Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 851042 Details for
Bug 1054201
Power off of a VM fails with unexpected exception from vdsm
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Vdsm log
vdsm.log (text/plain), 12.54 MB, created by
Tomas Dosek
on 2014-01-16 12:51:03 UTC
(
hide
)
Description:
Vdsm log
Filename:
MIME Type:
Creator:
Tomas Dosek
Created:
2014-01-16 12:51:03 UTC
Size:
12.54 MB
patch
obsolete
>VM Channels Listener::DEBUG::2014-01-16 16:01:02,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:01:02,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:01:02,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:01:02,150::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 16:01:02,282::task::579::TaskManager.Task::(_updateState) Task=`e28c3deb-7423-4721-9d0e-834a62be5a4f`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 16:01:02,283::task::579::TaskManager.Task::(_updateState) Task=`24c23cdf-d082-4535-af58-40c37f13dd82`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:01:02,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:01:02,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:01:02,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 16:01:02,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:01:02,284::task::1168::TaskManager.Task::(prepare) Task=`e28c3deb-7423-4721-9d0e-834a62be5a4f`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:01:02,284::task::1168::TaskManager.Task::(prepare) Task=`24c23cdf-d082-4535-af58-40c37f13dd82`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:01:02,285::task::579::TaskManager.Task::(_updateState) Task=`e28c3deb-7423-4721-9d0e-834a62be5a4f`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:01:02,285::task::579::TaskManager.Task::(_updateState) Task=`24c23cdf-d082-4535-af58-40c37f13dd82`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:01:02,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:01:02,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:01:02,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:01:02,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:01:02,286::task::974::TaskManager.Task::(_decref) Task=`e28c3deb-7423-4721-9d0e-834a62be5a4f`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:01:02,286::task::974::TaskManager.Task::(_decref) Task=`24c23cdf-d082-4535-af58-40c37f13dd82`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:02,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:01:02,798::task::579::TaskManager.Task::(_updateState) Task=`755ce49c-5cbc-4e60-90a1-27b399eba13a`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:01:02,798::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:01:02,798::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:01:02,799::task::1168::TaskManager.Task::(prepare) Task=`755ce49c-5cbc-4e60-90a1-27b399eba13a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:01:02,799::task::579::TaskManager.Task::(_updateState) Task=`755ce49c-5cbc-4e60-90a1-27b399eba13a`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:01:02,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:01:02,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:01:02,799::task::974::TaskManager.Task::(_decref) Task=`755ce49c-5cbc-4e60-90a1-27b399eba13a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:01:03,027::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:01:03,033::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:01:03,035::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:01:03,040::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:01:03,041::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:01:03,041::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:01:03,042::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:01:03,046::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-17177::DEBUG::2014-01-16 16:01:03,064::task::579::TaskManager.Task::(_updateState) Task=`213ce4e9-b4c2-4893-90c7-63fd6e482ad3`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:01:03,066::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:01:03,067::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:01:03,068::task::1168::TaskManager.Task::(prepare) Task=`213ce4e9-b4c2-4893-90c7-63fd6e482ad3`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:01:03,070::task::579::TaskManager.Task::(_updateState) Task=`213ce4e9-b4c2-4893-90c7-63fd6e482ad3`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:01:03,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:01:03,072::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:01:03,073::task::974::TaskManager.Task::(_decref) Task=`213ce4e9-b4c2-4893-90c7-63fd6e482ad3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:01:03,073::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251249 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:03,151::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:01:03,197::task::579::TaskManager.Task::(_updateState) Task=`51986b07-ab9b-4591-819e-31f130f5bebe`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:01:03,198::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:01:03,198::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:01:03,198::task::1168::TaskManager.Task::(prepare) Task=`51986b07-ab9b-4591-819e-31f130f5bebe`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:01:03,198::task::579::TaskManager.Task::(_updateState) Task=`51986b07-ab9b-4591-819e-31f130f5bebe`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:01:03,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:01:03,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:01:03,199::task::974::TaskManager.Task::(_decref) Task=`51986b07-ab9b-4591-819e-31f130f5bebe`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:01:03,199::task::579::TaskManager.Task::(_updateState) Task=`1f53b9ab-ffff-4393-8b74-e128472ed87f`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:01:03,199::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:01:03,199::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:01:03,200::task::1168::TaskManager.Task::(prepare) Task=`1f53b9ab-ffff-4393-8b74-e128472ed87f`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:01:03,200::task::579::TaskManager.Task::(_updateState) Task=`1f53b9ab-ffff-4393-8b74-e128472ed87f`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:01:03,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:01:03,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:01:03,200::task::974::TaskManager.Task::(_decref) Task=`1f53b9ab-ffff-4393-8b74-e128472ed87f`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:01:03,818::task::579::TaskManager.Task::(_updateState) Task=`a85e8e4c-6e29-4c8b-9411-9b92908a45a9`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:01:03,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:01:03,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:01:03,819::task::1168::TaskManager.Task::(prepare) Task=`a85e8e4c-6e29-4c8b-9411-9b92908a45a9`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:01:03,819::task::579::TaskManager.Task::(_updateState) Task=`a85e8e4c-6e29-4c8b-9411-9b92908a45a9`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:01:03,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:01:03,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:01:03,819::task::974::TaskManager.Task::(_decref) Task=`a85e8e4c-6e29-4c8b-9411-9b92908a45a9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:04,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:01:04,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:01:04,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:01:04,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:04,154::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:01:04,155::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:01:04,664::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:01:04,744::task::579::TaskManager.Task::(_updateState) Task=`a9558e0d-dba9-4e50-be55-2c5618bc9590`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:01:04,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:01:04,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:01:04,745::task::1168::TaskManager.Task::(prepare) Task=`a9558e0d-dba9-4e50-be55-2c5618bc9590`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:01:04,745::task::579::TaskManager.Task::(_updateState) Task=`a9558e0d-dba9-4e50-be55-2c5618bc9590`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:01:04,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:01:04,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:01:04,745::task::974::TaskManager.Task::(_decref) Task=`a9558e0d-dba9-4e50-be55-2c5618bc9590`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:05,156::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:05,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:06,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:01:06,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:01:06,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:06,666::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:07,159::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:01:07,159::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:01:07,159::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:01:07,784::task::579::TaskManager.Task::(_updateState) Task=`4217635c-547c-4099-afd4-24075db13f95`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:01:07,784::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:01:07,784::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:01:07,785::task::1168::TaskManager.Task::(prepare) Task=`4217635c-547c-4099-afd4-24075db13f95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:01:07,785::task::579::TaskManager.Task::(_updateState) Task=`4217635c-547c-4099-afd4-24075db13f95`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:01:07,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:01:07,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:01:07,785::task::974::TaskManager.Task::(_decref) Task=`4217635c-547c-4099-afd4-24075db13f95`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:08,160::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:01:08,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:01:08,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:01:08,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:08,667::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286014::DEBUG::2014-01-16 16:01:08,885::task::579::TaskManager.Task::(_updateState) Task=`8a55fba9-1f30-4b30-8995-979b0aac0060`::moving from state init -> state preparing >Thread-286014::INFO::2014-01-16 16:01:08,885::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286014::INFO::2014-01-16 16:01:08,886::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251249', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027403', 'lastCheck': '9.8', 'valid': True}} >Thread-286014::DEBUG::2014-01-16 16:01:08,886::task::1168::TaskManager.Task::(prepare) Task=`8a55fba9-1f30-4b30-8995-979b0aac0060`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251249', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027403', 'lastCheck': '9.8', 'valid': True}} >Thread-286014::DEBUG::2014-01-16 16:01:08,886::task::579::TaskManager.Task::(_updateState) Task=`8a55fba9-1f30-4b30-8995-979b0aac0060`::moving from state preparing -> state finished >Thread-286014::DEBUG::2014-01-16 16:01:08,886::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286014::DEBUG::2014-01-16 16:01:08,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286014::DEBUG::2014-01-16 16:01:08,886::task::974::TaskManager.Task::(_decref) Task=`8a55fba9-1f30-4b30-8995-979b0aac0060`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:01:09,086::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:01:09,103::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000226753 s, 18.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:09,162::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:10,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:01:10,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:10,669::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:10,670::task::579::TaskManager.Task::(_updateState) Task=`c04f5884-693f-418c-817e-9dfef1cc08b7`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:01:10,670::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:01:10,670::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:01:10,671::task::1168::TaskManager.Task::(prepare) Task=`c04f5884-693f-418c-817e-9dfef1cc08b7`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:01:10,671::task::579::TaskManager.Task::(_updateState) Task=`c04f5884-693f-418c-817e-9dfef1cc08b7`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:01:10,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:01:10,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:01:10,671::task::974::TaskManager.Task::(_decref) Task=`c04f5884-693f-418c-817e-9dfef1cc08b7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:10,673::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:01:10,673::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:01:10,681::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:10,683::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:10,684::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:11,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:01:11,432::task::579::TaskManager.Task::(_updateState) Task=`5ca12494-efe3-4822-a8f4-ac84c5f0bf0f`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:01:11,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:01:11,433::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:01:11,433::task::1168::TaskManager.Task::(prepare) Task=`5ca12494-efe3-4822-a8f4-ac84c5f0bf0f`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:01:11,433::task::579::TaskManager.Task::(_updateState) Task=`5ca12494-efe3-4822-a8f4-ac84c5f0bf0f`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:01:11,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:01:11,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:01:11,434::task::974::TaskManager.Task::(_decref) Task=`5ca12494-efe3-4822-a8f4-ac84c5f0bf0f`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:01:11,435::task::579::TaskManager.Task::(_updateState) Task=`a6180ebe-bf37-4f68-a841-b31ef7bc0092`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:01:11,435::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:01:11,436::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:01:11,436::task::1168::TaskManager.Task::(prepare) Task=`a6180ebe-bf37-4f68-a841-b31ef7bc0092`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:01:11,436::task::579::TaskManager.Task::(_updateState) Task=`a6180ebe-bf37-4f68-a841-b31ef7bc0092`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:01:11,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:01:11,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:01:11,437::task::974::TaskManager.Task::(_decref) Task=`a6180ebe-bf37-4f68-a841-b31ef7bc0092`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:01:11,447::task::579::TaskManager.Task::(_updateState) Task=`0f1337ad-b4d3-4915-a670-52f2b4a104d3`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:01:11,447::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:01:11,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:01:11,448::task::1168::TaskManager.Task::(prepare) Task=`0f1337ad-b4d3-4915-a670-52f2b4a104d3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:01:11,448::task::579::TaskManager.Task::(_updateState) Task=`0f1337ad-b4d3-4915-a670-52f2b4a104d3`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:01:11,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:01:11,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:01:11,448::task::974::TaskManager.Task::(_decref) Task=`0f1337ad-b4d3-4915-a670-52f2b4a104d3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:12,165::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:12,685::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:01:13,082::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:01:13,100::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000299395 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:13,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:01:13,503::task::579::TaskManager.Task::(_updateState) Task=`c06d721f-d14b-40ca-8187-2b60140b1e1b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:01:13,503::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:01:13,505::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:01:13,505::task::1168::TaskManager.Task::(prepare) Task=`c06d721f-d14b-40ca-8187-2b60140b1e1b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:01:13,505::task::579::TaskManager.Task::(_updateState) Task=`c06d721f-d14b-40ca-8187-2b60140b1e1b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:01:13,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:01:13,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:01:13,505::task::974::TaskManager.Task::(_decref) Task=`c06d721f-d14b-40ca-8187-2b60140b1e1b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:14,167::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:14,687::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:15,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:15,688::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:16,170::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:01:16,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:16,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:17,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:18,173::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:18,690::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:01:19,110::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:01:19,127::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028112 s, 14.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:19,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:01:19,545::task::579::TaskManager.Task::(_updateState) Task=`51ca20ee-2c2e-425f-8dc5-349c8643db0d`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:01:19,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:01:19,546::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:01:19,546::task::1168::TaskManager.Task::(prepare) Task=`51ca20ee-2c2e-425f-8dc5-349c8643db0d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:01:19,546::task::579::TaskManager.Task::(_updateState) Task=`51ca20ee-2c2e-425f-8dc5-349c8643db0d`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:01:19,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:01:19,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:01:19,547::task::974::TaskManager.Task::(_decref) Task=`51ca20ee-2c2e-425f-8dc5-349c8643db0d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:20,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:20,692::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:20,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:21,176::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:01:21,176::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:01:21,176::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:22,178::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:01:22,183::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:01:22,393::task::579::TaskManager.Task::(_updateState) Task=`67dc0bfd-5907-4a0d-b1da-6f68d3b346bc`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:01:22,394::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:01:22,396::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:01:22,396::task::1168::TaskManager.Task::(prepare) Task=`67dc0bfd-5907-4a0d-b1da-6f68d3b346bc`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:01:22,396::task::579::TaskManager.Task::(_updateState) Task=`67dc0bfd-5907-4a0d-b1da-6f68d3b346bc`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:01:22,396::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:01:22,396::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:01:22,396::task::974::TaskManager.Task::(_decref) Task=`67dc0bfd-5907-4a0d-b1da-6f68d3b346bc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:22,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:01:23,050::task::579::TaskManager.Task::(_updateState) Task=`3f33faf4-cc69-44b5-99ef-a17ce979a48d`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:01:23,050::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:01:23,050::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:01:23,051::task::1168::TaskManager.Task::(prepare) Task=`3f33faf4-cc69-44b5-99ef-a17ce979a48d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:01:23,051::task::579::TaskManager.Task::(_updateState) Task=`3f33faf4-cc69-44b5-99ef-a17ce979a48d`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:01:23,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:01:23,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:01:23,051::task::974::TaskManager.Task::(_decref) Task=`3f33faf4-cc69-44b5-99ef-a17ce979a48d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:01:23,109::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:01:23,125::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291812 s, 1.3 MB/s\n'; <rc> = 0 >Thread-59295::DEBUG::2014-01-16 16:01:23,168::task::579::TaskManager.Task::(_updateState) Task=`e0080043-4d26-4de7-b733-ca129a4970cb`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:01:23,168::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:01:23,169::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:01:23,169::task::1168::TaskManager.Task::(prepare) Task=`e0080043-4d26-4de7-b733-ca129a4970cb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:01:23,169::task::579::TaskManager.Task::(_updateState) Task=`e0080043-4d26-4de7-b733-ca129a4970cb`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:01:23,169::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:01:23,169::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:01:23,169::task::974::TaskManager.Task::(_decref) Task=`e0080043-4d26-4de7-b733-ca129a4970cb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:23,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:01:23,185::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:01:23,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:24,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:01:24,186::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:24,695::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286020::DEBUG::2014-01-16 16:01:24,754::task::579::TaskManager.Task::(_updateState) Task=`7157a424-6c45-4aff-8723-ff3abe6a6e7c`::moving from state init -> state preparing >Thread-286020::INFO::2014-01-16 16:01:24,755::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286020::INFO::2014-01-16 16:01:24,755::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291812', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028112', 'lastCheck': '5.6', 'valid': True}} >Thread-286020::DEBUG::2014-01-16 16:01:24,755::task::1168::TaskManager.Task::(prepare) Task=`7157a424-6c45-4aff-8723-ff3abe6a6e7c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291812', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028112', 'lastCheck': '5.6', 'valid': True}} >Thread-286020::DEBUG::2014-01-16 16:01:24,755::task::579::TaskManager.Task::(_updateState) Task=`7157a424-6c45-4aff-8723-ff3abe6a6e7c`::moving from state preparing -> state finished >Thread-286020::DEBUG::2014-01-16 16:01:24,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286020::DEBUG::2014-01-16 16:01:24,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286020::DEBUG::2014-01-16 16:01:24,756::task::974::TaskManager.Task::(_decref) Task=`7157a424-6c45-4aff-8723-ff3abe6a6e7c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:25,187::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:01:25,188::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:25,697::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:01:25,697::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:01:25,701::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:26,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:26,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:27,190::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:01:27,190::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:01:27,887::task::579::TaskManager.Task::(_updateState) Task=`bb40c52b-f5ea-4b4c-9299-9554292b8575`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:01:27,887::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:01:27,887::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:01:27,888::task::1168::TaskManager.Task::(prepare) Task=`bb40c52b-f5ea-4b4c-9299-9554292b8575`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:01:27,888::task::579::TaskManager.Task::(_updateState) Task=`bb40c52b-f5ea-4b4c-9299-9554292b8575`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:01:27,888::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:01:27,888::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:01:27,888::task::974::TaskManager.Task::(_decref) Task=`bb40c52b-f5ea-4b4c-9299-9554292b8575`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:28,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:01:28,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:28,704::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:01:29,135::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:01:29,152::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213103 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:29,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:01:29,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:01:29,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:01:29,193::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:30,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:01:30,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:01:30,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:30,705::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:30,706::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:01:30,872::task::579::TaskManager.Task::(_updateState) Task=`caad36c4-9fab-4579-9919-78d287e442e1`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:01:30,872::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:01:30,872::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:01:30,872::task::1168::TaskManager.Task::(prepare) Task=`caad36c4-9fab-4579-9919-78d287e442e1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:01:30,873::task::579::TaskManager.Task::(_updateState) Task=`caad36c4-9fab-4579-9919-78d287e442e1`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:01:30,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:01:30,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:01:30,873::task::974::TaskManager.Task::(_decref) Task=`caad36c4-9fab-4579-9919-78d287e442e1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:31,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:01:31,195::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:01:31,347::task::579::TaskManager.Task::(_updateState) Task=`f0db25c4-d36c-46a4-b432-e1d243ff3ae0`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:01:31,348::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:01:31,348::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:01:31,348::task::1168::TaskManager.Task::(prepare) Task=`f0db25c4-d36c-46a4-b432-e1d243ff3ae0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:01:31,348::task::579::TaskManager.Task::(_updateState) Task=`f0db25c4-d36c-46a4-b432-e1d243ff3ae0`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:01:31,348::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:01:31,348::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:01:31,349::task::974::TaskManager.Task::(_decref) Task=`f0db25c4-d36c-46a4-b432-e1d243ff3ae0`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:01:31,397::task::579::TaskManager.Task::(_updateState) Task=`3e25b5ef-7fdb-48f1-8f79-e1f97df63b66`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:01:31,397::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:01:31,398::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:01:31,398::task::1168::TaskManager.Task::(prepare) Task=`3e25b5ef-7fdb-48f1-8f79-e1f97df63b66`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:01:31,398::task::579::TaskManager.Task::(_updateState) Task=`3e25b5ef-7fdb-48f1-8f79-e1f97df63b66`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:01:31,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:01:31,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:01:31,398::task::974::TaskManager.Task::(_decref) Task=`3e25b5ef-7fdb-48f1-8f79-e1f97df63b66`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:01:31,568::task::579::TaskManager.Task::(_updateState) Task=`27378ad7-61a0-417f-9db4-f28de118c950`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:01:31,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:01:31,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:01:31,568::task::1168::TaskManager.Task::(prepare) Task=`27378ad7-61a0-417f-9db4-f28de118c950`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:01:31,569::task::579::TaskManager.Task::(_updateState) Task=`27378ad7-61a0-417f-9db4-f28de118c950`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:01:31,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:01:31,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:01:31,569::task::974::TaskManager.Task::(_decref) Task=`27378ad7-61a0-417f-9db4-f28de118c950`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:01:31,670::task::579::TaskManager.Task::(_updateState) Task=`d52a18e1-d974-4cd5-8c57-071d43f0207b`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:01:31,670::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:01:31,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:01:31,671::task::1168::TaskManager.Task::(prepare) Task=`d52a18e1-d974-4cd5-8c57-071d43f0207b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:01:31,671::task::579::TaskManager.Task::(_updateState) Task=`d52a18e1-d974-4cd5-8c57-071d43f0207b`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:01:31,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:01:31,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:01:31,671::task::974::TaskManager.Task::(_decref) Task=`d52a18e1-d974-4cd5-8c57-071d43f0207b`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:01:31,672::task::579::TaskManager.Task::(_updateState) Task=`a815a6f3-4d65-49e7-bb7d-cac526970e87`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:01:31,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:01:31,672::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:01:31,672::task::1168::TaskManager.Task::(prepare) Task=`a815a6f3-4d65-49e7-bb7d-cac526970e87`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:01:31,672::task::579::TaskManager.Task::(_updateState) Task=`a815a6f3-4d65-49e7-bb7d-cac526970e87`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:01:31,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:01:31,672::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:01:31,673::task::974::TaskManager.Task::(_decref) Task=`a815a6f3-4d65-49e7-bb7d-cac526970e87`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:01:31,673::task::579::TaskManager.Task::(_updateState) Task=`2d471be0-544c-4f75-9980-1889d6bef593`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:01:31,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:01:31,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:01:31,673::task::1168::TaskManager.Task::(prepare) Task=`2d471be0-544c-4f75-9980-1889d6bef593`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:01:31,674::task::579::TaskManager.Task::(_updateState) Task=`2d471be0-544c-4f75-9980-1889d6bef593`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:01:31,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:01:31,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:01:31,674::task::974::TaskManager.Task::(_decref) Task=`2d471be0-544c-4f75-9980-1889d6bef593`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:32,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:01:32,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:01:32,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:01:32,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:01:32,569::task::579::TaskManager.Task::(_updateState) Task=`c17ec00f-a859-4e94-883f-27d17b639ec2`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:01:32,569::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:01:32,569::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:01:32,569::task::1168::TaskManager.Task::(prepare) Task=`c17ec00f-a859-4e94-883f-27d17b639ec2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:01:32,570::task::579::TaskManager.Task::(_updateState) Task=`c17ec00f-a859-4e94-883f-27d17b639ec2`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:01:32,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:01:32,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:01:32,570::task::974::TaskManager.Task::(_decref) Task=`c17ec00f-a859-4e94-883f-27d17b639ec2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:32,708::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:01:32,851::task::579::TaskManager.Task::(_updateState) Task=`549978f3-8ec8-4808-a0f0-4d636e87a47b`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:01:32,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:01:32,852::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:01:32,852::task::1168::TaskManager.Task::(prepare) Task=`549978f3-8ec8-4808-a0f0-4d636e87a47b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:01:32,852::task::579::TaskManager.Task::(_updateState) Task=`549978f3-8ec8-4808-a0f0-4d636e87a47b`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:01:32,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:01:32,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:01:32,853::task::974::TaskManager.Task::(_decref) Task=`549978f3-8ec8-4808-a0f0-4d636e87a47b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:01:33,135::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:01:33,151::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000252122 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:33,198::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:34,199::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:01:34,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:01:34,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:01:34,200::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:34,201::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:01:34,203::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:01:34,709::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:35,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:35,710::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:36,205::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:01:36,205::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:01:36,206::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:36,712::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:37,207::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:01:37,207::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:01:37,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:38,209::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:01:38,209::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:01:38,209::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:01:38,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:38,713::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:01:39,161::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:01:39,177::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000255619 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:39,210::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:40,211::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:01:40,211::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:01:40,563::task::579::TaskManager.Task::(_updateState) Task=`b74599f4-03f1-4a2e-bfaf-00542a862eff`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:01:40,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:01:40,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:01:40,564::task::1168::TaskManager.Task::(prepare) Task=`b74599f4-03f1-4a2e-bfaf-00542a862eff`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:01:40,564::task::579::TaskManager.Task::(_updateState) Task=`b74599f4-03f1-4a2e-bfaf-00542a862eff`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:01:40,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:01:40,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:01:40,564::task::974::TaskManager.Task::(_decref) Task=`b74599f4-03f1-4a2e-bfaf-00542a862eff`::ref 0 aborting False >Thread-286026::DEBUG::2014-01-16 16:01:40,675::task::579::TaskManager.Task::(_updateState) Task=`31fb8648-af9e-46f4-a0e8-e8c9a7480673`::moving from state init -> state preparing >Thread-286026::INFO::2014-01-16 16:01:40,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286026::INFO::2014-01-16 16:01:40,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252122', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255619', 'lastCheck': '1.5', 'valid': True}} >Thread-286026::DEBUG::2014-01-16 16:01:40,676::task::1168::TaskManager.Task::(prepare) Task=`31fb8648-af9e-46f4-a0e8-e8c9a7480673`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252122', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255619', 'lastCheck': '1.5', 'valid': True}} >Thread-286026::DEBUG::2014-01-16 16:01:40,676::task::579::TaskManager.Task::(_updateState) Task=`31fb8648-af9e-46f4-a0e8-e8c9a7480673`::moving from state preparing -> state finished >Thread-286026::DEBUG::2014-01-16 16:01:40,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286026::DEBUG::2014-01-16 16:01:40,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286026::DEBUG::2014-01-16 16:01:40,676::task::974::TaskManager.Task::(_decref) Task=`31fb8648-af9e-46f4-a0e8-e8c9a7480673`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:40,714::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:40,716::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:01:40,716::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:01:40,718::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:41,213::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:01:41,304::task::579::TaskManager.Task::(_updateState) Task=`0cf0f9a6-5465-4ad4-9ffe-a8839fdcc0a0`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:01:41,304::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:01:41,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:01:41,304::task::1168::TaskManager.Task::(prepare) Task=`0cf0f9a6-5465-4ad4-9ffe-a8839fdcc0a0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:01:41,305::task::579::TaskManager.Task::(_updateState) Task=`0cf0f9a6-5465-4ad4-9ffe-a8839fdcc0a0`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:01:41,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:01:41,305::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:01:41,305::task::974::TaskManager.Task::(_decref) Task=`0cf0f9a6-5465-4ad4-9ffe-a8839fdcc0a0`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:01:41,305::task::579::TaskManager.Task::(_updateState) Task=`fa335693-c991-4e3b-9bea-e98f07ee9b2e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:01:41,306::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:01:41,306::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:01:41,306::task::1168::TaskManager.Task::(prepare) Task=`fa335693-c991-4e3b-9bea-e98f07ee9b2e`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:01:41,306::task::579::TaskManager.Task::(_updateState) Task=`fa335693-c991-4e3b-9bea-e98f07ee9b2e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:01:41,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:01:41,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:01:41,307::task::974::TaskManager.Task::(_decref) Task=`fa335693-c991-4e3b-9bea-e98f07ee9b2e`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:01:41,307::task::579::TaskManager.Task::(_updateState) Task=`0508bbd9-98e3-43ff-b895-4dfc74ca0fa1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:01:41,307::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:01:41,307::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:01:41,308::task::1168::TaskManager.Task::(prepare) Task=`0508bbd9-98e3-43ff-b895-4dfc74ca0fa1`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:01:41,308::task::579::TaskManager.Task::(_updateState) Task=`0508bbd9-98e3-43ff-b895-4dfc74ca0fa1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:01:41,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:01:41,308::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:01:41,308::task::974::TaskManager.Task::(_decref) Task=`0508bbd9-98e3-43ff-b895-4dfc74ca0fa1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:42,214::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:42,719::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:01:43,159::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:01:43,176::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000309689 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:43,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:44,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:01:44,400::task::579::TaskManager.Task::(_updateState) Task=`6ff24e85-01e8-4232-9e01-9094001428c8`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:01:44,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:01:44,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:01:44,401::task::1168::TaskManager.Task::(prepare) Task=`6ff24e85-01e8-4232-9e01-9094001428c8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:01:44,401::task::579::TaskManager.Task::(_updateState) Task=`6ff24e85-01e8-4232-9e01-9094001428c8`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:01:44,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:01:44,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:01:44,402::task::974::TaskManager.Task::(_decref) Task=`6ff24e85-01e8-4232-9e01-9094001428c8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:44,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:45,218::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:45,722::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:46,219::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:01:46,220::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:46,723::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:47,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:48,222::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:48,724::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:01:49,182::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:01:49,199::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000318868 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:49,223::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:50,224::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:50,726::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:01:50,727::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:51,225::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:01:51,225::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:01:51,226::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:01:51,392::task::579::TaskManager.Task::(_updateState) Task=`42b006a6-9b83-43ee-b3ee-f612735c25b4`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:01:51,392::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:01:51,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:01:51,393::task::1168::TaskManager.Task::(prepare) Task=`42b006a6-9b83-43ee-b3ee-f612735c25b4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:01:51,393::task::579::TaskManager.Task::(_updateState) Task=`42b006a6-9b83-43ee-b3ee-f612735c25b4`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:01:51,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:01:51,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:01:51,393::task::974::TaskManager.Task::(_decref) Task=`42b006a6-9b83-43ee-b3ee-f612735c25b4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:01:52,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:01:52,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:52,728::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:01:53,183::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:01:53,202::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267786 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:53,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:01:53,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:01:53,229::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:54,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:01:54,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:01:54,689::task::579::TaskManager.Task::(_updateState) Task=`19e2afc9-efc7-49b1-8139-e5bad23498cb`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:01:54,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:01:54,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:01:54,689::task::1168::TaskManager.Task::(prepare) Task=`19e2afc9-efc7-49b1-8139-e5bad23498cb`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:01:54,690::task::579::TaskManager.Task::(_updateState) Task=`19e2afc9-efc7-49b1-8139-e5bad23498cb`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:01:54,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:01:54,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:01:54,690::task::974::TaskManager.Task::(_decref) Task=`19e2afc9-efc7-49b1-8139-e5bad23498cb`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:01:54,690::task::579::TaskManager.Task::(_updateState) Task=`0f00fc3a-d890-438f-bc84-2ba860195481`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:01:54,691::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:01:54,691::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:01:54,691::task::1168::TaskManager.Task::(prepare) Task=`0f00fc3a-d890-438f-bc84-2ba860195481`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:01:54,691::task::579::TaskManager.Task::(_updateState) Task=`0f00fc3a-d890-438f-bc84-2ba860195481`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:01:54,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:01:54,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:01:54,691::task::974::TaskManager.Task::(_decref) Task=`0f00fc3a-d890-438f-bc84-2ba860195481`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:54,730::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:55,231::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:01:55,232::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:01:55,732::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:01:55,732::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:01:55,739::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:56,233::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286032::DEBUG::2014-01-16 16:01:56,419::task::579::TaskManager.Task::(_updateState) Task=`e61e18fc-f9a2-4c99-9149-00fbd8da746e`::moving from state init -> state preparing >Thread-286032::INFO::2014-01-16 16:01:56,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286032::INFO::2014-01-16 16:01:56,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267786', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318868', 'lastCheck': '7.2', 'valid': True}} >Thread-286032::DEBUG::2014-01-16 16:01:56,420::task::1168::TaskManager.Task::(prepare) Task=`e61e18fc-f9a2-4c99-9149-00fbd8da746e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267786', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318868', 'lastCheck': '7.2', 'valid': True}} >Thread-286032::DEBUG::2014-01-16 16:01:56,420::task::579::TaskManager.Task::(_updateState) Task=`e61e18fc-f9a2-4c99-9149-00fbd8da746e`::moving from state preparing -> state finished >Thread-286032::DEBUG::2014-01-16 16:01:56,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286032::DEBUG::2014-01-16 16:01:56,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286032::DEBUG::2014-01-16 16:01:56,420::task::974::TaskManager.Task::(_decref) Task=`e61e18fc-f9a2-4c99-9149-00fbd8da746e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:56,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:01:57,234::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:01:57,235::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:01:58,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:01:58,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:01:58,692::task::579::TaskManager.Task::(_updateState) Task=`18afa010-b5ab-4faf-aca5-9e85735b2697`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:01:58,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:01:58,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:01:58,693::task::1168::TaskManager.Task::(prepare) Task=`18afa010-b5ab-4faf-aca5-9e85735b2697`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:01:58,693::task::579::TaskManager.Task::(_updateState) Task=`18afa010-b5ab-4faf-aca5-9e85735b2697`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:01:58,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:01:58,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:01:58,693::task::974::TaskManager.Task::(_decref) Task=`18afa010-b5ab-4faf-aca5-9e85735b2697`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:01:58,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:01:59,205::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:01:59,221::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000254105 s, 16.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:01:59,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:01:59,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:01:59,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:01:59,239::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:00,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:02:00,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:02:00,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:00,742::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:00,743::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:02:01,030::task::579::TaskManager.Task::(_updateState) Task=`81d9ae43-d50d-4bd9-a6ac-c5d8fb92ad7b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:02:01,030::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:02:01,031::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:02:01,031::task::1168::TaskManager.Task::(prepare) Task=`81d9ae43-d50d-4bd9-a6ac-c5d8fb92ad7b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:02:01,031::task::579::TaskManager.Task::(_updateState) Task=`81d9ae43-d50d-4bd9-a6ac-c5d8fb92ad7b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:02:01,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:02:01,031::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:02:01,031::task::974::TaskManager.Task::(_decref) Task=`81d9ae43-d50d-4bd9-a6ac-c5d8fb92ad7b`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:02:01,032::task::579::TaskManager.Task::(_updateState) Task=`161a6b13-fb4b-4b50-bed9-3598e21fb37c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:02:01,032::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:02:01,032::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:02:01,032::task::1168::TaskManager.Task::(prepare) Task=`161a6b13-fb4b-4b50-bed9-3598e21fb37c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:02:01,032::task::579::TaskManager.Task::(_updateState) Task=`161a6b13-fb4b-4b50-bed9-3598e21fb37c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:02:01,032::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:02:01,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:02:01,033::task::974::TaskManager.Task::(_decref) Task=`161a6b13-fb4b-4b50-bed9-3598e21fb37c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:01,241::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:02:01,241::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:02,243::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:02:02,243::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:02:02,243::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:02:02,243::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:02:02,378::task::579::TaskManager.Task::(_updateState) Task=`5caf37de-1f1c-4af7-8b49-8d5837a82015`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:02:02,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:02:02,379::task::579::TaskManager.Task::(_updateState) Task=`68f65005-9c62-448f-a4ab-b5fbaffce069`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:02:02,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:02:02,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:02:02,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:02:02,381::task::1168::TaskManager.Task::(prepare) Task=`5caf37de-1f1c-4af7-8b49-8d5837a82015`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:02:02,381::task::1168::TaskManager.Task::(prepare) Task=`68f65005-9c62-448f-a4ab-b5fbaffce069`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:02:02,381::task::579::TaskManager.Task::(_updateState) Task=`5caf37de-1f1c-4af7-8b49-8d5837a82015`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:02:02,381::task::579::TaskManager.Task::(_updateState) Task=`68f65005-9c62-448f-a4ab-b5fbaffce069`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:02:02,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:02:02,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:02:02,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:02:02,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:02:02,382::task::974::TaskManager.Task::(_decref) Task=`5caf37de-1f1c-4af7-8b49-8d5837a82015`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:02:02,383::task::974::TaskManager.Task::(_decref) Task=`68f65005-9c62-448f-a4ab-b5fbaffce069`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:02:02,745::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:02:02,959::task::579::TaskManager.Task::(_updateState) Task=`f7558c5b-d991-4d8e-a8d5-dbe50a3ecb74`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:02:02,959::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:02:02,960::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:02:02,960::task::1168::TaskManager.Task::(prepare) Task=`f7558c5b-d991-4d8e-a8d5-dbe50a3ecb74`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:02:02,960::task::579::TaskManager.Task::(_updateState) Task=`f7558c5b-d991-4d8e-a8d5-dbe50a3ecb74`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:02:02,960::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:02:02,960::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:02:02,960::task::974::TaskManager.Task::(_decref) Task=`f7558c5b-d991-4d8e-a8d5-dbe50a3ecb74`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:02:03,210::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:02:03,226::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000321082 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:02:03,235::task::579::TaskManager.Task::(_updateState) Task=`f5c654fb-c4e5-4c32-bb34-1a753a856502`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:02:03,235::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:02:03,235::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:02:03,236::task::1168::TaskManager.Task::(prepare) Task=`f5c654fb-c4e5-4c32-bb34-1a753a856502`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:02:03,236::task::579::TaskManager.Task::(_updateState) Task=`f5c654fb-c4e5-4c32-bb34-1a753a856502`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:02:03,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:02:03,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:02:03,236::task::974::TaskManager.Task::(_decref) Task=`f5c654fb-c4e5-4c32-bb34-1a753a856502`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:03,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:02:03,286::task::579::TaskManager.Task::(_updateState) Task=`7820cdc9-6cfa-45b1-883b-28eaf0b2c368`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:02:03,287::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:02:03,287::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:02:03,287::task::1168::TaskManager.Task::(prepare) Task=`7820cdc9-6cfa-45b1-883b-28eaf0b2c368`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:02:03,287::task::579::TaskManager.Task::(_updateState) Task=`7820cdc9-6cfa-45b1-883b-28eaf0b2c368`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:02:03,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:02:03,288::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:02:03,288::task::974::TaskManager.Task::(_decref) Task=`7820cdc9-6cfa-45b1-883b-28eaf0b2c368`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:02:03,288::task::579::TaskManager.Task::(_updateState) Task=`6d3ab47e-75ba-46ec-bc60-47a7e99b7759`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:02:03,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:02:03,289::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:02:03,289::task::1168::TaskManager.Task::(prepare) Task=`6d3ab47e-75ba-46ec-bc60-47a7e99b7759`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:02:03,289::task::579::TaskManager.Task::(_updateState) Task=`6d3ab47e-75ba-46ec-bc60-47a7e99b7759`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:02:03,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:02:03,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:02:03,289::task::974::TaskManager.Task::(_decref) Task=`6d3ab47e-75ba-46ec-bc60-47a7e99b7759`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:02:03,995::task::579::TaskManager.Task::(_updateState) Task=`511dbc86-c11f-448d-aecb-54c6f6405a3f`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:02:03,996::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:02:03,996::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:02:03,996::task::1168::TaskManager.Task::(prepare) Task=`511dbc86-c11f-448d-aecb-54c6f6405a3f`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:02:03,996::task::579::TaskManager.Task::(_updateState) Task=`511dbc86-c11f-448d-aecb-54c6f6405a3f`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:02:03,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:02:03,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:02:03,997::task::974::TaskManager.Task::(_decref) Task=`511dbc86-c11f-448d-aecb-54c6f6405a3f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:04,245::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:02:04,245::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:02:04,246::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:02:04,246::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:04,246::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:02:04,247::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:02:04,746::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:02:04,921::task::579::TaskManager.Task::(_updateState) Task=`19c26bd5-72d4-4d8c-8b9d-c4ae0f2815a2`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:02:04,921::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:02:04,922::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:02:04,922::task::1168::TaskManager.Task::(prepare) Task=`19c26bd5-72d4-4d8c-8b9d-c4ae0f2815a2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:02:04,922::task::579::TaskManager.Task::(_updateState) Task=`19c26bd5-72d4-4d8c-8b9d-c4ae0f2815a2`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:02:04,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:02:04,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:02:04,922::task::974::TaskManager.Task::(_decref) Task=`19c26bd5-72d4-4d8c-8b9d-c4ae0f2815a2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:05,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:05,747::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:06,249::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:02:06,249::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:02:06,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:06,749::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:07,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:02:07,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:02:07,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:02:07,957::task::579::TaskManager.Task::(_updateState) Task=`07eeb5f3-9a00-4d0e-98af-8c41fbe93c2e`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:02:07,957::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:02:07,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:02:07,958::task::1168::TaskManager.Task::(prepare) Task=`07eeb5f3-9a00-4d0e-98af-8c41fbe93c2e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:02:07,958::task::579::TaskManager.Task::(_updateState) Task=`07eeb5f3-9a00-4d0e-98af-8c41fbe93c2e`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:02:07,958::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:02:07,958::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:02:07,958::task::974::TaskManager.Task::(_decref) Task=`07eeb5f3-9a00-4d0e-98af-8c41fbe93c2e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:08,252::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:02:08,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:02:08,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:02:08,253::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:08,750::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:02:09,227::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:02:09,244::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000226739 s, 18.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:09,254::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:10,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:02:10,256::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:10,751::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:10,752::task::579::TaskManager.Task::(_updateState) Task=`82acabd3-3a1d-4d45-8df8-8e7a95d7aa53`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:02:10,752::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:02:10,753::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:02:10,753::task::1168::TaskManager.Task::(prepare) Task=`82acabd3-3a1d-4d45-8df8-8e7a95d7aa53`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:02:10,753::task::579::TaskManager.Task::(_updateState) Task=`82acabd3-3a1d-4d45-8df8-8e7a95d7aa53`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:02:10,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:02:10,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:02:10,753::task::974::TaskManager.Task::(_decref) Task=`82acabd3-3a1d-4d45-8df8-8e7a95d7aa53`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:02:10,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:02:10,755::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:02:10,756::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:10,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:10,759::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:11,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:02:11,627::task::579::TaskManager.Task::(_updateState) Task=`28fe5ad2-088a-43e6-a15a-5890ca215231`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:02:11,627::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:02:11,627::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:02:11,627::task::1168::TaskManager.Task::(prepare) Task=`28fe5ad2-088a-43e6-a15a-5890ca215231`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:02:11,628::task::579::TaskManager.Task::(_updateState) Task=`28fe5ad2-088a-43e6-a15a-5890ca215231`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:02:11,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:02:11,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:02:11,628::task::974::TaskManager.Task::(_decref) Task=`28fe5ad2-088a-43e6-a15a-5890ca215231`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:02:11,850::task::579::TaskManager.Task::(_updateState) Task=`d9e2e06a-eecf-4931-b1d6-5aa064eb4549`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:02:11,850::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:02:11,851::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:02:11,851::task::1168::TaskManager.Task::(prepare) Task=`d9e2e06a-eecf-4931-b1d6-5aa064eb4549`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:02:11,851::task::579::TaskManager.Task::(_updateState) Task=`d9e2e06a-eecf-4931-b1d6-5aa064eb4549`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:02:11,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:02:11,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:02:11,852::task::974::TaskManager.Task::(_decref) Task=`d9e2e06a-eecf-4931-b1d6-5aa064eb4549`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:02:11,852::task::579::TaskManager.Task::(_updateState) Task=`705160a7-8f4b-441e-9be8-42bc319fd1b7`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:02:11,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:02:11,852::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:02:11,852::task::1168::TaskManager.Task::(prepare) Task=`705160a7-8f4b-441e-9be8-42bc319fd1b7`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:02:11,852::task::579::TaskManager.Task::(_updateState) Task=`705160a7-8f4b-441e-9be8-42bc319fd1b7`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:02:11,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:02:11,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:02:11,853::task::974::TaskManager.Task::(_decref) Task=`705160a7-8f4b-441e-9be8-42bc319fd1b7`::ref 0 aborting False >Thread-286038::DEBUG::2014-01-16 16:02:12,250::task::579::TaskManager.Task::(_updateState) Task=`9e3843a8-740c-4437-bf7f-14aa424fc87d`::moving from state init -> state preparing >Thread-286038::INFO::2014-01-16 16:02:12,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286038::INFO::2014-01-16 16:02:12,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321082', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226739', 'lastCheck': '3.0', 'valid': True}} >Thread-286038::DEBUG::2014-01-16 16:02:12,251::task::1168::TaskManager.Task::(prepare) Task=`9e3843a8-740c-4437-bf7f-14aa424fc87d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321082', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226739', 'lastCheck': '3.0', 'valid': True}} >Thread-286038::DEBUG::2014-01-16 16:02:12,251::task::579::TaskManager.Task::(_updateState) Task=`9e3843a8-740c-4437-bf7f-14aa424fc87d`::moving from state preparing -> state finished >Thread-286038::DEBUG::2014-01-16 16:02:12,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286038::DEBUG::2014-01-16 16:02:12,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286038::DEBUG::2014-01-16 16:02:12,252::task::974::TaskManager.Task::(_decref) Task=`9e3843a8-740c-4437-bf7f-14aa424fc87d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:12,258::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:12,760::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:02:13,233::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:02:13,250::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267203 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:13,265::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:02:13,600::task::579::TaskManager.Task::(_updateState) Task=`63405112-9293-4844-bd19-c41b7a813ffe`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:02:13,601::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:02:13,602::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:02:13,602::task::1168::TaskManager.Task::(prepare) Task=`63405112-9293-4844-bd19-c41b7a813ffe`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:02:13,602::task::579::TaskManager.Task::(_updateState) Task=`63405112-9293-4844-bd19-c41b7a813ffe`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:02:13,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:02:13,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:02:13,603::task::974::TaskManager.Task::(_decref) Task=`63405112-9293-4844-bd19-c41b7a813ffe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:14,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:14,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:15,267::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:15,763::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:16,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:02:16,268::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:16,764::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:17,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:18,270::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:18,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:02:19,250::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:02:19,266::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000256407 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:19,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:02:19,724::task::579::TaskManager.Task::(_updateState) Task=`41e23bbb-de53-4681-88ee-00cb5d98269c`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:02:19,724::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:02:19,725::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:02:19,725::task::1168::TaskManager.Task::(prepare) Task=`41e23bbb-de53-4681-88ee-00cb5d98269c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:02:19,725::task::579::TaskManager.Task::(_updateState) Task=`41e23bbb-de53-4681-88ee-00cb5d98269c`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:02:19,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:02:19,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:02:19,726::task::974::TaskManager.Task::(_decref) Task=`41e23bbb-de53-4681-88ee-00cb5d98269c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:20,272::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:20,767::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:20,769::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:21,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:02:21,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:02:21,274::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:22,274::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:02:22,275::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:02:22,468::task::579::TaskManager.Task::(_updateState) Task=`f633f382-9420-4314-b95d-06f1eccefc2e`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:02:22,468::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:02:22,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:02:22,470::task::1168::TaskManager.Task::(prepare) Task=`f633f382-9420-4314-b95d-06f1eccefc2e`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:02:22,470::task::579::TaskManager.Task::(_updateState) Task=`f633f382-9420-4314-b95d-06f1eccefc2e`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:02:22,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:02:22,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:02:22,471::task::974::TaskManager.Task::(_decref) Task=`f633f382-9420-4314-b95d-06f1eccefc2e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:02:22,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:02:23,219::task::579::TaskManager.Task::(_updateState) Task=`4f83a838-79c7-4098-a174-49a87627f170`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:02:23,219::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:02:23,220::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:02:23,220::task::1168::TaskManager.Task::(prepare) Task=`4f83a838-79c7-4098-a174-49a87627f170`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:02:23,220::task::579::TaskManager.Task::(_updateState) Task=`4f83a838-79c7-4098-a174-49a87627f170`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:02:23,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:02:23,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:02:23,220::task::974::TaskManager.Task::(_decref) Task=`4f83a838-79c7-4098-a174-49a87627f170`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:02:23,257::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:02:23,275::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000311955 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:23,276::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:02:23,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:02:23,279::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-59295::DEBUG::2014-01-16 16:02:23,347::task::579::TaskManager.Task::(_updateState) Task=`54c23198-0fde-426e-8e16-091ce6827565`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:02:23,347::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:02:23,347::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:02:23,348::task::1168::TaskManager.Task::(prepare) Task=`54c23198-0fde-426e-8e16-091ce6827565`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:02:23,348::task::579::TaskManager.Task::(_updateState) Task=`54c23198-0fde-426e-8e16-091ce6827565`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:02:23,348::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:02:23,348::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:02:23,348::task::974::TaskManager.Task::(_decref) Task=`54c23198-0fde-426e-8e16-091ce6827565`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:24,280::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:02:24,280::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:24,771::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:25,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:02:25,281::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:25,773::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:02:25,774::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:02:25,775::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:26,283::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:26,776::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:27,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:02:27,284::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286044::DEBUG::2014-01-16 16:02:28,007::task::579::TaskManager.Task::(_updateState) Task=`e24ce10f-e319-469f-b9f8-f5a3466208c8`::moving from state init -> state preparing >Thread-286044::INFO::2014-01-16 16:02:28,007::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286044::INFO::2014-01-16 16:02:28,007::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311955', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256407', 'lastCheck': '8.7', 'valid': True}} >Thread-286044::DEBUG::2014-01-16 16:02:28,008::task::1168::TaskManager.Task::(prepare) Task=`e24ce10f-e319-469f-b9f8-f5a3466208c8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311955', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256407', 'lastCheck': '8.7', 'valid': True}} >Thread-286044::DEBUG::2014-01-16 16:02:28,008::task::579::TaskManager.Task::(_updateState) Task=`e24ce10f-e319-469f-b9f8-f5a3466208c8`::moving from state preparing -> state finished >Thread-286044::DEBUG::2014-01-16 16:02:28,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286044::DEBUG::2014-01-16 16:02:28,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286044::DEBUG::2014-01-16 16:02:28,008::task::974::TaskManager.Task::(_decref) Task=`e24ce10f-e319-469f-b9f8-f5a3466208c8`::ref 0 aborting False >Thread-251420::DEBUG::2014-01-16 16:02:28,064::task::579::TaskManager.Task::(_updateState) Task=`56cfeca9-3565-4ac2-afdf-52fb6703ab46`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:02:28,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:02:28,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:02:28,064::task::1168::TaskManager.Task::(prepare) Task=`56cfeca9-3565-4ac2-afdf-52fb6703ab46`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:02:28,065::task::579::TaskManager.Task::(_updateState) Task=`56cfeca9-3565-4ac2-afdf-52fb6703ab46`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:02:28,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:02:28,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:02:28,065::task::974::TaskManager.Task::(_decref) Task=`56cfeca9-3565-4ac2-afdf-52fb6703ab46`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:28,286::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:02:28,286::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:28,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:02:29,271::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:02:29,286::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:02:29,288::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:02:29,289::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:02:29,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:02:29,292::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000314206 s, 13.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:30,292::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:02:30,293::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:02:30,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:30,779::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:30,780::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:02:31,031::task::579::TaskManager.Task::(_updateState) Task=`65d39608-a534-4822-8816-cf2e052a32d7`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:02:31,032::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:02:31,032::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:02:31,032::task::1168::TaskManager.Task::(prepare) Task=`65d39608-a534-4822-8816-cf2e052a32d7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:02:31,032::task::579::TaskManager.Task::(_updateState) Task=`65d39608-a534-4822-8816-cf2e052a32d7`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:02:31,032::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:02:31,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:02:31,033::task::974::TaskManager.Task::(_decref) Task=`65d39608-a534-4822-8816-cf2e052a32d7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:31,293::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:02:31,294::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:02:31,517::task::579::TaskManager.Task::(_updateState) Task=`6ca7b971-cb88-4ff4-9d4d-7527a1b39d58`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:02:31,517::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:02:31,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:02:31,518::task::1168::TaskManager.Task::(prepare) Task=`6ca7b971-cb88-4ff4-9d4d-7527a1b39d58`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:02:31,518::task::579::TaskManager.Task::(_updateState) Task=`6ca7b971-cb88-4ff4-9d4d-7527a1b39d58`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:02:31,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:02:31,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:02:31,518::task::974::TaskManager.Task::(_decref) Task=`6ca7b971-cb88-4ff4-9d4d-7527a1b39d58`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:02:31,572::task::579::TaskManager.Task::(_updateState) Task=`4c6bd458-4784-47a9-ae73-c237381dac28`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:02:31,572::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:02:31,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:02:31,573::task::1168::TaskManager.Task::(prepare) Task=`4c6bd458-4784-47a9-ae73-c237381dac28`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:02:31,573::task::579::TaskManager.Task::(_updateState) Task=`4c6bd458-4784-47a9-ae73-c237381dac28`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:02:31,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:02:31,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:02:31,573::task::974::TaskManager.Task::(_decref) Task=`4c6bd458-4784-47a9-ae73-c237381dac28`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:02:31,739::task::579::TaskManager.Task::(_updateState) Task=`bb921875-075f-4aa8-aaa5-35095f515ffb`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:02:31,739::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:02:31,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:02:31,740::task::1168::TaskManager.Task::(prepare) Task=`bb921875-075f-4aa8-aaa5-35095f515ffb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:02:31,740::task::579::TaskManager.Task::(_updateState) Task=`bb921875-075f-4aa8-aaa5-35095f515ffb`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:02:31,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:02:31,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:02:31,740::task::974::TaskManager.Task::(_decref) Task=`bb921875-075f-4aa8-aaa5-35095f515ffb`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:02:31,946::task::579::TaskManager.Task::(_updateState) Task=`acb4ba6b-7306-42a7-89fb-544ef3a42a12`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:02:31,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:02:31,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:02:31,947::task::1168::TaskManager.Task::(prepare) Task=`acb4ba6b-7306-42a7-89fb-544ef3a42a12`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:02:31,947::task::579::TaskManager.Task::(_updateState) Task=`acb4ba6b-7306-42a7-89fb-544ef3a42a12`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:02:31,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:02:31,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:02:31,948::task::974::TaskManager.Task::(_decref) Task=`acb4ba6b-7306-42a7-89fb-544ef3a42a12`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:02:31,948::task::579::TaskManager.Task::(_updateState) Task=`df919a55-0dd3-4c9d-a92e-d39beab41b2b`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:02:31,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:02:31,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:02:31,948::task::1168::TaskManager.Task::(prepare) Task=`df919a55-0dd3-4c9d-a92e-d39beab41b2b`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:02:31,948::task::579::TaskManager.Task::(_updateState) Task=`df919a55-0dd3-4c9d-a92e-d39beab41b2b`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:02:31,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:02:31,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:02:31,949::task::974::TaskManager.Task::(_decref) Task=`df919a55-0dd3-4c9d-a92e-d39beab41b2b`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:02:31,949::task::579::TaskManager.Task::(_updateState) Task=`6f84bfd8-4da5-4e0f-8ae8-88bca8e0c352`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:02:31,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:02:31,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:02:31,950::task::1168::TaskManager.Task::(prepare) Task=`6f84bfd8-4da5-4e0f-8ae8-88bca8e0c352`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:02:31,950::task::579::TaskManager.Task::(_updateState) Task=`6f84bfd8-4da5-4e0f-8ae8-88bca8e0c352`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:02:31,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:02:31,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:02:31,950::task::974::TaskManager.Task::(_decref) Task=`6f84bfd8-4da5-4e0f-8ae8-88bca8e0c352`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:32,294::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:02:32,294::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:02:32,295::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:02:32,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:02:32,737::task::579::TaskManager.Task::(_updateState) Task=`5d0261ca-fe4c-47b1-9cd9-dea264220109`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:02:32,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:02:32,738::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:02:32,738::task::1168::TaskManager.Task::(prepare) Task=`5d0261ca-fe4c-47b1-9cd9-dea264220109`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:02:32,738::task::579::TaskManager.Task::(_updateState) Task=`5d0261ca-fe4c-47b1-9cd9-dea264220109`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:02:32,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:02:32,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:02:32,739::task::974::TaskManager.Task::(_decref) Task=`5d0261ca-fe4c-47b1-9cd9-dea264220109`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:02:32,781::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:02:33,023::task::579::TaskManager.Task::(_updateState) Task=`53bb585a-0e3b-41b3-8f7c-5294e6c7e3ea`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:02:33,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:02:33,024::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:02:33,024::task::1168::TaskManager.Task::(prepare) Task=`53bb585a-0e3b-41b3-8f7c-5294e6c7e3ea`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:02:33,024::task::579::TaskManager.Task::(_updateState) Task=`53bb585a-0e3b-41b3-8f7c-5294e6c7e3ea`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:02:33,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:02:33,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:02:33,024::task::974::TaskManager.Task::(_decref) Task=`53bb585a-0e3b-41b3-8f7c-5294e6c7e3ea`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:02:33,284::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:02:33,299::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:02:33,301::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000302592 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:34,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:02:34,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:02:34,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:02:34,300::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:34,301::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:02:34,301::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:02:34,783::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:35,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:35,784::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:36,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:02:36,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:02:36,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:36,785::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:37,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:02:37,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:02:37,305::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:38,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:02:38,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:02:38,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:02:38,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:38,786::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:02:39,297::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:02:39,312::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:02:39,315::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000240249 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:40,314::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:02:40,315::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:02:40,730::task::579::TaskManager.Task::(_updateState) Task=`9381643b-e97c-411c-8a7d-f091069abe6c`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:02:40,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:02:40,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:02:40,731::task::1168::TaskManager.Task::(prepare) Task=`9381643b-e97c-411c-8a7d-f091069abe6c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:02:40,731::task::579::TaskManager.Task::(_updateState) Task=`9381643b-e97c-411c-8a7d-f091069abe6c`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:02:40,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:02:40,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:02:40,732::task::974::TaskManager.Task::(_decref) Task=`9381643b-e97c-411c-8a7d-f091069abe6c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:02:40,788::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:40,790::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:02:40,790::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:02:40,792::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:41,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:02:41,893::task::579::TaskManager.Task::(_updateState) Task=`e5a15237-bc12-45bd-bbc6-db87ae096e69`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:02:41,893::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:02:41,893::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:02:41,894::task::1168::TaskManager.Task::(prepare) Task=`e5a15237-bc12-45bd-bbc6-db87ae096e69`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:02:41,894::task::579::TaskManager.Task::(_updateState) Task=`e5a15237-bc12-45bd-bbc6-db87ae096e69`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:02:41,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:02:41,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:02:41,894::task::974::TaskManager.Task::(_decref) Task=`e5a15237-bc12-45bd-bbc6-db87ae096e69`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:02:41,894::task::579::TaskManager.Task::(_updateState) Task=`f506f96b-80be-43f4-8e93-1525c9e6ed38`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:02:41,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:02:41,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:02:41,895::task::1168::TaskManager.Task::(prepare) Task=`f506f96b-80be-43f4-8e93-1525c9e6ed38`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:02:41,895::task::579::TaskManager.Task::(_updateState) Task=`f506f96b-80be-43f4-8e93-1525c9e6ed38`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:02:41,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:02:41,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:02:41,895::task::974::TaskManager.Task::(_decref) Task=`f506f96b-80be-43f4-8e93-1525c9e6ed38`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:02:41,896::task::579::TaskManager.Task::(_updateState) Task=`3295e6a7-4142-4b45-af3f-b3de99df9a0d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:02:41,896::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:02:41,896::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:02:41,896::task::1168::TaskManager.Task::(prepare) Task=`3295e6a7-4142-4b45-af3f-b3de99df9a0d`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:02:41,896::task::579::TaskManager.Task::(_updateState) Task=`3295e6a7-4142-4b45-af3f-b3de99df9a0d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:02:41,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:02:41,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:02:41,897::task::974::TaskManager.Task::(_decref) Task=`3295e6a7-4142-4b45-af3f-b3de99df9a0d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:42,317::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:42,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:02:43,308::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:02:43,322::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:02:43,324::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000304798 s, 1.2 MB/s\n'; <rc> = 0 >Thread-286050::DEBUG::2014-01-16 16:02:43,909::task::579::TaskManager.Task::(_updateState) Task=`e3719433-cff9-4908-af7d-06174ba90898`::moving from state init -> state preparing >Thread-286050::INFO::2014-01-16 16:02:43,909::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286050::INFO::2014-01-16 16:02:43,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304798', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240249', 'lastCheck': '4.6', 'valid': True}} >Thread-286050::DEBUG::2014-01-16 16:02:43,910::task::1168::TaskManager.Task::(prepare) Task=`e3719433-cff9-4908-af7d-06174ba90898`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304798', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240249', 'lastCheck': '4.6', 'valid': True}} >Thread-286050::DEBUG::2014-01-16 16:02:43,910::task::579::TaskManager.Task::(_updateState) Task=`e3719433-cff9-4908-af7d-06174ba90898`::moving from state preparing -> state finished >Thread-286050::DEBUG::2014-01-16 16:02:43,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286050::DEBUG::2014-01-16 16:02:43,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286050::DEBUG::2014-01-16 16:02:43,911::task::974::TaskManager.Task::(_decref) Task=`e3719433-cff9-4908-af7d-06174ba90898`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:44,325::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:02:44,587::task::579::TaskManager.Task::(_updateState) Task=`036a8e28-3c29-4807-9854-1f2883a1f094`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:02:44,587::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:02:44,587::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:02:44,588::task::1168::TaskManager.Task::(prepare) Task=`036a8e28-3c29-4807-9854-1f2883a1f094`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:02:44,588::task::579::TaskManager.Task::(_updateState) Task=`036a8e28-3c29-4807-9854-1f2883a1f094`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:02:44,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:02:44,588::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:02:44,588::task::974::TaskManager.Task::(_decref) Task=`036a8e28-3c29-4807-9854-1f2883a1f094`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:02:44,794::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:45,326::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:45,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:46,327::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:02:46,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:46,797::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:47,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:48,329::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:48,798::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:02:49,320::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:02:49,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:02:49,337::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000240566 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:50,336::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:50,800::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:02:50,801::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:51,337::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:02:51,337::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:02:51,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:02:51,558::task::579::TaskManager.Task::(_updateState) Task=`97d6bf1d-46e5-4826-bedf-d117c9ac425b`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:02:51,558::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:02:51,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:02:51,559::task::1168::TaskManager.Task::(prepare) Task=`97d6bf1d-46e5-4826-bedf-d117c9ac425b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:02:51,559::task::579::TaskManager.Task::(_updateState) Task=`97d6bf1d-46e5-4826-bedf-d117c9ac425b`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:02:51,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:02:51,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:02:51,559::task::974::TaskManager.Task::(_decref) Task=`97d6bf1d-46e5-4826-bedf-d117c9ac425b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:52,339::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:02:52,339::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:52,803::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:02:53,332::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:02:53,349::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:02:53,351::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:02:53,354::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:02:53,356::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272666 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:54,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:02:54,356::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:54,804::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:02:54,914::task::579::TaskManager.Task::(_updateState) Task=`3828e239-0498-4fe9-b99e-7b4627412896`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:02:54,914::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:02:54,915::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:02:54,915::task::1168::TaskManager.Task::(prepare) Task=`3828e239-0498-4fe9-b99e-7b4627412896`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:02:54,915::task::579::TaskManager.Task::(_updateState) Task=`3828e239-0498-4fe9-b99e-7b4627412896`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:02:54,915::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:02:54,915::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:02:54,915::task::974::TaskManager.Task::(_decref) Task=`3828e239-0498-4fe9-b99e-7b4627412896`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:02:54,916::task::579::TaskManager.Task::(_updateState) Task=`28554ffe-f75b-4e5b-85bc-3d8f2bebd1f8`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:02:54,916::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:02:54,916::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:02:54,916::task::1168::TaskManager.Task::(prepare) Task=`28554ffe-f75b-4e5b-85bc-3d8f2bebd1f8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:02:54,916::task::579::TaskManager.Task::(_updateState) Task=`28554ffe-f75b-4e5b-85bc-3d8f2bebd1f8`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:02:54,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:02:54,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:02:54,917::task::974::TaskManager.Task::(_decref) Task=`28554ffe-f75b-4e5b-85bc-3d8f2bebd1f8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:02:55,358::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:02:55,358::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:55,806::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:02:55,806::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:02:55,807::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:56,359::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:56,809::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:02:57,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:02:57,360::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:02:58,361::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:02:58,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:02:58,810::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:02:58,859::task::579::TaskManager.Task::(_updateState) Task=`2e055dbe-7e13-4271-9f35-b4da54d781c2`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:02:58,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:02:58,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:02:58,859::task::1168::TaskManager.Task::(prepare) Task=`2e055dbe-7e13-4271-9f35-b4da54d781c2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:02:58,859::task::579::TaskManager.Task::(_updateState) Task=`2e055dbe-7e13-4271-9f35-b4da54d781c2`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:02:58,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:02:58,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:02:58,860::task::974::TaskManager.Task::(_decref) Task=`2e055dbe-7e13-4271-9f35-b4da54d781c2`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:02:59,343::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:02:59,359::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000301786 s, 13.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:02:59,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:02:59,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:02:59,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:02:59,363::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286056::DEBUG::2014-01-16 16:03:00,125::task::579::TaskManager.Task::(_updateState) Task=`30309f67-c6b9-44f6-8a3e-63e23498ebc5`::moving from state init -> state preparing >Thread-286056::INFO::2014-01-16 16:03:00,125::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286056::INFO::2014-01-16 16:03:00,125::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272666', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301786', 'lastCheck': '0.8', 'valid': True}} >Thread-286056::DEBUG::2014-01-16 16:03:00,125::task::1168::TaskManager.Task::(prepare) Task=`30309f67-c6b9-44f6-8a3e-63e23498ebc5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272666', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301786', 'lastCheck': '0.8', 'valid': True}} >Thread-286056::DEBUG::2014-01-16 16:03:00,125::task::579::TaskManager.Task::(_updateState) Task=`30309f67-c6b9-44f6-8a3e-63e23498ebc5`::moving from state preparing -> state finished >Thread-286056::DEBUG::2014-01-16 16:03:00,126::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286056::DEBUG::2014-01-16 16:03:00,126::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286056::DEBUG::2014-01-16 16:03:00,126::task::974::TaskManager.Task::(_decref) Task=`30309f67-c6b9-44f6-8a3e-63e23498ebc5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:00,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:03:00,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:03:00,364::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:00,811::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:00,812::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:03:01,252::task::579::TaskManager.Task::(_updateState) Task=`8d7e0af3-6ad0-4736-87dc-7bc1b17e0ed0`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:03:01,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:03:01,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:03:01,253::task::1168::TaskManager.Task::(prepare) Task=`8d7e0af3-6ad0-4736-87dc-7bc1b17e0ed0`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:03:01,253::task::579::TaskManager.Task::(_updateState) Task=`8d7e0af3-6ad0-4736-87dc-7bc1b17e0ed0`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:03:01,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:03:01,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:03:01,253::task::974::TaskManager.Task::(_decref) Task=`8d7e0af3-6ad0-4736-87dc-7bc1b17e0ed0`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:03:01,254::task::579::TaskManager.Task::(_updateState) Task=`f123b5d8-d096-45c9-a07a-ce575a2462ce`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:03:01,254::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:03:01,254::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:03:01,254::task::1168::TaskManager.Task::(prepare) Task=`f123b5d8-d096-45c9-a07a-ce575a2462ce`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:03:01,254::task::579::TaskManager.Task::(_updateState) Task=`f123b5d8-d096-45c9-a07a-ce575a2462ce`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:03:01,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:03:01,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:03:01,255::task::974::TaskManager.Task::(_decref) Task=`f123b5d8-d096-45c9-a07a-ce575a2462ce`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:01,365::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:03:01,366::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:02,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:03:02,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:03:02,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:03:02,367::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:03:02,485::task::579::TaskManager.Task::(_updateState) Task=`8331d3db-3831-4483-80c6-bb7cb7fa6046`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:03:02,486::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:03:02,486::task::579::TaskManager.Task::(_updateState) Task=`35a72631-a46b-42e1-a428-e59dbffbc12d`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:03:02,486::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:03:02,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:03:02,487::task::1168::TaskManager.Task::(prepare) Task=`8331d3db-3831-4483-80c6-bb7cb7fa6046`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:03:02,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:03:02,487::task::579::TaskManager.Task::(_updateState) Task=`8331d3db-3831-4483-80c6-bb7cb7fa6046`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:03:02,487::task::1168::TaskManager.Task::(prepare) Task=`35a72631-a46b-42e1-a428-e59dbffbc12d`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:03:02,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:03:02,488::task::579::TaskManager.Task::(_updateState) Task=`35a72631-a46b-42e1-a428-e59dbffbc12d`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:03:02,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:03:02,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:03:02,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:03:02,488::task::974::TaskManager.Task::(_decref) Task=`8331d3db-3831-4483-80c6-bb7cb7fa6046`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:03:02,489::task::974::TaskManager.Task::(_decref) Task=`35a72631-a46b-42e1-a428-e59dbffbc12d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:03:02,814::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:03:03,128::task::579::TaskManager.Task::(_updateState) Task=`7677e218-eb00-44b7-b3f6-081fbbddeacc`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:03:03,128::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:03:03,128::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:03:03,128::task::1168::TaskManager.Task::(prepare) Task=`7677e218-eb00-44b7-b3f6-081fbbddeacc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:03:03,129::task::579::TaskManager.Task::(_updateState) Task=`7677e218-eb00-44b7-b3f6-081fbbddeacc`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:03:03,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:03:03,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:03:03,129::task::974::TaskManager.Task::(_decref) Task=`7677e218-eb00-44b7-b3f6-081fbbddeacc`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:03:03,365::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:03:03,382::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:03:03,390::task::579::TaskManager.Task::(_updateState) Task=`8cd6309b-8675-47bf-9823-51e5c237a0ff`::moving from state init -> state preparing >Thread-17177::DEBUG::2014-01-16 16:03:03,391::task::579::TaskManager.Task::(_updateState) Task=`0d8b69d7-a0ab-46ca-b355-791339962880`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:03:03,395::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-17177::INFO::2014-01-16 16:03:03,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-16399::INFO::2014-01-16 16:03:03,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-17177::INFO::2014-01-16 16:03:03,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-16399::DEBUG::2014-01-16 16:03:03,403::task::1168::TaskManager.Task::(prepare) Task=`8cd6309b-8675-47bf-9823-51e5c237a0ff`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-17177::DEBUG::2014-01-16 16:03:03,405::task::1168::TaskManager.Task::(prepare) Task=`0d8b69d7-a0ab-46ca-b355-791339962880`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-16399::DEBUG::2014-01-16 16:03:03,406::task::579::TaskManager.Task::(_updateState) Task=`8cd6309b-8675-47bf-9823-51e5c237a0ff`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:03:03,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:03:03,409::task::579::TaskManager.Task::(_updateState) Task=`0d8b69d7-a0ab-46ca-b355-791339962880`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:03:03,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:03:03,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:03:03,416::task::974::TaskManager.Task::(_decref) Task=`8cd6309b-8675-47bf-9823-51e5c237a0ff`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:03:03,416::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276775 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:03:03,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:03:03,420::task::579::TaskManager.Task::(_updateState) Task=`fdb66e15-5809-4581-9113-3f1dd24049c2`::moving from state init -> state preparing >Thread-17177::DEBUG::2014-01-16 16:03:03,421::task::974::TaskManager.Task::(_decref) Task=`0d8b69d7-a0ab-46ca-b355-791339962880`::ref 0 aborting False >Thread-16399::INFO::2014-01-16 16:03:03,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:03:03,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:03:03,428::task::1168::TaskManager.Task::(prepare) Task=`fdb66e15-5809-4581-9113-3f1dd24049c2`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:03:03,429::task::579::TaskManager.Task::(_updateState) Task=`fdb66e15-5809-4581-9113-3f1dd24049c2`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:03:03,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:03:03,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:03:03,430::task::974::TaskManager.Task::(_decref) Task=`fdb66e15-5809-4581-9113-3f1dd24049c2`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:03:04,202::task::579::TaskManager.Task::(_updateState) Task=`76de0fa9-a88e-4d8b-9803-e5f28d7b66af`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:03:04,202::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:03:04,202::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:03:04,203::task::1168::TaskManager.Task::(prepare) Task=`76de0fa9-a88e-4d8b-9803-e5f28d7b66af`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:03:04,203::task::579::TaskManager.Task::(_updateState) Task=`76de0fa9-a88e-4d8b-9803-e5f28d7b66af`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:03:04,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:03:04,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:03:04,204::task::974::TaskManager.Task::(_decref) Task=`76de0fa9-a88e-4d8b-9803-e5f28d7b66af`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:04,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:03:04,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:03:04,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:03:04,389::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:04,390::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:03:04,390::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:03:04,815::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:03:05,095::task::579::TaskManager.Task::(_updateState) Task=`9bf4c42b-539b-4aa7-88cd-aae2f3202e67`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:03:05,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:03:05,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:03:05,096::task::1168::TaskManager.Task::(prepare) Task=`9bf4c42b-539b-4aa7-88cd-aae2f3202e67`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:03:05,096::task::579::TaskManager.Task::(_updateState) Task=`9bf4c42b-539b-4aa7-88cd-aae2f3202e67`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:03:05,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:03:05,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:03:05,097::task::974::TaskManager.Task::(_decref) Task=`9bf4c42b-539b-4aa7-88cd-aae2f3202e67`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:05,392::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:05,816::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:06,393::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:03:06,393::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:03:06,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:06,818::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:07,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:03:07,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:03:07,394::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:03:08,139::task::579::TaskManager.Task::(_updateState) Task=`d6575381-86a4-43cc-82c0-874d71e4df82`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:03:08,140::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:03:08,140::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:03:08,140::task::1168::TaskManager.Task::(prepare) Task=`d6575381-86a4-43cc-82c0-874d71e4df82`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:03:08,141::task::579::TaskManager.Task::(_updateState) Task=`d6575381-86a4-43cc-82c0-874d71e4df82`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:03:08,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:03:08,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:03:08,141::task::974::TaskManager.Task::(_decref) Task=`d6575381-86a4-43cc-82c0-874d71e4df82`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:08,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:03:08,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:03:08,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:03:08,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:08,819::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:03:09,365::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:03:09,382::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000318049 s, 12.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:09,397::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:10,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:03:10,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:10,820::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:10,822::task::579::TaskManager.Task::(_updateState) Task=`e6ef6dd0-c422-4b71-bc76-cd8c129fd1ab`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:03:10,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:03:10,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:03:10,823::task::1168::TaskManager.Task::(prepare) Task=`e6ef6dd0-c422-4b71-bc76-cd8c129fd1ab`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:03:10,823::task::579::TaskManager.Task::(_updateState) Task=`e6ef6dd0-c422-4b71-bc76-cd8c129fd1ab`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:03:10,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:03:10,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:03:10,823::task::974::TaskManager.Task::(_decref) Task=`e6ef6dd0-c422-4b71-bc76-cd8c129fd1ab`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:03:10,826::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:03:10,826::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:03:10,828::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:10,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:10,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:11,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:03:11,810::task::579::TaskManager.Task::(_updateState) Task=`d83eed0a-aeca-4900-98fc-3fbc47502894`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:03:11,810::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:03:11,810::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:03:11,811::task::1168::TaskManager.Task::(prepare) Task=`d83eed0a-aeca-4900-98fc-3fbc47502894`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:03:11,811::task::579::TaskManager.Task::(_updateState) Task=`d83eed0a-aeca-4900-98fc-3fbc47502894`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:03:11,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:03:11,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:03:11,811::task::974::TaskManager.Task::(_decref) Task=`d83eed0a-aeca-4900-98fc-3fbc47502894`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:03:12,229::task::579::TaskManager.Task::(_updateState) Task=`2a791699-df29-44d4-a664-1c2d3484fd5a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:03:12,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:03:12,229::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:03:12,229::task::1168::TaskManager.Task::(prepare) Task=`2a791699-df29-44d4-a664-1c2d3484fd5a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:03:12,230::task::579::TaskManager.Task::(_updateState) Task=`2a791699-df29-44d4-a664-1c2d3484fd5a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:03:12,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:03:12,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:03:12,230::task::974::TaskManager.Task::(_decref) Task=`2a791699-df29-44d4-a664-1c2d3484fd5a`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:03:12,230::task::579::TaskManager.Task::(_updateState) Task=`c26edf6a-dfff-4ca8-810f-78ee05f6387d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:03:12,231::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:03:12,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:03:12,231::task::1168::TaskManager.Task::(prepare) Task=`c26edf6a-dfff-4ca8-810f-78ee05f6387d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:03:12,231::task::579::TaskManager.Task::(_updateState) Task=`c26edf6a-dfff-4ca8-810f-78ee05f6387d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:03:12,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:03:12,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:03:12,232::task::974::TaskManager.Task::(_decref) Task=`c26edf6a-dfff-4ca8-810f-78ee05f6387d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:12,400::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:12,833::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:13,401::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:03:13,435::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:03:13,451::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000310941 s, 1.2 MB/s\n'; <rc> = 0 >Thread-131569::DEBUG::2014-01-16 16:03:13,691::task::579::TaskManager.Task::(_updateState) Task=`a581326a-2823-49c9-a856-2afdb7b57ef8`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:03:13,691::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:03:13,692::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:03:13,692::task::1168::TaskManager.Task::(prepare) Task=`a581326a-2823-49c9-a856-2afdb7b57ef8`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:03:13,692::task::579::TaskManager.Task::(_updateState) Task=`a581326a-2823-49c9-a856-2afdb7b57ef8`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:03:13,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:03:13,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:03:13,693::task::974::TaskManager.Task::(_decref) Task=`a581326a-2823-49c9-a856-2afdb7b57ef8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:14,402::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:14,835::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:15,404::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:15,836::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286062::DEBUG::2014-01-16 16:03:15,899::task::579::TaskManager.Task::(_updateState) Task=`52874042-aaa1-4196-9c31-4cb8c0ce15aa`::moving from state init -> state preparing >Thread-286062::INFO::2014-01-16 16:03:15,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286062::INFO::2014-01-16 16:03:15,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310941', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318049', 'lastCheck': '6.5', 'valid': True}} >Thread-286062::DEBUG::2014-01-16 16:03:15,900::task::1168::TaskManager.Task::(prepare) Task=`52874042-aaa1-4196-9c31-4cb8c0ce15aa`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310941', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318049', 'lastCheck': '6.5', 'valid': True}} >Thread-286062::DEBUG::2014-01-16 16:03:15,900::task::579::TaskManager.Task::(_updateState) Task=`52874042-aaa1-4196-9c31-4cb8c0ce15aa`::moving from state preparing -> state finished >Thread-286062::DEBUG::2014-01-16 16:03:15,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286062::DEBUG::2014-01-16 16:03:15,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286062::DEBUG::2014-01-16 16:03:15,900::task::974::TaskManager.Task::(_decref) Task=`52874042-aaa1-4196-9c31-4cb8c0ce15aa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:16,404::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:03:16,405::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:16,838::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:17,406::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:18,407::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:18,839::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:03:19,387::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:03:19,403::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267457 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:19,408::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:03:19,895::task::579::TaskManager.Task::(_updateState) Task=`199def31-13b2-436d-81b1-5aceb5fb7ec5`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:03:19,895::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:03:19,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:03:19,895::task::1168::TaskManager.Task::(prepare) Task=`199def31-13b2-436d-81b1-5aceb5fb7ec5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:03:19,896::task::579::TaskManager.Task::(_updateState) Task=`199def31-13b2-436d-81b1-5aceb5fb7ec5`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:03:19,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:03:19,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:03:19,896::task::974::TaskManager.Task::(_decref) Task=`199def31-13b2-436d-81b1-5aceb5fb7ec5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:20,408::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:20,840::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:20,841::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:21,410::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:03:21,410::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:03:21,410::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:22,412::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:03:22,412::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:03:22,537::task::579::TaskManager.Task::(_updateState) Task=`2a274efc-559b-4d64-b8ff-c76a6b7616e3`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:03:22,537::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:03:22,538::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:03:22,538::task::1168::TaskManager.Task::(prepare) Task=`2a274efc-559b-4d64-b8ff-c76a6b7616e3`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:03:22,538::task::579::TaskManager.Task::(_updateState) Task=`2a274efc-559b-4d64-b8ff-c76a6b7616e3`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:03:22,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:03:22,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:03:22,538::task::974::TaskManager.Task::(_decref) Task=`2a274efc-559b-4d64-b8ff-c76a6b7616e3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:03:22,843::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:03:23,382::task::579::TaskManager.Task::(_updateState) Task=`82ed1e6a-44a0-4f32-9bec-6ab167e22b9b`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:03:23,382::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:03:23,382::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:03:23,383::task::1168::TaskManager.Task::(prepare) Task=`82ed1e6a-44a0-4f32-9bec-6ab167e22b9b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:03:23,383::task::579::TaskManager.Task::(_updateState) Task=`82ed1e6a-44a0-4f32-9bec-6ab167e22b9b`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:03:23,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:03:23,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:03:23,383::task::974::TaskManager.Task::(_decref) Task=`82ed1e6a-44a0-4f32-9bec-6ab167e22b9b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:23,413::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:03:23,413::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:03:23,413::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:03:23,458::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:03:23,474::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272304 s, 1.3 MB/s\n'; <rc> = 0 >Thread-59295::DEBUG::2014-01-16 16:03:23,517::task::579::TaskManager.Task::(_updateState) Task=`efc6f122-90eb-409c-b7e7-520f577681c5`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:03:23,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:03:23,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:03:23,518::task::1168::TaskManager.Task::(prepare) Task=`efc6f122-90eb-409c-b7e7-520f577681c5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:03:23,518::task::579::TaskManager.Task::(_updateState) Task=`efc6f122-90eb-409c-b7e7-520f577681c5`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:03:23,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:03:23,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:03:23,519::task::974::TaskManager.Task::(_decref) Task=`efc6f122-90eb-409c-b7e7-520f577681c5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:24,414::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:03:24,415::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:24,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:25,415::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:03:25,416::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:25,847::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:03:25,847::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:03:25,848::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:26,417::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:26,849::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:27,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:03:27,418::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:03:28,262::task::579::TaskManager.Task::(_updateState) Task=`31062494-9443-464f-8a32-beb13c1d67d8`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:03:28,263::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:03:28,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:03:28,263::task::1168::TaskManager.Task::(prepare) Task=`31062494-9443-464f-8a32-beb13c1d67d8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:03:28,263::task::579::TaskManager.Task::(_updateState) Task=`31062494-9443-464f-8a32-beb13c1d67d8`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:03:28,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:03:28,264::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:03:28,264::task::974::TaskManager.Task::(_decref) Task=`31062494-9443-464f-8a32-beb13c1d67d8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:28,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:03:28,420::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:28,851::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:03:29,409::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:03:29,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:03:29,426::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:03:29,427::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:03:29,428::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:03:29,430::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304329 s, 13.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:30,430::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:03:30,430::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:03:30,431::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:30,853::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:30,854::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:03:31,204::task::579::TaskManager.Task::(_updateState) Task=`e1865119-2daa-424e-a9a9-779e0e5193fc`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:03:31,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:03:31,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:03:31,205::task::1168::TaskManager.Task::(prepare) Task=`e1865119-2daa-424e-a9a9-779e0e5193fc`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:03:31,205::task::579::TaskManager.Task::(_updateState) Task=`e1865119-2daa-424e-a9a9-779e0e5193fc`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:03:31,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:03:31,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:03:31,206::task::974::TaskManager.Task::(_decref) Task=`e1865119-2daa-424e-a9a9-779e0e5193fc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:31,431::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:03:31,432::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286068::DEBUG::2014-01-16 16:03:31,653::task::579::TaskManager.Task::(_updateState) Task=`02056de1-d7aa-4f8d-89ed-755079aacbec`::moving from state init -> state preparing >Thread-286068::INFO::2014-01-16 16:03:31,653::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286068::INFO::2014-01-16 16:03:31,653::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272304', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304329', 'lastCheck': '2.2', 'valid': True}} >Thread-286068::DEBUG::2014-01-16 16:03:31,653::task::1168::TaskManager.Task::(prepare) Task=`02056de1-d7aa-4f8d-89ed-755079aacbec`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272304', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304329', 'lastCheck': '2.2', 'valid': True}} >Thread-286068::DEBUG::2014-01-16 16:03:31,654::task::579::TaskManager.Task::(_updateState) Task=`02056de1-d7aa-4f8d-89ed-755079aacbec`::moving from state preparing -> state finished >Thread-286068::DEBUG::2014-01-16 16:03:31,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286068::DEBUG::2014-01-16 16:03:31,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286068::DEBUG::2014-01-16 16:03:31,654::task::974::TaskManager.Task::(_decref) Task=`02056de1-d7aa-4f8d-89ed-755079aacbec`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:03:31,687::task::579::TaskManager.Task::(_updateState) Task=`60b700c3-78d0-4c8a-a88a-4d3223ae7e66`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:03:31,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:03:31,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:03:31,688::task::1168::TaskManager.Task::(prepare) Task=`60b700c3-78d0-4c8a-a88a-4d3223ae7e66`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:03:31,688::task::579::TaskManager.Task::(_updateState) Task=`60b700c3-78d0-4c8a-a88a-4d3223ae7e66`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:03:31,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:03:31,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:03:31,689::task::974::TaskManager.Task::(_decref) Task=`60b700c3-78d0-4c8a-a88a-4d3223ae7e66`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:03:31,748::task::579::TaskManager.Task::(_updateState) Task=`95677fc1-6d89-4386-933c-41b1433565a5`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:03:31,749::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:03:31,749::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:03:31,750::task::1168::TaskManager.Task::(prepare) Task=`95677fc1-6d89-4386-933c-41b1433565a5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:03:31,750::task::579::TaskManager.Task::(_updateState) Task=`95677fc1-6d89-4386-933c-41b1433565a5`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:03:31,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:03:31,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:03:31,751::task::974::TaskManager.Task::(_decref) Task=`95677fc1-6d89-4386-933c-41b1433565a5`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:03:31,908::task::579::TaskManager.Task::(_updateState) Task=`0188c7b0-eb25-4e15-bfa1-2e3e8d0ceaf6`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:03:31,909::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:03:31,909::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:03:31,909::task::1168::TaskManager.Task::(prepare) Task=`0188c7b0-eb25-4e15-bfa1-2e3e8d0ceaf6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:03:31,909::task::579::TaskManager.Task::(_updateState) Task=`0188c7b0-eb25-4e15-bfa1-2e3e8d0ceaf6`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:03:31,909::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:03:31,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:03:31,909::task::974::TaskManager.Task::(_decref) Task=`0188c7b0-eb25-4e15-bfa1-2e3e8d0ceaf6`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:03:32,244::task::579::TaskManager.Task::(_updateState) Task=`0746b906-5064-4208-a99e-1a8200acb569`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:03:32,245::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:03:32,245::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:03:32,245::task::1168::TaskManager.Task::(prepare) Task=`0746b906-5064-4208-a99e-1a8200acb569`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:03:32,245::task::579::TaskManager.Task::(_updateState) Task=`0746b906-5064-4208-a99e-1a8200acb569`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:03:32,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:03:32,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:03:32,245::task::974::TaskManager.Task::(_decref) Task=`0746b906-5064-4208-a99e-1a8200acb569`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:03:32,246::task::579::TaskManager.Task::(_updateState) Task=`175d25ae-088c-44eb-92be-6bc59ba25413`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:03:32,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:03:32,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:03:32,246::task::1168::TaskManager.Task::(prepare) Task=`175d25ae-088c-44eb-92be-6bc59ba25413`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:03:32,246::task::579::TaskManager.Task::(_updateState) Task=`175d25ae-088c-44eb-92be-6bc59ba25413`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:03:32,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:03:32,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:03:32,247::task::974::TaskManager.Task::(_decref) Task=`175d25ae-088c-44eb-92be-6bc59ba25413`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:03:32,247::task::579::TaskManager.Task::(_updateState) Task=`a7f337c9-6843-4cb1-a29a-e7098d113f55`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:03:32,247::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:03:32,247::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:03:32,248::task::1168::TaskManager.Task::(prepare) Task=`a7f337c9-6843-4cb1-a29a-e7098d113f55`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:03:32,248::task::579::TaskManager.Task::(_updateState) Task=`a7f337c9-6843-4cb1-a29a-e7098d113f55`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:03:32,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:03:32,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:03:32,248::task::974::TaskManager.Task::(_decref) Task=`a7f337c9-6843-4cb1-a29a-e7098d113f55`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:32,433::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:03:32,433::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:03:32,433::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:03:32,433::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:32,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:03:32,899::task::579::TaskManager.Task::(_updateState) Task=`3632e684-76a3-4ea2-bf97-0dafd0324a3e`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:03:32,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:03:32,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:03:32,900::task::1168::TaskManager.Task::(prepare) Task=`3632e684-76a3-4ea2-bf97-0dafd0324a3e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:03:32,900::task::579::TaskManager.Task::(_updateState) Task=`3632e684-76a3-4ea2-bf97-0dafd0324a3e`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:03:32,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:03:32,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:03:32,900::task::974::TaskManager.Task::(_decref) Task=`3632e684-76a3-4ea2-bf97-0dafd0324a3e`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:03:33,190::task::579::TaskManager.Task::(_updateState) Task=`1ad62390-06db-4d9f-99d5-fd4cf70e9cf4`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:03:33,190::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:03:33,191::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:03:33,191::task::1168::TaskManager.Task::(prepare) Task=`1ad62390-06db-4d9f-99d5-fd4cf70e9cf4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:03:33,191::task::579::TaskManager.Task::(_updateState) Task=`1ad62390-06db-4d9f-99d5-fd4cf70e9cf4`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:03:33,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:03:33,191::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:03:33,191::task::974::TaskManager.Task::(_decref) Task=`1ad62390-06db-4d9f-99d5-fd4cf70e9cf4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:33,434::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:03:33,482::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:03:33,500::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000288663 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:34,436::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:03:34,436::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:03:34,436::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:03:34,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:34,437::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:03:34,437::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:03:34,857::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:35,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:35,858::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:36,439::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:03:36,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:03:36,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:36,860::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:37,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:03:37,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:03:37,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:38,443::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:03:38,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:03:38,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:03:38,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:38,861::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:03:39,436::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:03:39,450::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:03:39,453::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000298287 s, 13.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:40,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:03:40,452::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:40,863::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:40,865::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:03:40,865::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:03:40,866::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:03:40,895::task::579::TaskManager.Task::(_updateState) Task=`bc760368-1725-4196-9efb-2797e53ac7b0`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:03:40,895::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:03:40,896::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:03:40,896::task::1168::TaskManager.Task::(prepare) Task=`bc760368-1725-4196-9efb-2797e53ac7b0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:03:40,896::task::579::TaskManager.Task::(_updateState) Task=`bc760368-1725-4196-9efb-2797e53ac7b0`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:03:40,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:03:40,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:03:40,896::task::974::TaskManager.Task::(_decref) Task=`bc760368-1725-4196-9efb-2797e53ac7b0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:41,453::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:42,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:03:42,492::task::579::TaskManager.Task::(_updateState) Task=`5986d958-5ee8-4155-a871-9db35aae9928`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:03:42,492::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:03:42,493::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:03:42,493::task::1168::TaskManager.Task::(prepare) Task=`5986d958-5ee8-4155-a871-9db35aae9928`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:03:42,493::task::579::TaskManager.Task::(_updateState) Task=`5986d958-5ee8-4155-a871-9db35aae9928`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:03:42,493::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:03:42,493::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:03:42,493::task::974::TaskManager.Task::(_decref) Task=`5986d958-5ee8-4155-a871-9db35aae9928`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:03:42,494::task::579::TaskManager.Task::(_updateState) Task=`31082107-ffbf-43e8-b378-58e9864a2116`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:03:42,494::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:03:42,494::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:03:42,494::task::1168::TaskManager.Task::(prepare) Task=`31082107-ffbf-43e8-b378-58e9864a2116`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:03:42,494::task::579::TaskManager.Task::(_updateState) Task=`31082107-ffbf-43e8-b378-58e9864a2116`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:03:42,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:03:42,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:03:42,495::task::974::TaskManager.Task::(_decref) Task=`31082107-ffbf-43e8-b378-58e9864a2116`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:03:42,495::task::579::TaskManager.Task::(_updateState) Task=`553bf1c6-920d-4d21-95cc-6ca2fdd4bbda`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:03:42,495::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:03:42,495::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:03:42,495::task::1168::TaskManager.Task::(prepare) Task=`553bf1c6-920d-4d21-95cc-6ca2fdd4bbda`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:03:42,495::task::579::TaskManager.Task::(_updateState) Task=`553bf1c6-920d-4d21-95cc-6ca2fdd4bbda`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:03:42,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:03:42,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:03:42,496::task::974::TaskManager.Task::(_decref) Task=`553bf1c6-920d-4d21-95cc-6ca2fdd4bbda`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:03:42,867::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:43,456::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:03:43,508::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:03:43,525::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271652 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:44,458::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:03:44,773::task::579::TaskManager.Task::(_updateState) Task=`b56f9663-ed3e-463b-8336-cea4dcf614d8`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:03:44,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:03:44,774::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:03:44,774::task::1168::TaskManager.Task::(prepare) Task=`b56f9663-ed3e-463b-8336-cea4dcf614d8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:03:44,774::task::579::TaskManager.Task::(_updateState) Task=`b56f9663-ed3e-463b-8336-cea4dcf614d8`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:03:44,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:03:44,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:03:44,775::task::974::TaskManager.Task::(_decref) Task=`b56f9663-ed3e-463b-8336-cea4dcf614d8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:03:44,869::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:45,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:45,870::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:46,460::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:03:46,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:46,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:47,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286074::DEBUG::2014-01-16 16:03:47,569::task::579::TaskManager.Task::(_updateState) Task=`2f9b1dc6-3c01-489f-8bfc-a8b7c9a66e63`::moving from state init -> state preparing >Thread-286074::INFO::2014-01-16 16:03:47,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286074::INFO::2014-01-16 16:03:47,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271652', 'lastCheck': '4.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000298287', 'lastCheck': '8.1', 'valid': True}} >Thread-286074::DEBUG::2014-01-16 16:03:47,570::task::1168::TaskManager.Task::(prepare) Task=`2f9b1dc6-3c01-489f-8bfc-a8b7c9a66e63`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271652', 'lastCheck': '4.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000298287', 'lastCheck': '8.1', 'valid': True}} >Thread-286074::DEBUG::2014-01-16 16:03:47,570::task::579::TaskManager.Task::(_updateState) Task=`2f9b1dc6-3c01-489f-8bfc-a8b7c9a66e63`::moving from state preparing -> state finished >Thread-286074::DEBUG::2014-01-16 16:03:47,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286074::DEBUG::2014-01-16 16:03:47,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286074::DEBUG::2014-01-16 16:03:47,570::task::974::TaskManager.Task::(_decref) Task=`2f9b1dc6-3c01-489f-8bfc-a8b7c9a66e63`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:48,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:48,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:03:49,459::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:03:49,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:03:49,478::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000228296 s, 17.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:50,476::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:50,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:03:50,875::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:51,478::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:03:51,478::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:03:51,478::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:03:51,735::task::579::TaskManager.Task::(_updateState) Task=`2334dc92-6aec-4d78-9464-b572454c081f`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:03:51,736::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:03:51,736::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:03:51,736::task::1168::TaskManager.Task::(prepare) Task=`2334dc92-6aec-4d78-9464-b572454c081f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:03:51,736::task::579::TaskManager.Task::(_updateState) Task=`2334dc92-6aec-4d78-9464-b572454c081f`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:03:51,736::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:03:51,737::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:03:51,737::task::974::TaskManager.Task::(_decref) Task=`2334dc92-6aec-4d78-9464-b572454c081f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:52,479::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:03:52,480::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:52,876::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:53,480::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:03:53,481::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:03:53,481::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:03:53,532::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:03:53,548::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000262058 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:03:54,482::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:03:54,482::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:54,878::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:03:55,140::task::579::TaskManager.Task::(_updateState) Task=`461a058f-4dec-42e2-ae85-a09231f36c0c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:03:55,140::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:03:55,141::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:03:55,141::task::1168::TaskManager.Task::(prepare) Task=`461a058f-4dec-42e2-ae85-a09231f36c0c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:03:55,141::task::579::TaskManager.Task::(_updateState) Task=`461a058f-4dec-42e2-ae85-a09231f36c0c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:03:55,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:03:55,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:03:55,141::task::974::TaskManager.Task::(_decref) Task=`461a058f-4dec-42e2-ae85-a09231f36c0c`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:03:55,142::task::579::TaskManager.Task::(_updateState) Task=`622b7e4d-f365-4d79-ae49-34fc57210ca5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:03:55,142::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:03:55,142::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:03:55,142::task::1168::TaskManager.Task::(prepare) Task=`622b7e4d-f365-4d79-ae49-34fc57210ca5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:03:55,142::task::579::TaskManager.Task::(_updateState) Task=`622b7e4d-f365-4d79-ae49-34fc57210ca5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:03:55,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:03:55,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:03:55,143::task::974::TaskManager.Task::(_decref) Task=`622b7e4d-f365-4d79-ae49-34fc57210ca5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:03:55,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:03:55,484::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:55,881::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:03:55,881::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:03:55,882::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:56,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:56,884::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:03:57,486::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:03:57,486::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:03:58,488::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:03:58,488::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:03:58,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:03:59,027::task::579::TaskManager.Task::(_updateState) Task=`f456d4b6-27c8-4fbb-8118-eee9601202b9`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:03:59,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:03:59,028::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:03:59,028::task::1168::TaskManager.Task::(prepare) Task=`f456d4b6-27c8-4fbb-8118-eee9601202b9`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:03:59,028::task::579::TaskManager.Task::(_updateState) Task=`f456d4b6-27c8-4fbb-8118-eee9601202b9`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:03:59,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:03:59,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:03:59,028::task::974::TaskManager.Task::(_decref) Task=`f456d4b6-27c8-4fbb-8118-eee9601202b9`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:03:59,483::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:03:59,497::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:03:59,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:03:59,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:03:59,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:03:59,505::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00033199 s, 12.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:00,504::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:04:00,504::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:04:00,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:00,886::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:00,888::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:04:01,476::task::579::TaskManager.Task::(_updateState) Task=`288abd95-bf1d-4aaf-bc43-e4105b1503bd`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:04:01,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:04:01,477::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:04:01,477::task::1168::TaskManager.Task::(prepare) Task=`288abd95-bf1d-4aaf-bc43-e4105b1503bd`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:04:01,477::task::579::TaskManager.Task::(_updateState) Task=`288abd95-bf1d-4aaf-bc43-e4105b1503bd`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:04:01,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:04:01,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:04:01,478::task::974::TaskManager.Task::(_decref) Task=`288abd95-bf1d-4aaf-bc43-e4105b1503bd`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:04:01,478::task::579::TaskManager.Task::(_updateState) Task=`464211a8-da70-4601-9236-e830028779bf`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:04:01,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:04:01,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:04:01,479::task::1168::TaskManager.Task::(prepare) Task=`464211a8-da70-4601-9236-e830028779bf`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:04:01,479::task::579::TaskManager.Task::(_updateState) Task=`464211a8-da70-4601-9236-e830028779bf`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:04:01,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:04:01,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:04:01,479::task::974::TaskManager.Task::(_decref) Task=`464211a8-da70-4601-9236-e830028779bf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:01,505::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:04:01,506::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:02,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:04:02,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:04:02,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:04:02,508::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:04:02,574::task::579::TaskManager.Task::(_updateState) Task=`167ee155-1eca-4a4e-97b9-88c3aa2bbefc`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:04:02,575::task::579::TaskManager.Task::(_updateState) Task=`3d08b6c7-f923-41d9-9ee7-7fc23133b4ca`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:04:02,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:04:02,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:04:02,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:04:02,576::task::1168::TaskManager.Task::(prepare) Task=`167ee155-1eca-4a4e-97b9-88c3aa2bbefc`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:04:02,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:04:02,576::task::579::TaskManager.Task::(_updateState) Task=`167ee155-1eca-4a4e-97b9-88c3aa2bbefc`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:04:02,577::task::1168::TaskManager.Task::(prepare) Task=`3d08b6c7-f923-41d9-9ee7-7fc23133b4ca`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:04:02,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:04:02,577::task::579::TaskManager.Task::(_updateState) Task=`3d08b6c7-f923-41d9-9ee7-7fc23133b4ca`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:04:02,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:04:02,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:04:02,578::task::974::TaskManager.Task::(_decref) Task=`167ee155-1eca-4a4e-97b9-88c3aa2bbefc`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:04:02,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:04:02,578::task::974::TaskManager.Task::(_decref) Task=`3d08b6c7-f923-41d9-9ee7-7fc23133b4ca`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:04:02,889::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:04:03,292::task::579::TaskManager.Task::(_updateState) Task=`b5fe1fa3-8e4a-4ee5-9dd5-3682e7e9e4e7`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:04:03,292::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:04:03,292::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:04:03,293::task::1168::TaskManager.Task::(prepare) Task=`b5fe1fa3-8e4a-4ee5-9dd5-3682e7e9e4e7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:04:03,293::task::579::TaskManager.Task::(_updateState) Task=`b5fe1fa3-8e4a-4ee5-9dd5-3682e7e9e4e7`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:04:03,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:04:03,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:04:03,293::task::974::TaskManager.Task::(_decref) Task=`b5fe1fa3-8e4a-4ee5-9dd5-3682e7e9e4e7`::ref 0 aborting False >Thread-286080::DEBUG::2014-01-16 16:04:03,353::task::579::TaskManager.Task::(_updateState) Task=`604058e7-73bd-4fa3-bef1-042049ce3526`::moving from state init -> state preparing >Thread-286080::INFO::2014-01-16 16:04:03,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286080::INFO::2014-01-16 16:04:03,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262058', 'lastCheck': '9.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033199', 'lastCheck': '3.8', 'valid': True}} >Thread-286080::DEBUG::2014-01-16 16:04:03,354::task::1168::TaskManager.Task::(prepare) Task=`604058e7-73bd-4fa3-bef1-042049ce3526`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262058', 'lastCheck': '9.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033199', 'lastCheck': '3.8', 'valid': True}} >Thread-286080::DEBUG::2014-01-16 16:04:03,354::task::579::TaskManager.Task::(_updateState) Task=`604058e7-73bd-4fa3-bef1-042049ce3526`::moving from state preparing -> state finished >Thread-286080::DEBUG::2014-01-16 16:04:03,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286080::DEBUG::2014-01-16 16:04:03,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286080::DEBUG::2014-01-16 16:04:03,355::task::974::TaskManager.Task::(_decref) Task=`604058e7-73bd-4fa3-bef1-042049ce3526`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:03,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:04:03,534::task::579::TaskManager.Task::(_updateState) Task=`fbb88cd1-7c14-4fb0-a36e-a8ae282a2232`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:04:03,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:04:03,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:04:03,535::task::1168::TaskManager.Task::(prepare) Task=`fbb88cd1-7c14-4fb0-a36e-a8ae282a2232`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:04:03,535::task::579::TaskManager.Task::(_updateState) Task=`fbb88cd1-7c14-4fb0-a36e-a8ae282a2232`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:04:03,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:04:03,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:04:03,535::task::974::TaskManager.Task::(_decref) Task=`fbb88cd1-7c14-4fb0-a36e-a8ae282a2232`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:04:03,535::task::579::TaskManager.Task::(_updateState) Task=`9e868910-b7f4-4398-85b8-34a3a6bbdfbd`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:04:03,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:04:03,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:04:03,536::task::1168::TaskManager.Task::(prepare) Task=`9e868910-b7f4-4398-85b8-34a3a6bbdfbd`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:04:03,536::task::579::TaskManager.Task::(_updateState) Task=`9e868910-b7f4-4398-85b8-34a3a6bbdfbd`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:04:03,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:04:03,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:04:03,537::task::974::TaskManager.Task::(_decref) Task=`9e868910-b7f4-4398-85b8-34a3a6bbdfbd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:04:03,556::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:04:03,572::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000252768 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:04:03,576::task::579::TaskManager.Task::(_updateState) Task=`84d5b43d-dd7b-443a-9634-f697e839813a`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:04:03,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:04:03,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:04:03,577::task::1168::TaskManager.Task::(prepare) Task=`84d5b43d-dd7b-443a-9634-f697e839813a`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:04:03,577::task::579::TaskManager.Task::(_updateState) Task=`84d5b43d-dd7b-443a-9634-f697e839813a`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:04:03,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:04:03,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:04:03,578::task::974::TaskManager.Task::(_decref) Task=`84d5b43d-dd7b-443a-9634-f697e839813a`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:04:04,382::task::579::TaskManager.Task::(_updateState) Task=`a0942ac6-b4ed-4d4f-ab6a-1ff4ed70aba9`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:04:04,382::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:04:04,383::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:04:04,383::task::1168::TaskManager.Task::(prepare) Task=`a0942ac6-b4ed-4d4f-ab6a-1ff4ed70aba9`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:04:04,383::task::579::TaskManager.Task::(_updateState) Task=`a0942ac6-b4ed-4d4f-ab6a-1ff4ed70aba9`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:04:04,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:04:04,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:04:04,384::task::974::TaskManager.Task::(_decref) Task=`a0942ac6-b4ed-4d4f-ab6a-1ff4ed70aba9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:04,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:04:04,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:04:04,511::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:04:04,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:04,511::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:04:04,511::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:04:04,891::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:04:05,268::task::579::TaskManager.Task::(_updateState) Task=`a459417b-2e20-4ef6-80d1-a61595cf5390`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:04:05,269::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:04:05,269::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:04:05,269::task::1168::TaskManager.Task::(prepare) Task=`a459417b-2e20-4ef6-80d1-a61595cf5390`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:04:05,269::task::579::TaskManager.Task::(_updateState) Task=`a459417b-2e20-4ef6-80d1-a61595cf5390`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:04:05,269::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:04:05,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:04:05,270::task::974::TaskManager.Task::(_decref) Task=`a459417b-2e20-4ef6-80d1-a61595cf5390`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:05,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:05,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:06,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:04:06,514::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:04:06,514::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:06,894::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:07,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:04:07,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:04:07,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:04:08,313::task::579::TaskManager.Task::(_updateState) Task=`12d7ab57-53ed-466b-ae47-d2828aae5440`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:04:08,313::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:04:08,314::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:04:08,314::task::1168::TaskManager.Task::(prepare) Task=`12d7ab57-53ed-466b-ae47-d2828aae5440`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:04:08,314::task::579::TaskManager.Task::(_updateState) Task=`12d7ab57-53ed-466b-ae47-d2828aae5440`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:04:08,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:04:08,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:04:08,314::task::974::TaskManager.Task::(_decref) Task=`12d7ab57-53ed-466b-ae47-d2828aae5440`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:08,516::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:04:08,516::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:04:08,516::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:04:08,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:08,896::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:04:09,510::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:04:09,525::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:04:09,528::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000251321 s, 16.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:10,528::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:04:10,528::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:10,898::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:10,898::task::579::TaskManager.Task::(_updateState) Task=`42bd3b8d-e3ee-4b6d-a073-32719dd5a7fd`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:04:10,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:04:10,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:04:10,899::task::1168::TaskManager.Task::(prepare) Task=`42bd3b8d-e3ee-4b6d-a073-32719dd5a7fd`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:04:10,899::task::579::TaskManager.Task::(_updateState) Task=`42bd3b8d-e3ee-4b6d-a073-32719dd5a7fd`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:04:10,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:04:10,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:04:10,900::task::974::TaskManager.Task::(_decref) Task=`42bd3b8d-e3ee-4b6d-a073-32719dd5a7fd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:04:10,902::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:04:10,902::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:04:10,903::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:10,905::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:10,906::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:11,529::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:04:11,983::task::579::TaskManager.Task::(_updateState) Task=`4d7fec06-c596-431f-8a8f-ee7ecb28f561`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:04:11,984::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:04:11,984::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:04:11,984::task::1168::TaskManager.Task::(prepare) Task=`4d7fec06-c596-431f-8a8f-ee7ecb28f561`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:04:11,984::task::579::TaskManager.Task::(_updateState) Task=`4d7fec06-c596-431f-8a8f-ee7ecb28f561`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:04:11,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:04:11,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:04:11,985::task::974::TaskManager.Task::(_decref) Task=`4d7fec06-c596-431f-8a8f-ee7ecb28f561`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:12,531::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:04:12,604::task::579::TaskManager.Task::(_updateState) Task=`4ea8e90f-4f7e-47ee-96e1-6522b719ac94`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:04:12,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:04:12,604::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:04:12,605::task::1168::TaskManager.Task::(prepare) Task=`4ea8e90f-4f7e-47ee-96e1-6522b719ac94`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:04:12,605::task::579::TaskManager.Task::(_updateState) Task=`4ea8e90f-4f7e-47ee-96e1-6522b719ac94`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:04:12,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:04:12,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:04:12,605::task::974::TaskManager.Task::(_decref) Task=`4ea8e90f-4f7e-47ee-96e1-6522b719ac94`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:04:12,605::task::579::TaskManager.Task::(_updateState) Task=`f20f4a9c-86be-4817-b352-fabb40a3733f`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:04:12,606::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:04:12,606::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:04:12,606::task::1168::TaskManager.Task::(prepare) Task=`f20f4a9c-86be-4817-b352-fabb40a3733f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:04:12,606::task::579::TaskManager.Task::(_updateState) Task=`f20f4a9c-86be-4817-b352-fabb40a3733f`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:04:12,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:04:12,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:04:12,607::task::974::TaskManager.Task::(_decref) Task=`f20f4a9c-86be-4817-b352-fabb40a3733f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:04:12,907::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:13,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:04:13,582::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:04:13,598::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308818 s, 1.2 MB/s\n'; <rc> = 0 >Thread-131569::DEBUG::2014-01-16 16:04:13,779::task::579::TaskManager.Task::(_updateState) Task=`d562c6d3-9002-4aaf-906e-3d9923bc1462`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:04:13,779::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:04:13,780::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:04:13,780::task::1168::TaskManager.Task::(prepare) Task=`d562c6d3-9002-4aaf-906e-3d9923bc1462`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:04:13,780::task::579::TaskManager.Task::(_updateState) Task=`d562c6d3-9002-4aaf-906e-3d9923bc1462`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:04:13,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:04:13,780::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:04:13,781::task::974::TaskManager.Task::(_decref) Task=`d562c6d3-9002-4aaf-906e-3d9923bc1462`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:14,533::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:14,908::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:15,534::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:15,910::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:16,535::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:04:16,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:16,911::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:17,536::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:18,537::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:18,912::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286086::DEBUG::2014-01-16 16:04:19,081::task::579::TaskManager.Task::(_updateState) Task=`240a2230-f8da-4983-8e5d-145112961440`::moving from state init -> state preparing >Thread-286086::INFO::2014-01-16 16:04:19,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286086::INFO::2014-01-16 16:04:19,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308818', 'lastCheck': '5.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251321', 'lastCheck': '9.5', 'valid': True}} >Thread-286086::DEBUG::2014-01-16 16:04:19,082::task::1168::TaskManager.Task::(prepare) Task=`240a2230-f8da-4983-8e5d-145112961440`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308818', 'lastCheck': '5.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251321', 'lastCheck': '9.5', 'valid': True}} >Thread-286086::DEBUG::2014-01-16 16:04:19,082::task::579::TaskManager.Task::(_updateState) Task=`240a2230-f8da-4983-8e5d-145112961440`::moving from state preparing -> state finished >Thread-286086::DEBUG::2014-01-16 16:04:19,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286086::DEBUG::2014-01-16 16:04:19,082::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286086::DEBUG::2014-01-16 16:04:19,082::task::974::TaskManager.Task::(_decref) Task=`240a2230-f8da-4983-8e5d-145112961440`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:04:19,534::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:04:19,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:04:19,552::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000206096 s, 19.9 MB/s\n'; <rc> = 0 >Thread-189046::DEBUG::2014-01-16 16:04:20,061::task::579::TaskManager.Task::(_updateState) Task=`6a6b0c8a-4392-420e-ab99-cd92c1369a68`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:04:20,061::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:04:20,061::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:04:20,062::task::1168::TaskManager.Task::(prepare) Task=`6a6b0c8a-4392-420e-ab99-cd92c1369a68`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:04:20,062::task::579::TaskManager.Task::(_updateState) Task=`6a6b0c8a-4392-420e-ab99-cd92c1369a68`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:04:20,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:04:20,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:04:20,062::task::974::TaskManager.Task::(_decref) Task=`6a6b0c8a-4392-420e-ab99-cd92c1369a68`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:20,551::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:20,914::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:20,915::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:21,553::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:04:21,553::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:04:21,553::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:22,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:04:22,556::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:04:22,602::task::579::TaskManager.Task::(_updateState) Task=`bdb8e4f4-0d0f-4f01-9be8-6c307d079677`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:04:22,602::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:04:22,603::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:04:22,603::task::1168::TaskManager.Task::(prepare) Task=`bdb8e4f4-0d0f-4f01-9be8-6c307d079677`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:04:22,603::task::579::TaskManager.Task::(_updateState) Task=`bdb8e4f4-0d0f-4f01-9be8-6c307d079677`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:04:22,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:04:22,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:04:22,603::task::974::TaskManager.Task::(_decref) Task=`bdb8e4f4-0d0f-4f01-9be8-6c307d079677`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:04:22,916::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:23,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:04:23,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:04:23,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:04:23,569::task::579::TaskManager.Task::(_updateState) Task=`0900b034-fcd5-48da-8c12-b3b51c954ad3`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:04:23,569::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:04:23,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:04:23,570::task::1168::TaskManager.Task::(prepare) Task=`0900b034-fcd5-48da-8c12-b3b51c954ad3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:04:23,570::task::579::TaskManager.Task::(_updateState) Task=`0900b034-fcd5-48da-8c12-b3b51c954ad3`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:04:23,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:04:23,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:04:23,570::task::974::TaskManager.Task::(_decref) Task=`0900b034-fcd5-48da-8c12-b3b51c954ad3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:04:23,608::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:04:23,626::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000309842 s, 1.2 MB/s\n'; <rc> = 0 >Thread-59295::DEBUG::2014-01-16 16:04:23,688::task::579::TaskManager.Task::(_updateState) Task=`c10a0366-9dde-4458-9fc3-075fa6f9fc1e`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:04:23,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:04:23,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:04:23,689::task::1168::TaskManager.Task::(prepare) Task=`c10a0366-9dde-4458-9fc3-075fa6f9fc1e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:04:23,689::task::579::TaskManager.Task::(_updateState) Task=`c10a0366-9dde-4458-9fc3-075fa6f9fc1e`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:04:23,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:04:23,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:04:23,690::task::974::TaskManager.Task::(_decref) Task=`c10a0366-9dde-4458-9fc3-075fa6f9fc1e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:24,559::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:04:24,559::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:24,918::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:25,560::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:04:25,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:25,920::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:04:25,920::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:04:25,922::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:26,562::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:26,924::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:27,563::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:04:27,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:04:28,449::task::579::TaskManager.Task::(_updateState) Task=`0e0bb9cf-b350-473f-bc01-992823ae29cc`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:04:28,449::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:04:28,450::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:04:28,450::task::1168::TaskManager.Task::(prepare) Task=`0e0bb9cf-b350-473f-bc01-992823ae29cc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:04:28,450::task::579::TaskManager.Task::(_updateState) Task=`0e0bb9cf-b350-473f-bc01-992823ae29cc`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:04:28,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:04:28,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:04:28,450::task::974::TaskManager.Task::(_decref) Task=`0e0bb9cf-b350-473f-bc01-992823ae29cc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:28,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:04:28,565::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:28,925::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:04:29,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:04:29,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:04:29,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:04:29,576::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:04:29,578::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:04:29,581::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028823 s, 14.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:30,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:04:30,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:04:30,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:30,927::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:30,928::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:04:31,370::task::579::TaskManager.Task::(_updateState) Task=`f73369d0-527f-4df9-968d-6dd249fe1845`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:04:31,370::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:04:31,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:04:31,371::task::1168::TaskManager.Task::(prepare) Task=`f73369d0-527f-4df9-968d-6dd249fe1845`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:04:31,371::task::579::TaskManager.Task::(_updateState) Task=`f73369d0-527f-4df9-968d-6dd249fe1845`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:04:31,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:04:31,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:04:31,371::task::974::TaskManager.Task::(_decref) Task=`f73369d0-527f-4df9-968d-6dd249fe1845`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:31,582::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:04:31,582::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:04:31,875::task::579::TaskManager.Task::(_updateState) Task=`c31fa6fb-2f90-496e-b496-f59823786922`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:04:31,875::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:04:31,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:04:31,876::task::1168::TaskManager.Task::(prepare) Task=`c31fa6fb-2f90-496e-b496-f59823786922`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:04:31,876::task::579::TaskManager.Task::(_updateState) Task=`c31fa6fb-2f90-496e-b496-f59823786922`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:04:31,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:04:31,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:04:31,876::task::974::TaskManager.Task::(_decref) Task=`c31fa6fb-2f90-496e-b496-f59823786922`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:04:31,913::task::579::TaskManager.Task::(_updateState) Task=`dd4d876a-4b6c-4792-ba5d-c2a210943d0f`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:04:31,914::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:04:31,914::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:04:31,914::task::1168::TaskManager.Task::(prepare) Task=`dd4d876a-4b6c-4792-ba5d-c2a210943d0f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:04:31,914::task::579::TaskManager.Task::(_updateState) Task=`dd4d876a-4b6c-4792-ba5d-c2a210943d0f`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:04:31,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:04:31,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:04:31,915::task::974::TaskManager.Task::(_decref) Task=`dd4d876a-4b6c-4792-ba5d-c2a210943d0f`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:04:32,075::task::579::TaskManager.Task::(_updateState) Task=`304c22b0-baee-4042-b461-90c239b6e183`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:04:32,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:04:32,075::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:04:32,075::task::1168::TaskManager.Task::(prepare) Task=`304c22b0-baee-4042-b461-90c239b6e183`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:04:32,076::task::579::TaskManager.Task::(_updateState) Task=`304c22b0-baee-4042-b461-90c239b6e183`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:04:32,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:04:32,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:04:32,076::task::974::TaskManager.Task::(_decref) Task=`304c22b0-baee-4042-b461-90c239b6e183`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:04:32,531::task::579::TaskManager.Task::(_updateState) Task=`383e4c76-f017-4334-bc9a-2697ebd2bd7e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:04:32,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:04:32,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:04:32,532::task::1168::TaskManager.Task::(prepare) Task=`383e4c76-f017-4334-bc9a-2697ebd2bd7e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:04:32,532::task::579::TaskManager.Task::(_updateState) Task=`383e4c76-f017-4334-bc9a-2697ebd2bd7e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:04:32,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:04:32,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:04:32,533::task::974::TaskManager.Task::(_decref) Task=`383e4c76-f017-4334-bc9a-2697ebd2bd7e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:04:32,533::task::579::TaskManager.Task::(_updateState) Task=`4c164a6f-c584-40de-8f8a-63d50a1446a7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:04:32,533::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:04:32,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:04:32,533::task::1168::TaskManager.Task::(prepare) Task=`4c164a6f-c584-40de-8f8a-63d50a1446a7`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:04:32,534::task::579::TaskManager.Task::(_updateState) Task=`4c164a6f-c584-40de-8f8a-63d50a1446a7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:04:32,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:04:32,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:04:32,534::task::974::TaskManager.Task::(_decref) Task=`4c164a6f-c584-40de-8f8a-63d50a1446a7`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:04:32,534::task::579::TaskManager.Task::(_updateState) Task=`9f6e6639-c06a-4b44-b8dd-7de786b003e9`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:04:32,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:04:32,535::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:04:32,535::task::1168::TaskManager.Task::(prepare) Task=`9f6e6639-c06a-4b44-b8dd-7de786b003e9`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:04:32,535::task::579::TaskManager.Task::(_updateState) Task=`9f6e6639-c06a-4b44-b8dd-7de786b003e9`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:04:32,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:04:32,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:04:32,535::task::974::TaskManager.Task::(_decref) Task=`9f6e6639-c06a-4b44-b8dd-7de786b003e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:32,583::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:04:32,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:04:32,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:04:32,584::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:32,929::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:04:33,067::task::579::TaskManager.Task::(_updateState) Task=`38931180-c0fa-49f7-84af-8a710b67fbc1`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:04:33,067::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:04:33,067::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:04:33,068::task::1168::TaskManager.Task::(prepare) Task=`38931180-c0fa-49f7-84af-8a710b67fbc1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:04:33,068::task::579::TaskManager.Task::(_updateState) Task=`38931180-c0fa-49f7-84af-8a710b67fbc1`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:04:33,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:04:33,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:04:33,068::task::974::TaskManager.Task::(_decref) Task=`38931180-c0fa-49f7-84af-8a710b67fbc1`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:04:33,365::task::579::TaskManager.Task::(_updateState) Task=`73f28773-3cbf-4857-b5ca-66a8726a416f`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:04:33,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:04:33,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:04:33,366::task::1168::TaskManager.Task::(prepare) Task=`73f28773-3cbf-4857-b5ca-66a8726a416f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:04:33,366::task::579::TaskManager.Task::(_updateState) Task=`73f28773-3cbf-4857-b5ca-66a8726a416f`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:04:33,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:04:33,367::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:04:33,367::task::974::TaskManager.Task::(_decref) Task=`73f28773-3cbf-4857-b5ca-66a8726a416f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:33,585::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:04:33,634::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:04:33,650::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264364 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:34,586::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:04:34,587::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:04:34,587::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:04:34,587::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:34,587::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:04:34,589::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-286092::DEBUG::2014-01-16 16:04:34,853::task::579::TaskManager.Task::(_updateState) Task=`228994f1-df44-49fb-960e-112a2c3add26`::moving from state init -> state preparing >Thread-286092::INFO::2014-01-16 16:04:34,853::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286092::INFO::2014-01-16 16:04:34,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264364', 'lastCheck': '1.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028823', 'lastCheck': '5.3', 'valid': True}} >Thread-286092::DEBUG::2014-01-16 16:04:34,853::task::1168::TaskManager.Task::(prepare) Task=`228994f1-df44-49fb-960e-112a2c3add26`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264364', 'lastCheck': '1.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028823', 'lastCheck': '5.3', 'valid': True}} >Thread-286092::DEBUG::2014-01-16 16:04:34,854::task::579::TaskManager.Task::(_updateState) Task=`228994f1-df44-49fb-960e-112a2c3add26`::moving from state preparing -> state finished >Thread-286092::DEBUG::2014-01-16 16:04:34,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286092::DEBUG::2014-01-16 16:04:34,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286092::DEBUG::2014-01-16 16:04:34,854::task::974::TaskManager.Task::(_decref) Task=`228994f1-df44-49fb-960e-112a2c3add26`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:04:34,931::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:35,590::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:35,933::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:36,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:04:36,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:04:36,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:36,934::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:37,593::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:04:37,593::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:04:37,593::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:38,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:04:38,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:04:38,595::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:04:38,595::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:38,935::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:04:39,587::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:04:39,602::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:04:39,606::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000255624 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:40,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:04:40,605::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:40,937::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:40,939::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:04:40,939::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:04:40,946::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:04:41,058::task::579::TaskManager.Task::(_updateState) Task=`08d0f493-dca9-4dc7-9608-1ba58d0f6e2a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:04:41,058::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:04:41,058::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:04:41,058::task::1168::TaskManager.Task::(prepare) Task=`08d0f493-dca9-4dc7-9608-1ba58d0f6e2a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:04:41,059::task::579::TaskManager.Task::(_updateState) Task=`08d0f493-dca9-4dc7-9608-1ba58d0f6e2a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:04:41,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:04:41,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:04:41,059::task::974::TaskManager.Task::(_decref) Task=`08d0f493-dca9-4dc7-9608-1ba58d0f6e2a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:41,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:42,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:42,947::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:04:43,052::task::579::TaskManager.Task::(_updateState) Task=`34d0a0c1-012c-4413-a946-51b14ebdef21`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:04:43,052::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:04:43,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:04:43,053::task::1168::TaskManager.Task::(prepare) Task=`34d0a0c1-012c-4413-a946-51b14ebdef21`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:04:43,053::task::579::TaskManager.Task::(_updateState) Task=`34d0a0c1-012c-4413-a946-51b14ebdef21`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:04:43,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:04:43,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:04:43,054::task::974::TaskManager.Task::(_decref) Task=`34d0a0c1-012c-4413-a946-51b14ebdef21`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:04:43,054::task::579::TaskManager.Task::(_updateState) Task=`158d3712-c2a0-4480-9659-ca52d7f6fc5d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:04:43,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:04:43,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:04:43,054::task::1168::TaskManager.Task::(prepare) Task=`158d3712-c2a0-4480-9659-ca52d7f6fc5d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:04:43,054::task::579::TaskManager.Task::(_updateState) Task=`158d3712-c2a0-4480-9659-ca52d7f6fc5d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:04:43,055::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:04:43,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:04:43,055::task::974::TaskManager.Task::(_decref) Task=`158d3712-c2a0-4480-9659-ca52d7f6fc5d`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:04:43,055::task::579::TaskManager.Task::(_updateState) Task=`2cd38e68-9746-4b1b-a88b-b3f35e8dae41`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:04:43,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:04:43,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:04:43,056::task::1168::TaskManager.Task::(prepare) Task=`2cd38e68-9746-4b1b-a88b-b3f35e8dae41`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:04:43,056::task::579::TaskManager.Task::(_updateState) Task=`2cd38e68-9746-4b1b-a88b-b3f35e8dae41`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:04:43,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:04:43,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:04:43,056::task::974::TaskManager.Task::(_decref) Task=`2cd38e68-9746-4b1b-a88b-b3f35e8dae41`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:43,608::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:04:43,658::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:04:43,675::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297307 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:44,610::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:44,949::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:04:44,962::task::579::TaskManager.Task::(_updateState) Task=`9dab5eff-e90f-4dda-ba87-f533afbe19bc`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:04:44,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:04:44,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:04:44,963::task::1168::TaskManager.Task::(prepare) Task=`9dab5eff-e90f-4dda-ba87-f533afbe19bc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:04:44,963::task::579::TaskManager.Task::(_updateState) Task=`9dab5eff-e90f-4dda-ba87-f533afbe19bc`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:04:44,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:04:44,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:04:44,964::task::974::TaskManager.Task::(_decref) Task=`9dab5eff-e90f-4dda-ba87-f533afbe19bc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:45,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:45,950::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:46,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:04:46,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:46,951::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:47,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:48,615::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:48,953::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:04:49,611::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:04:49,626::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:04:49,629::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000226071 s, 18.1 MB/s\n'; <rc> = 0 >Thread-286098::DEBUG::2014-01-16 16:04:50,590::task::579::TaskManager.Task::(_updateState) Task=`b3a4213c-3d68-4cf0-bab8-e9b9b7615687`::moving from state init -> state preparing >Thread-286098::INFO::2014-01-16 16:04:50,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286098::INFO::2014-01-16 16:04:50,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297307', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226071', 'lastCheck': '1.0', 'valid': True}} >Thread-286098::DEBUG::2014-01-16 16:04:50,590::task::1168::TaskManager.Task::(prepare) Task=`b3a4213c-3d68-4cf0-bab8-e9b9b7615687`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297307', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226071', 'lastCheck': '1.0', 'valid': True}} >Thread-286098::DEBUG::2014-01-16 16:04:50,591::task::579::TaskManager.Task::(_updateState) Task=`b3a4213c-3d68-4cf0-bab8-e9b9b7615687`::moving from state preparing -> state finished >Thread-286098::DEBUG::2014-01-16 16:04:50,591::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286098::DEBUG::2014-01-16 16:04:50,591::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286098::DEBUG::2014-01-16 16:04:50,591::task::974::TaskManager.Task::(_decref) Task=`b3a4213c-3d68-4cf0-bab8-e9b9b7615687`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:50,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:50,954::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:04:50,955::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:51,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:04:51,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:04:51,629::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:04:51,918::task::579::TaskManager.Task::(_updateState) Task=`ecb716f8-cbf6-4a9d-89e2-d12df5722977`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:04:51,918::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:04:51,919::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:04:51,919::task::1168::TaskManager.Task::(prepare) Task=`ecb716f8-cbf6-4a9d-89e2-d12df5722977`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:04:51,919::task::579::TaskManager.Task::(_updateState) Task=`ecb716f8-cbf6-4a9d-89e2-d12df5722977`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:04:51,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:04:51,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:04:51,919::task::974::TaskManager.Task::(_decref) Task=`ecb716f8-cbf6-4a9d-89e2-d12df5722977`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:52,630::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:04:52,630::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:52,956::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:53,631::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:04:53,632::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:04:53,632::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:04:53,683::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:04:53,699::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281221 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:04:54,633::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:04:54,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:54,958::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:04:55,365::task::579::TaskManager.Task::(_updateState) Task=`2943d3f6-20b7-40ef-b2cd-122d4f545322`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:04:55,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:04:55,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:04:55,366::task::1168::TaskManager.Task::(prepare) Task=`2943d3f6-20b7-40ef-b2cd-122d4f545322`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:04:55,366::task::579::TaskManager.Task::(_updateState) Task=`2943d3f6-20b7-40ef-b2cd-122d4f545322`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:04:55,367::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:04:55,367::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:04:55,367::task::974::TaskManager.Task::(_decref) Task=`2943d3f6-20b7-40ef-b2cd-122d4f545322`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:04:55,367::task::579::TaskManager.Task::(_updateState) Task=`c373a8a4-04d9-401a-9358-92793313a0c6`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:04:55,367::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:04:55,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:04:55,368::task::1168::TaskManager.Task::(prepare) Task=`c373a8a4-04d9-401a-9358-92793313a0c6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:04:55,368::task::579::TaskManager.Task::(_updateState) Task=`c373a8a4-04d9-401a-9358-92793313a0c6`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:04:55,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:04:55,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:04:55,368::task::974::TaskManager.Task::(_decref) Task=`c373a8a4-04d9-401a-9358-92793313a0c6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:04:55,634::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:04:55,635::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:55,960::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:04:55,961::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:04:55,962::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:56,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:56,963::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:04:57,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:04:57,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:04:58,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:04:58,639::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:04:58,964::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:04:59,196::task::579::TaskManager.Task::(_updateState) Task=`541ce97a-6522-492b-ae87-9144718b173b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:04:59,196::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:04:59,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:04:59,197::task::1168::TaskManager.Task::(prepare) Task=`541ce97a-6522-492b-ae87-9144718b173b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:04:59,197::task::579::TaskManager.Task::(_updateState) Task=`541ce97a-6522-492b-ae87-9144718b173b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:04:59,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:04:59,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:04:59,197::task::974::TaskManager.Task::(_decref) Task=`541ce97a-6522-492b-ae87-9144718b173b`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:04:59,632::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:04:59,633::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:04:59,633::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:04:59,633::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:04:59,635::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:04:59,650::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:04:59,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:04:59,652::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:04:59,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:04:59,654::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000285514 s, 7.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:04:59,655::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000285514 s, 7.2 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:04:59,655::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:04:59,655::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:04:59,655::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:04:59,656::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:04:59,656::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:04:59,656::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:04:59,656::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:04:59,657::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:04:59,657::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:04:59,872::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:04:59,874::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:04:59,875::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:04:59,877::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:04:59,877::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:04:59,877::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:04:59,878::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:00,047::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:05:00,050::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:00,066::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00015711 s, 26.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:00,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:05:00,656::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:05:00,656::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:00,966::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:00,967::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:01,658::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:05:01,658::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:05:01,702::task::579::TaskManager.Task::(_updateState) Task=`0f11ff24-b047-4eb0-abbb-820334687d9c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:05:01,703::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:05:01,703::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:05:01,703::task::1168::TaskManager.Task::(prepare) Task=`0f11ff24-b047-4eb0-abbb-820334687d9c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:05:01,704::task::579::TaskManager.Task::(_updateState) Task=`0f11ff24-b047-4eb0-abbb-820334687d9c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:05:01,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:05:01,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:05:01,704::task::974::TaskManager.Task::(_decref) Task=`0f11ff24-b047-4eb0-abbb-820334687d9c`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:05:01,704::task::579::TaskManager.Task::(_updateState) Task=`960f24b7-f5ff-4480-bad4-2f89f3d23647`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:05:01,705::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:05:01,705::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:05:01,705::task::1168::TaskManager.Task::(prepare) Task=`960f24b7-f5ff-4480-bad4-2f89f3d23647`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:05:01,705::task::579::TaskManager.Task::(_updateState) Task=`960f24b7-f5ff-4480-bad4-2f89f3d23647`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:05:01,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:05:01,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:05:01,706::task::974::TaskManager.Task::(_decref) Task=`960f24b7-f5ff-4480-bad4-2f89f3d23647`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:05:02,656::task::579::TaskManager.Task::(_updateState) Task=`32d2ed23-c7b7-4271-844f-b5e42ab1ee94`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:05:02,657::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:05:02,659::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:05:02,659::task::579::TaskManager.Task::(_updateState) Task=`e357c7ff-b160-4452-a5f0-5b3d0eac1dba`::moving from state init -> state preparing >VM Channels Listener::DEBUG::2014-01-16 16:05:02,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >Thread-53040::DEBUG::2014-01-16 16:05:02,661::task::1168::TaskManager.Task::(prepare) Task=`32d2ed23-c7b7-4271-844f-b5e42ab1ee94`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >VM Channels Listener::DEBUG::2014-01-16 16:05:02,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >Thread-251782::INFO::2014-01-16 16:05:02,664::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 16:05:02,664::task::579::TaskManager.Task::(_updateState) Task=`32d2ed23-c7b7-4271-844f-b5e42ab1ee94`::moving from state preparing -> state finished >VM Channels Listener::DEBUG::2014-01-16 16:05:02,667::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >Thread-53040::DEBUG::2014-01-16 16:05:02,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >VM Channels Listener::DEBUG::2014-01-16 16:05:02,671::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::INFO::2014-01-16 16:05:02,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:05:02,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:05:02,673::task::1168::TaskManager.Task::(prepare) Task=`e357c7ff-b160-4452-a5f0-5b3d0eac1dba`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:05:02,674::task::974::TaskManager.Task::(_decref) Task=`32d2ed23-c7b7-4271-844f-b5e42ab1ee94`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:05:02,675::task::579::TaskManager.Task::(_updateState) Task=`e357c7ff-b160-4452-a5f0-5b3d0eac1dba`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:05:02,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:05:02,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:05:02,676::task::974::TaskManager.Task::(_decref) Task=`e357c7ff-b160-4452-a5f0-5b3d0eac1dba`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:05:02,968::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:05:03,473::task::579::TaskManager.Task::(_updateState) Task=`806f7f21-c73c-43ca-81ba-7d6af58b0cc8`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:05:03,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:05:03,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:05:03,474::task::1168::TaskManager.Task::(prepare) Task=`806f7f21-c73c-43ca-81ba-7d6af58b0cc8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:05:03,474::task::579::TaskManager.Task::(_updateState) Task=`806f7f21-c73c-43ca-81ba-7d6af58b0cc8`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:05:03,474::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:05:03,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:05:03,475::task::974::TaskManager.Task::(_decref) Task=`806f7f21-c73c-43ca-81ba-7d6af58b0cc8`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:05:03,672::task::579::TaskManager.Task::(_updateState) Task=`7cc43f59-0e5c-4dd5-a634-7158d6eb54ae`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:05:03,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >VM Channels Listener::DEBUG::2014-01-16 16:05:03,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::INFO::2014-01-16 16:05:03,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:05:03,673::task::1168::TaskManager.Task::(prepare) Task=`7cc43f59-0e5c-4dd5-a634-7158d6eb54ae`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:05:03,674::task::579::TaskManager.Task::(_updateState) Task=`7cc43f59-0e5c-4dd5-a634-7158d6eb54ae`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:05:03,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:05:03,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:05:03,674::task::974::TaskManager.Task::(_decref) Task=`7cc43f59-0e5c-4dd5-a634-7158d6eb54ae`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:05:03,674::task::579::TaskManager.Task::(_updateState) Task=`267b7d8d-c06d-4209-96fd-d8328684b8f4`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:05:03,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:05:03,675::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:05:03,675::task::1168::TaskManager.Task::(prepare) Task=`267b7d8d-c06d-4209-96fd-d8328684b8f4`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:05:03,675::task::579::TaskManager.Task::(_updateState) Task=`267b7d8d-c06d-4209-96fd-d8328684b8f4`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:05:03,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:05:03,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:05:03,675::task::974::TaskManager.Task::(_decref) Task=`267b7d8d-c06d-4209-96fd-d8328684b8f4`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:05:03,708::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:05:03,724::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286487 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:05:03,734::task::579::TaskManager.Task::(_updateState) Task=`eab8356b-b0c2-4b6b-b6bd-1960f13327c5`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:05:03,735::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:05:03,735::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:05:03,735::task::1168::TaskManager.Task::(prepare) Task=`eab8356b-b0c2-4b6b-b6bd-1960f13327c5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:05:03,736::task::579::TaskManager.Task::(_updateState) Task=`eab8356b-b0c2-4b6b-b6bd-1960f13327c5`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:05:03,736::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:05:03,736::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:05:03,736::task::974::TaskManager.Task::(_decref) Task=`eab8356b-b0c2-4b6b-b6bd-1960f13327c5`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:05:04,554::task::579::TaskManager.Task::(_updateState) Task=`3025baee-f34d-4041-aa45-0a46236112ac`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:05:04,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:05:04,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:05:04,555::task::1168::TaskManager.Task::(prepare) Task=`3025baee-f34d-4041-aa45-0a46236112ac`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:05:04,556::task::579::TaskManager.Task::(_updateState) Task=`3025baee-f34d-4041-aa45-0a46236112ac`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:05:04,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:05:04,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:05:04,556::task::974::TaskManager.Task::(_decref) Task=`3025baee-f34d-4041-aa45-0a46236112ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:04,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:05:04,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:05:04,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:05:04,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:05:04,675::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:05:04,676::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:05:04,969::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:05:05,439::task::579::TaskManager.Task::(_updateState) Task=`a7cc6824-c0e7-4d93-a5b2-6c0db6e7c152`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:05:05,440::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:05:05,440::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:05:05,440::task::1168::TaskManager.Task::(prepare) Task=`a7cc6824-c0e7-4d93-a5b2-6c0db6e7c152`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:05:05,440::task::579::TaskManager.Task::(_updateState) Task=`a7cc6824-c0e7-4d93-a5b2-6c0db6e7c152`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:05:05,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:05:05,441::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:05:05,441::task::974::TaskManager.Task::(_decref) Task=`a7cc6824-c0e7-4d93-a5b2-6c0db6e7c152`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:05,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:05,971::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286104::DEBUG::2014-01-16 16:05:06,345::task::579::TaskManager.Task::(_updateState) Task=`585db61c-6df6-4597-8387-517d570d66c5`::moving from state init -> state preparing >Thread-286104::INFO::2014-01-16 16:05:06,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286104::INFO::2014-01-16 16:05:06,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286487', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00015711', 'lastCheck': '6.3', 'valid': True}} >Thread-286104::DEBUG::2014-01-16 16:05:06,346::task::1168::TaskManager.Task::(prepare) Task=`585db61c-6df6-4597-8387-517d570d66c5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286487', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00015711', 'lastCheck': '6.3', 'valid': True}} >Thread-286104::DEBUG::2014-01-16 16:05:06,346::task::579::TaskManager.Task::(_updateState) Task=`585db61c-6df6-4597-8387-517d570d66c5`::moving from state preparing -> state finished >Thread-286104::DEBUG::2014-01-16 16:05:06,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286104::DEBUG::2014-01-16 16:05:06,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286104::DEBUG::2014-01-16 16:05:06,346::task::974::TaskManager.Task::(_decref) Task=`585db61c-6df6-4597-8387-517d570d66c5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:06,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:05:06,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:05:06,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:06,972::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:07,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:05:07,681::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:05:07,681::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:05:08,498::task::579::TaskManager.Task::(_updateState) Task=`7b5b536d-aff7-4a53-8587-f018ede8080c`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:05:08,498::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:05:08,498::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:05:08,499::task::1168::TaskManager.Task::(prepare) Task=`7b5b536d-aff7-4a53-8587-f018ede8080c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:05:08,499::task::579::TaskManager.Task::(_updateState) Task=`7b5b536d-aff7-4a53-8587-f018ede8080c`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:05:08,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:05:08,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:05:08,499::task::974::TaskManager.Task::(_decref) Task=`7b5b536d-aff7-4a53-8587-f018ede8080c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:08,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:05:08,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:05:08,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:05:08,683::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:08,973::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:09,684::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:05:10,074::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:10,092::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000264252 s, 15.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:10,685::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:05:10,685::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:10,975::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:10,976::task::579::TaskManager.Task::(_updateState) Task=`2ac4ab00-7fbe-4bc9-836c-53d5122305b4`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:05:10,976::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:05:10,976::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:05:10,976::task::1168::TaskManager.Task::(prepare) Task=`2ac4ab00-7fbe-4bc9-836c-53d5122305b4`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:05:10,977::task::579::TaskManager.Task::(_updateState) Task=`2ac4ab00-7fbe-4bc9-836c-53d5122305b4`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:05:10,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:05:10,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:05:10,977::task::974::TaskManager.Task::(_decref) Task=`2ac4ab00-7fbe-4bc9-836c-53d5122305b4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:05:10,979::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:05:10,979::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:05:10,981::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:10,983::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:10,983::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:11,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:05:12,161::task::579::TaskManager.Task::(_updateState) Task=`3caaeb8e-8273-4d5c-b3e5-c484b0b68f68`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:05:12,162::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:05:12,162::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:05:12,162::task::1168::TaskManager.Task::(prepare) Task=`3caaeb8e-8273-4d5c-b3e5-c484b0b68f68`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:05:12,162::task::579::TaskManager.Task::(_updateState) Task=`3caaeb8e-8273-4d5c-b3e5-c484b0b68f68`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:05:12,162::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:05:12,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:05:12,162::task::974::TaskManager.Task::(_decref) Task=`3caaeb8e-8273-4d5c-b3e5-c484b0b68f68`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:12,688::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:05:12,971::task::579::TaskManager.Task::(_updateState) Task=`0aef9302-8823-4702-bc76-f3035a67286a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:05:12,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:05:12,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:05:12,971::task::1168::TaskManager.Task::(prepare) Task=`0aef9302-8823-4702-bc76-f3035a67286a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:05:12,971::task::579::TaskManager.Task::(_updateState) Task=`0aef9302-8823-4702-bc76-f3035a67286a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:05:12,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:05:12,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:05:12,972::task::974::TaskManager.Task::(_decref) Task=`0aef9302-8823-4702-bc76-f3035a67286a`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:05:12,972::task::579::TaskManager.Task::(_updateState) Task=`893435e6-1ee4-4f74-8bfa-36703917bcec`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:05:12,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:05:12,973::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:05:12,973::task::1168::TaskManager.Task::(prepare) Task=`893435e6-1ee4-4f74-8bfa-36703917bcec`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:05:12,973::task::579::TaskManager.Task::(_updateState) Task=`893435e6-1ee4-4f74-8bfa-36703917bcec`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:05:12,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:05:12,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:05:12,973::task::974::TaskManager.Task::(_decref) Task=`893435e6-1ee4-4f74-8bfa-36703917bcec`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:05:12,985::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:13,689::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:05:13,733::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:05:13,749::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000270306 s, 1.4 MB/s\n'; <rc> = 0 >Thread-131569::DEBUG::2014-01-16 16:05:13,858::task::579::TaskManager.Task::(_updateState) Task=`78492df2-7393-49b8-8813-06796fb34dbf`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:05:13,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:05:13,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:05:13,860::task::1168::TaskManager.Task::(prepare) Task=`78492df2-7393-49b8-8813-06796fb34dbf`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:05:13,860::task::579::TaskManager.Task::(_updateState) Task=`78492df2-7393-49b8-8813-06796fb34dbf`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:05:13,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:05:13,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:05:13,861::task::974::TaskManager.Task::(_decref) Task=`78492df2-7393-49b8-8813-06796fb34dbf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:14,690::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:14,986::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:15,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:15,987::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:16,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:05:16,692::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:16,989::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:17,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:05:18,695::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:18,990::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:19,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:05:20,097::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:20,113::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000259214 s, 15.8 MB/s\n'; <rc> = 0 >Thread-189046::DEBUG::2014-01-16 16:05:20,227::task::579::TaskManager.Task::(_updateState) Task=`cc68a85c-7062-4a05-a804-10b18032e9c9`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:05:20,227::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:05:20,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:05:20,228::task::1168::TaskManager.Task::(prepare) Task=`cc68a85c-7062-4a05-a804-10b18032e9c9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:05:20,228::task::579::TaskManager.Task::(_updateState) Task=`cc68a85c-7062-4a05-a804-10b18032e9c9`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:05:20,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:05:20,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:05:20,228::task::974::TaskManager.Task::(_decref) Task=`cc68a85c-7062-4a05-a804-10b18032e9c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:20,697::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:20,991::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:20,992::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:21,698::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:05:21,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:05:21,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286110::DEBUG::2014-01-16 16:05:22,079::task::579::TaskManager.Task::(_updateState) Task=`d61f562e-740e-49b8-8950-2c1640b9c8f1`::moving from state init -> state preparing >Thread-286110::INFO::2014-01-16 16:05:22,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286110::INFO::2014-01-16 16:05:22,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270306', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259214', 'lastCheck': '2.0', 'valid': True}} >Thread-286110::DEBUG::2014-01-16 16:05:22,080::task::1168::TaskManager.Task::(prepare) Task=`d61f562e-740e-49b8-8950-2c1640b9c8f1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270306', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259214', 'lastCheck': '2.0', 'valid': True}} >Thread-286110::DEBUG::2014-01-16 16:05:22,080::task::579::TaskManager.Task::(_updateState) Task=`d61f562e-740e-49b8-8950-2c1640b9c8f1`::moving from state preparing -> state finished >Thread-286110::DEBUG::2014-01-16 16:05:22,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286110::DEBUG::2014-01-16 16:05:22,080::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286110::DEBUG::2014-01-16 16:05:22,081::task::974::TaskManager.Task::(_decref) Task=`d61f562e-740e-49b8-8950-2c1640b9c8f1`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:05:22,680::task::579::TaskManager.Task::(_updateState) Task=`da22ed3a-f129-4978-bbf0-487291ff3d1b`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:05:22,680::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:05:22,681::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:05:22,681::task::1168::TaskManager.Task::(prepare) Task=`da22ed3a-f129-4978-bbf0-487291ff3d1b`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:05:22,682::task::579::TaskManager.Task::(_updateState) Task=`da22ed3a-f129-4978-bbf0-487291ff3d1b`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:05:22,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:05:22,682::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:05:22,682::task::974::TaskManager.Task::(_decref) Task=`da22ed3a-f129-4978-bbf0-487291ff3d1b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:22,700::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:05:22,700::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:22,993::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:23,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:05:23,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:05:23,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:05:23,743::task::579::TaskManager.Task::(_updateState) Task=`a868e844-7183-4cb6-bae7-2d1c6271aee3`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:05:23,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:05:23,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:05:23,744::task::1168::TaskManager.Task::(prepare) Task=`a868e844-7183-4cb6-bae7-2d1c6271aee3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:05:23,744::task::579::TaskManager.Task::(_updateState) Task=`a868e844-7183-4cb6-bae7-2d1c6271aee3`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:05:23,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:05:23,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:05:23,744::task::974::TaskManager.Task::(_decref) Task=`a868e844-7183-4cb6-bae7-2d1c6271aee3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:05:23,757::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:05:23,774::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000270331 s, 1.4 MB/s\n'; <rc> = 0 >Thread-59295::DEBUG::2014-01-16 16:05:23,852::task::579::TaskManager.Task::(_updateState) Task=`0373d2c8-fd3a-409c-bd56-e47a8b78ce94`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:05:23,853::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:05:23,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:05:23,853::task::1168::TaskManager.Task::(prepare) Task=`0373d2c8-fd3a-409c-bd56-e47a8b78ce94`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:05:23,853::task::579::TaskManager.Task::(_updateState) Task=`0373d2c8-fd3a-409c-bd56-e47a8b78ce94`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:05:23,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:05:23,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:05:23,854::task::974::TaskManager.Task::(_decref) Task=`0373d2c8-fd3a-409c-bd56-e47a8b78ce94`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:24,702::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:05:24,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:24,994::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:25,702::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:05:25,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:25,997::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:05:25,997::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:05:25,998::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:26,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:26,999::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:27,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:05:27,705::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:05:28,622::task::579::TaskManager.Task::(_updateState) Task=`41d871fb-19bb-4ce9-87a7-e4af194dc3ef`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:05:28,623::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:05:28,623::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:05:28,623::task::1168::TaskManager.Task::(prepare) Task=`41d871fb-19bb-4ce9-87a7-e4af194dc3ef`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:05:28,623::task::579::TaskManager.Task::(_updateState) Task=`41d871fb-19bb-4ce9-87a7-e4af194dc3ef`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:05:28,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:05:28,624::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:05:28,624::task::974::TaskManager.Task::(_decref) Task=`41d871fb-19bb-4ce9-87a7-e4af194dc3ef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:28,706::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:05:28,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:29,001::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:29,708::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:05:29,708::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:05:29,708::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:05:29,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:05:30,119::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:30,135::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000212464 s, 19.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:30,710::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:05:30,710::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:05:30,710::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:31,002::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:31,003::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:05:31,545::task::579::TaskManager.Task::(_updateState) Task=`48dc5828-0337-4f5b-947d-fcceeef6b5d2`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:05:31,546::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:05:31,546::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:05:31,547::task::1168::TaskManager.Task::(prepare) Task=`48dc5828-0337-4f5b-947d-fcceeef6b5d2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:05:31,547::task::579::TaskManager.Task::(_updateState) Task=`48dc5828-0337-4f5b-947d-fcceeef6b5d2`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:05:31,547::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:05:31,547::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:05:31,547::task::974::TaskManager.Task::(_decref) Task=`48dc5828-0337-4f5b-947d-fcceeef6b5d2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:31,712::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:05:31,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:05:32,046::task::579::TaskManager.Task::(_updateState) Task=`78139ce4-f210-47f8-8489-e55b0c0b7dcc`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:05:32,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:05:32,047::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:05:32,047::task::1168::TaskManager.Task::(prepare) Task=`78139ce4-f210-47f8-8489-e55b0c0b7dcc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:05:32,048::task::579::TaskManager.Task::(_updateState) Task=`78139ce4-f210-47f8-8489-e55b0c0b7dcc`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:05:32,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:05:32,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:05:32,048::task::974::TaskManager.Task::(_decref) Task=`78139ce4-f210-47f8-8489-e55b0c0b7dcc`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:05:32,061::task::579::TaskManager.Task::(_updateState) Task=`2bc22259-8377-4af1-b846-93c45b21ab1d`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:05:32,061::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:05:32,062::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:05:32,062::task::1168::TaskManager.Task::(prepare) Task=`2bc22259-8377-4af1-b846-93c45b21ab1d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:05:32,062::task::579::TaskManager.Task::(_updateState) Task=`2bc22259-8377-4af1-b846-93c45b21ab1d`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:05:32,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:05:32,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:05:32,063::task::974::TaskManager.Task::(_decref) Task=`2bc22259-8377-4af1-b846-93c45b21ab1d`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:05:32,241::task::579::TaskManager.Task::(_updateState) Task=`43083232-db00-4ca6-94b8-a850f5c651d5`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:05:32,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:05:32,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:05:32,241::task::1168::TaskManager.Task::(prepare) Task=`43083232-db00-4ca6-94b8-a850f5c651d5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:05:32,242::task::579::TaskManager.Task::(_updateState) Task=`43083232-db00-4ca6-94b8-a850f5c651d5`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:05:32,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:05:32,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:05:32,242::task::974::TaskManager.Task::(_decref) Task=`43083232-db00-4ca6-94b8-a850f5c651d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:32,713::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:05:32,714::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:05:32,714::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:05:32,714::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:05:32,804::task::579::TaskManager.Task::(_updateState) Task=`82e97832-8030-4953-8ed6-8a08b3ddff25`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:05:32,804::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:05:32,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:05:32,804::task::1168::TaskManager.Task::(prepare) Task=`82e97832-8030-4953-8ed6-8a08b3ddff25`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:05:32,805::task::579::TaskManager.Task::(_updateState) Task=`82e97832-8030-4953-8ed6-8a08b3ddff25`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:05:32,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:05:32,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:05:32,805::task::974::TaskManager.Task::(_decref) Task=`82e97832-8030-4953-8ed6-8a08b3ddff25`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:05:32,805::task::579::TaskManager.Task::(_updateState) Task=`9a416132-f248-4d9e-aa03-c8bef213368f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:05:32,805::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:05:32,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:05:32,806::task::1168::TaskManager.Task::(prepare) Task=`9a416132-f248-4d9e-aa03-c8bef213368f`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:05:32,806::task::579::TaskManager.Task::(_updateState) Task=`9a416132-f248-4d9e-aa03-c8bef213368f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:05:32,806::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:05:32,806::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:05:32,806::task::974::TaskManager.Task::(_decref) Task=`9a416132-f248-4d9e-aa03-c8bef213368f`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:05:32,807::task::579::TaskManager.Task::(_updateState) Task=`93ddb1fb-8cd5-4300-a4f9-f58f54340f29`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:05:32,807::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:05:32,807::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:05:32,807::task::1168::TaskManager.Task::(prepare) Task=`93ddb1fb-8cd5-4300-a4f9-f58f54340f29`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:05:32,807::task::579::TaskManager.Task::(_updateState) Task=`93ddb1fb-8cd5-4300-a4f9-f58f54340f29`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:05:32,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:05:32,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:05:32,808::task::974::TaskManager.Task::(_decref) Task=`93ddb1fb-8cd5-4300-a4f9-f58f54340f29`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:05:33,004::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:05:33,227::task::579::TaskManager.Task::(_updateState) Task=`ad48417a-fb3a-44c3-94dc-db5a2a39b802`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:05:33,227::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:05:33,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:05:33,227::task::1168::TaskManager.Task::(prepare) Task=`ad48417a-fb3a-44c3-94dc-db5a2a39b802`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:05:33,228::task::579::TaskManager.Task::(_updateState) Task=`ad48417a-fb3a-44c3-94dc-db5a2a39b802`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:05:33,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:05:33,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:05:33,228::task::974::TaskManager.Task::(_decref) Task=`ad48417a-fb3a-44c3-94dc-db5a2a39b802`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:05:33,552::task::579::TaskManager.Task::(_updateState) Task=`2e693369-b51d-4c66-92b8-224352be3606`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:05:33,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:05:33,552::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:05:33,552::task::1168::TaskManager.Task::(prepare) Task=`2e693369-b51d-4c66-92b8-224352be3606`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:05:33,552::task::579::TaskManager.Task::(_updateState) Task=`2e693369-b51d-4c66-92b8-224352be3606`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:05:33,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:05:33,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:05:33,553::task::974::TaskManager.Task::(_decref) Task=`2e693369-b51d-4c66-92b8-224352be3606`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:33,715::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:05:33,782::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:05:33,800::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271631 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:34,716::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:05:34,717::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:05:34,717::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:05:34,717::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:05:34,717::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:05:34,718::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:05:35,006::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:35,718::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:36,007::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:36,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:05:36,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:05:36,720::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:37,008::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:37,720::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:05:37,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:05:37,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286116::DEBUG::2014-01-16 16:05:38,230::task::579::TaskManager.Task::(_updateState) Task=`cfb393e5-9b0a-4d10-9d97-75c7171d4fc9`::moving from state init -> state preparing >Thread-286116::INFO::2014-01-16 16:05:38,230::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286116::INFO::2014-01-16 16:05:38,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271631', 'lastCheck': '4.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212464', 'lastCheck': '8.1', 'valid': True}} >Thread-286116::DEBUG::2014-01-16 16:05:38,231::task::1168::TaskManager.Task::(prepare) Task=`cfb393e5-9b0a-4d10-9d97-75c7171d4fc9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271631', 'lastCheck': '4.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212464', 'lastCheck': '8.1', 'valid': True}} >Thread-286116::DEBUG::2014-01-16 16:05:38,231::task::579::TaskManager.Task::(_updateState) Task=`cfb393e5-9b0a-4d10-9d97-75c7171d4fc9`::moving from state preparing -> state finished >Thread-286116::DEBUG::2014-01-16 16:05:38,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286116::DEBUG::2014-01-16 16:05:38,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286116::DEBUG::2014-01-16 16:05:38,231::task::974::TaskManager.Task::(_decref) Task=`cfb393e5-9b0a-4d10-9d97-75c7171d4fc9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:38,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:05:38,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:05:38,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:05:38,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:39,010::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:39,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:05:40,141::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:40,157::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0002956 s, 13.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:40,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:05:40,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:41,011::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:41,013::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:05:41,013::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:05:41,019::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:05:41,215::task::579::TaskManager.Task::(_updateState) Task=`40135835-9f77-473a-bbed-ba540e642668`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:05:41,216::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:05:41,216::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:05:41,216::task::1168::TaskManager.Task::(prepare) Task=`40135835-9f77-473a-bbed-ba540e642668`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:05:41,216::task::579::TaskManager.Task::(_updateState) Task=`40135835-9f77-473a-bbed-ba540e642668`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:05:41,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:05:41,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:05:41,217::task::974::TaskManager.Task::(_decref) Task=`40135835-9f77-473a-bbed-ba540e642668`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:41,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:05:42,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:43,020::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:05:43,625::task::579::TaskManager.Task::(_updateState) Task=`15a7d59e-f550-48e2-a29c-7cfc80a57e59`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:05:43,625::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:05:43,626::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:05:43,626::task::1168::TaskManager.Task::(prepare) Task=`15a7d59e-f550-48e2-a29c-7cfc80a57e59`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:05:43,626::task::579::TaskManager.Task::(_updateState) Task=`15a7d59e-f550-48e2-a29c-7cfc80a57e59`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:05:43,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:05:43,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:05:43,626::task::974::TaskManager.Task::(_decref) Task=`15a7d59e-f550-48e2-a29c-7cfc80a57e59`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:05:43,627::task::579::TaskManager.Task::(_updateState) Task=`ee90bef3-e83b-4581-8fb9-c5cba0a3cbad`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:05:43,627::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:05:43,627::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:05:43,627::task::1168::TaskManager.Task::(prepare) Task=`ee90bef3-e83b-4581-8fb9-c5cba0a3cbad`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:05:43,627::task::579::TaskManager.Task::(_updateState) Task=`ee90bef3-e83b-4581-8fb9-c5cba0a3cbad`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:05:43,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:05:43,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:05:43,628::task::974::TaskManager.Task::(_decref) Task=`ee90bef3-e83b-4581-8fb9-c5cba0a3cbad`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:05:43,628::task::579::TaskManager.Task::(_updateState) Task=`3a605bb7-11a7-4816-8619-7162c3b4d4ce`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:05:43,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:05:43,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:05:43,629::task::1168::TaskManager.Task::(prepare) Task=`3a605bb7-11a7-4816-8619-7162c3b4d4ce`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:05:43,629::task::579::TaskManager.Task::(_updateState) Task=`3a605bb7-11a7-4816-8619-7162c3b4d4ce`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:05:43,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:05:43,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:05:43,629::task::974::TaskManager.Task::(_decref) Task=`3a605bb7-11a7-4816-8619-7162c3b4d4ce`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:43,730::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:05:43,807::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:05:43,823::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000278438 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:44,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:45,021::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:05:45,149::task::579::TaskManager.Task::(_updateState) Task=`4ff033f7-100d-44dc-846f-a56dee4bb40c`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:05:45,150::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:05:45,150::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:05:45,150::task::1168::TaskManager.Task::(prepare) Task=`4ff033f7-100d-44dc-846f-a56dee4bb40c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:05:45,150::task::579::TaskManager.Task::(_updateState) Task=`4ff033f7-100d-44dc-846f-a56dee4bb40c`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:05:45,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:05:45,151::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:05:45,151::task::974::TaskManager.Task::(_decref) Task=`4ff033f7-100d-44dc-846f-a56dee4bb40c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:45,732::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:46,023::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:46,733::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:05:46,734::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:47,024::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:47,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:05:48,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:49,025::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:49,737::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:05:50,162::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:05:50,180::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000212987 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:05:50,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:51,026::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:05:51,027::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:51,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:05:51,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:05:51,740::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:05:52,098::task::579::TaskManager.Task::(_updateState) Task=`f8490868-1b17-4abd-b7b4-3e2361d225fb`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:05:52,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:05:52,099::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:05:52,099::task::1168::TaskManager.Task::(prepare) Task=`f8490868-1b17-4abd-b7b4-3e2361d225fb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:05:52,099::task::579::TaskManager.Task::(_updateState) Task=`f8490868-1b17-4abd-b7b4-3e2361d225fb`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:05:52,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:05:52,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:05:52,100::task::974::TaskManager.Task::(_decref) Task=`f8490868-1b17-4abd-b7b4-3e2361d225fb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:52,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:05:52,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:53,029::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:53,743::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:05:53,743::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:05:53,744::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:05:53,831::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:05:53,849::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267927 s, 1.4 MB/s\n'; <rc> = 0 >Thread-286122::DEBUG::2014-01-16 16:05:53,978::task::579::TaskManager.Task::(_updateState) Task=`d64688e6-50c9-447a-ae2b-6e33a04ad09a`::moving from state init -> state preparing >Thread-286122::INFO::2014-01-16 16:05:53,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286122::INFO::2014-01-16 16:05:53,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267927', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212987', 'lastCheck': '3.8', 'valid': True}} >Thread-286122::DEBUG::2014-01-16 16:05:53,979::task::1168::TaskManager.Task::(prepare) Task=`d64688e6-50c9-447a-ae2b-6e33a04ad09a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267927', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212987', 'lastCheck': '3.8', 'valid': True}} >Thread-286122::DEBUG::2014-01-16 16:05:53,979::task::579::TaskManager.Task::(_updateState) Task=`d64688e6-50c9-447a-ae2b-6e33a04ad09a`::moving from state preparing -> state finished >Thread-286122::DEBUG::2014-01-16 16:05:53,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286122::DEBUG::2014-01-16 16:05:53,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286122::DEBUG::2014-01-16 16:05:53,979::task::974::TaskManager.Task::(_decref) Task=`d64688e6-50c9-447a-ae2b-6e33a04ad09a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:54,744::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:05:54,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:55,030::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:05:55,598::task::579::TaskManager.Task::(_updateState) Task=`6643b6f7-dd0d-4b43-934e-f10c73077264`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:05:55,598::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:05:55,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:05:55,599::task::1168::TaskManager.Task::(prepare) Task=`6643b6f7-dd0d-4b43-934e-f10c73077264`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:05:55,599::task::579::TaskManager.Task::(_updateState) Task=`6643b6f7-dd0d-4b43-934e-f10c73077264`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:05:55,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:05:55,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:05:55,599::task::974::TaskManager.Task::(_decref) Task=`6643b6f7-dd0d-4b43-934e-f10c73077264`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:05:55,600::task::579::TaskManager.Task::(_updateState) Task=`f79cf3a6-8e00-498d-a756-c77b61cafd2c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:05:55,600::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:05:55,600::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:05:55,600::task::1168::TaskManager.Task::(prepare) Task=`f79cf3a6-8e00-498d-a756-c77b61cafd2c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:05:55,600::task::579::TaskManager.Task::(_updateState) Task=`f79cf3a6-8e00-498d-a756-c77b61cafd2c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:05:55,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:05:55,601::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:05:55,601::task::974::TaskManager.Task::(_decref) Task=`f79cf3a6-8e00-498d-a756-c77b61cafd2c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:55,746::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:05:55,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:56,032::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:05:56,033::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:05:56,034::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:56,747::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:57,035::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:05:57,748::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:05:57,749::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:05:58,750::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:05:58,750::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:05:59,036::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:05:59,364::task::579::TaskManager.Task::(_updateState) Task=`8b191fea-e313-4b89-ac40-5a804b012168`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:05:59,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:05:59,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:05:59,365::task::1168::TaskManager.Task::(prepare) Task=`8b191fea-e313-4b89-ac40-5a804b012168`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:05:59,365::task::579::TaskManager.Task::(_updateState) Task=`8b191fea-e313-4b89-ac40-5a804b012168`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:05:59,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:05:59,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:05:59,366::task::974::TaskManager.Task::(_decref) Task=`8b191fea-e313-4b89-ac40-5a804b012168`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:05:59,750::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:05:59,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:05:59,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:05:59,751::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:06:00,186::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:06:00,202::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000361807 s, 11.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:00,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:06:00,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:06:00,752::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:01,038::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:01,039::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:01,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:06:01,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:06:01,920::task::579::TaskManager.Task::(_updateState) Task=`cba57a79-28ea-48a2-bc55-2400b2eb4fd2`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:06:01,920::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:06:01,920::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:06:01,920::task::1168::TaskManager.Task::(prepare) Task=`cba57a79-28ea-48a2-bc55-2400b2eb4fd2`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:06:01,921::task::579::TaskManager.Task::(_updateState) Task=`cba57a79-28ea-48a2-bc55-2400b2eb4fd2`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:06:01,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:06:01,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:06:01,921::task::974::TaskManager.Task::(_decref) Task=`cba57a79-28ea-48a2-bc55-2400b2eb4fd2`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:06:01,921::task::579::TaskManager.Task::(_updateState) Task=`cfaf63fa-6386-4a4e-85e0-e449fd0e7241`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:06:01,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:06:01,922::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:06:01,922::task::1168::TaskManager.Task::(prepare) Task=`cfaf63fa-6386-4a4e-85e0-e449fd0e7241`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:06:01,922::task::579::TaskManager.Task::(_updateState) Task=`cfaf63fa-6386-4a4e-85e0-e449fd0e7241`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:06:01,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:06:01,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:06:01,923::task::974::TaskManager.Task::(_decref) Task=`cfaf63fa-6386-4a4e-85e0-e449fd0e7241`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:06:02,749::task::579::TaskManager.Task::(_updateState) Task=`4976e78a-5af9-46c0-bf78-9ed82d2ac3ef`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:06:02,749::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:06:02,749::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:06:02,750::task::1168::TaskManager.Task::(prepare) Task=`4976e78a-5af9-46c0-bf78-9ed82d2ac3ef`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:06:02,750::task::579::TaskManager.Task::(_updateState) Task=`4976e78a-5af9-46c0-bf78-9ed82d2ac3ef`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:06:02,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:06:02,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:06:02,750::task::974::TaskManager.Task::(_decref) Task=`4976e78a-5af9-46c0-bf78-9ed82d2ac3ef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:02,754::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:06:02,754::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:06:02,754::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:06:02,755::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 16:06:02,755::task::579::TaskManager.Task::(_updateState) Task=`650ace99-5539-43fb-8b8b-6f62a2cfd2fa`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:06:02,756::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:06:02,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:06:02,757::task::1168::TaskManager.Task::(prepare) Task=`650ace99-5539-43fb-8b8b-6f62a2cfd2fa`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:06:02,757::task::579::TaskManager.Task::(_updateState) Task=`650ace99-5539-43fb-8b8b-6f62a2cfd2fa`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:06:02,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:06:02,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:06:02,758::task::974::TaskManager.Task::(_decref) Task=`650ace99-5539-43fb-8b8b-6f62a2cfd2fa`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:06:03,040::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:06:03,636::task::579::TaskManager.Task::(_updateState) Task=`4007e9e0-2814-466d-bf6f-d123aa920657`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:06:03,636::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:06:03,636::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:06:03,636::task::1168::TaskManager.Task::(prepare) Task=`4007e9e0-2814-466d-bf6f-d123aa920657`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:06:03,636::task::579::TaskManager.Task::(_updateState) Task=`4007e9e0-2814-466d-bf6f-d123aa920657`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:06:03,637::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:06:03,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:06:03,637::task::974::TaskManager.Task::(_decref) Task=`4007e9e0-2814-466d-bf6f-d123aa920657`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:03,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:06:03,792::task::579::TaskManager.Task::(_updateState) Task=`7e36f8c4-a86f-4058-b33f-3e5bb3c6d733`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:06:03,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:06:03,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:06:03,792::task::1168::TaskManager.Task::(prepare) Task=`7e36f8c4-a86f-4058-b33f-3e5bb3c6d733`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:06:03,793::task::579::TaskManager.Task::(_updateState) Task=`7e36f8c4-a86f-4058-b33f-3e5bb3c6d733`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:06:03,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:06:03,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:06:03,793::task::974::TaskManager.Task::(_decref) Task=`7e36f8c4-a86f-4058-b33f-3e5bb3c6d733`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:06:03,793::task::579::TaskManager.Task::(_updateState) Task=`acea9086-43e8-4e22-be34-7167efff50a2`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:06:03,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:06:03,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:06:03,794::task::1168::TaskManager.Task::(prepare) Task=`acea9086-43e8-4e22-be34-7167efff50a2`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:06:03,794::task::579::TaskManager.Task::(_updateState) Task=`acea9086-43e8-4e22-be34-7167efff50a2`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:06:03,794::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:06:03,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:06:03,794::task::974::TaskManager.Task::(_decref) Task=`acea9086-43e8-4e22-be34-7167efff50a2`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:06:03,851::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:06:03,855::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:06:03,856::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:06:03,861::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:06:03,863::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:06:03,863::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:06:03,863::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:06:03,868::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:06:03,884::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000230705 s, 1.6 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:06:03,886::task::579::TaskManager.Task::(_updateState) Task=`41f96146-5be2-4a0e-ac95-b36f9d254aff`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:06:03,887::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:06:03,887::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:06:03,887::task::1168::TaskManager.Task::(prepare) Task=`41f96146-5be2-4a0e-ac95-b36f9d254aff`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:06:03,887::task::579::TaskManager.Task::(_updateState) Task=`41f96146-5be2-4a0e-ac95-b36f9d254aff`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:06:03,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:06:03,888::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:06:03,888::task::974::TaskManager.Task::(_decref) Task=`41f96146-5be2-4a0e-ac95-b36f9d254aff`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:06:04,721::task::579::TaskManager.Task::(_updateState) Task=`bc5793cf-ed30-40f1-beaf-774e36ab3230`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:06:04,722::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:06:04,722::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:06:04,722::task::1168::TaskManager.Task::(prepare) Task=`bc5793cf-ed30-40f1-beaf-774e36ab3230`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:06:04,722::task::579::TaskManager.Task::(_updateState) Task=`bc5793cf-ed30-40f1-beaf-774e36ab3230`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:06:04,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:06:04,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:06:04,723::task::974::TaskManager.Task::(_decref) Task=`bc5793cf-ed30-40f1-beaf-774e36ab3230`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:04,757::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:06:04,758::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:06:04,758::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:06:04,758::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:04,758::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:06:04,759::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:06:05,042::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:06:05,611::task::579::TaskManager.Task::(_updateState) Task=`8a86e0ad-1c42-4801-9d61-2d9ad44911df`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:06:05,611::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:06:05,612::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:06:05,612::task::1168::TaskManager.Task::(prepare) Task=`8a86e0ad-1c42-4801-9d61-2d9ad44911df`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:06:05,612::task::579::TaskManager.Task::(_updateState) Task=`8a86e0ad-1c42-4801-9d61-2d9ad44911df`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:06:05,612::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:06:05,612::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:06:05,612::task::974::TaskManager.Task::(_decref) Task=`8a86e0ad-1c42-4801-9d61-2d9ad44911df`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:05,760::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:06,043::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:06,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:06:06,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:06:06,761::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:07,044::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:07,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:06:07,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:06:07,762::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:06:08,665::task::579::TaskManager.Task::(_updateState) Task=`50485cd4-dab4-4a1d-bd82-e9d5471a339c`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:06:08,665::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:06:08,665::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:06:08,665::task::1168::TaskManager.Task::(prepare) Task=`50485cd4-dab4-4a1d-bd82-e9d5471a339c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:06:08,666::task::579::TaskManager.Task::(_updateState) Task=`50485cd4-dab4-4a1d-bd82-e9d5471a339c`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:06:08,666::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:06:08,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:06:08,666::task::974::TaskManager.Task::(_decref) Task=`50485cd4-dab4-4a1d-bd82-e9d5471a339c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:08,763::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:06:08,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:06:08,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:06:08,764::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:09,046::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:09,765::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286129::DEBUG::2014-01-16 16:06:10,055::task::579::TaskManager.Task::(_updateState) Task=`e6a0d354-a52b-494e-a836-89156e83443c`::moving from state init -> state preparing >Thread-286129::INFO::2014-01-16 16:06:10,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286129::INFO::2014-01-16 16:06:10,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000230705', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361807', 'lastCheck': '9.9', 'valid': True}} >Thread-286129::DEBUG::2014-01-16 16:06:10,056::task::1168::TaskManager.Task::(prepare) Task=`e6a0d354-a52b-494e-a836-89156e83443c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000230705', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361807', 'lastCheck': '9.9', 'valid': True}} >Thread-286129::DEBUG::2014-01-16 16:06:10,056::task::579::TaskManager.Task::(_updateState) Task=`e6a0d354-a52b-494e-a836-89156e83443c`::moving from state preparing -> state finished >Thread-286129::DEBUG::2014-01-16 16:06:10,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286129::DEBUG::2014-01-16 16:06:10,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286129::DEBUG::2014-01-16 16:06:10,057::task::974::TaskManager.Task::(_decref) Task=`e6a0d354-a52b-494e-a836-89156e83443c`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:06:10,208::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:06:10,225::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026913 s, 15.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:10,771::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:06:10,771::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:11,047::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:11,048::task::579::TaskManager.Task::(_updateState) Task=`99eb6651-6927-40ed-8096-bac268be81e8`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:06:11,048::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:06:11,049::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:06:11,049::task::1168::TaskManager.Task::(prepare) Task=`99eb6651-6927-40ed-8096-bac268be81e8`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:06:11,049::task::579::TaskManager.Task::(_updateState) Task=`99eb6651-6927-40ed-8096-bac268be81e8`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:06:11,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:06:11,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:06:11,049::task::974::TaskManager.Task::(_decref) Task=`99eb6651-6927-40ed-8096-bac268be81e8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:06:11,051::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:06:11,051::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:06:11,053::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:11,054::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:11,055::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:11,773::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:06:12,323::task::579::TaskManager.Task::(_updateState) Task=`c5d555e5-01bc-44d3-9d36-87bb847b4baa`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:06:12,324::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:06:12,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:06:12,324::task::1168::TaskManager.Task::(prepare) Task=`c5d555e5-01bc-44d3-9d36-87bb847b4baa`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:06:12,324::task::579::TaskManager.Task::(_updateState) Task=`c5d555e5-01bc-44d3-9d36-87bb847b4baa`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:06:12,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:06:12,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:06:12,325::task::974::TaskManager.Task::(_decref) Task=`c5d555e5-01bc-44d3-9d36-87bb847b4baa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:12,774::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:13,056::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:06:13,339::task::579::TaskManager.Task::(_updateState) Task=`effb3944-49e6-403a-9145-961007f8b5ef`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:06:13,339::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:06:13,339::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:06:13,340::task::1168::TaskManager.Task::(prepare) Task=`effb3944-49e6-403a-9145-961007f8b5ef`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:06:13,340::task::579::TaskManager.Task::(_updateState) Task=`effb3944-49e6-403a-9145-961007f8b5ef`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:06:13,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:06:13,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:06:13,340::task::974::TaskManager.Task::(_decref) Task=`effb3944-49e6-403a-9145-961007f8b5ef`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:06:13,341::task::579::TaskManager.Task::(_updateState) Task=`f0db54dc-426c-4b22-a1d6-275d1f83c63f`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:06:13,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:06:13,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:06:13,341::task::1168::TaskManager.Task::(prepare) Task=`f0db54dc-426c-4b22-a1d6-275d1f83c63f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:06:13,342::task::579::TaskManager.Task::(_updateState) Task=`f0db54dc-426c-4b22-a1d6-275d1f83c63f`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:06:13,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:06:13,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:06:13,342::task::974::TaskManager.Task::(_decref) Task=`f0db54dc-426c-4b22-a1d6-275d1f83c63f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:13,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:06:13,891::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:06:13,908::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000328498 s, 1.1 MB/s\n'; <rc> = 0 >Thread-131569::DEBUG::2014-01-16 16:06:13,939::task::579::TaskManager.Task::(_updateState) Task=`0cdb4314-57f1-4c64-b8e3-15d7684b45e1`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:06:13,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:06:13,940::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:06:13,940::task::1168::TaskManager.Task::(prepare) Task=`0cdb4314-57f1-4c64-b8e3-15d7684b45e1`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:06:13,940::task::579::TaskManager.Task::(_updateState) Task=`0cdb4314-57f1-4c64-b8e3-15d7684b45e1`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:06:13,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:06:13,941::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:06:13,941::task::974::TaskManager.Task::(_decref) Task=`0cdb4314-57f1-4c64-b8e3-15d7684b45e1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:14,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:15,058::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:15,778::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:16,059::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:16,779::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:06:16,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:17,060::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:17,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:18,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:19,061::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:19,783::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:06:20,230::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:06:20,247::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000219625 s, 18.6 MB/s\n'; <rc> = 0 >Thread-189046::DEBUG::2014-01-16 16:06:20,389::task::579::TaskManager.Task::(_updateState) Task=`2a37f0bd-1c47-4cae-bfd5-21e67e79dc71`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:06:20,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:06:20,390::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:06:20,391::task::1168::TaskManager.Task::(prepare) Task=`2a37f0bd-1c47-4cae-bfd5-21e67e79dc71`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:06:20,391::task::579::TaskManager.Task::(_updateState) Task=`2a37f0bd-1c47-4cae-bfd5-21e67e79dc71`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:06:20,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:06:20,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:06:20,391::task::974::TaskManager.Task::(_decref) Task=`2a37f0bd-1c47-4cae-bfd5-21e67e79dc71`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:20,785::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:21,063::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:21,064::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:21,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:06:21,787::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:06:21,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:06:22,746::task::579::TaskManager.Task::(_updateState) Task=`5b76a30d-f77c-4bb9-8009-7252391538d1`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:06:22,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:06:22,748::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:06:22,748::task::1168::TaskManager.Task::(prepare) Task=`5b76a30d-f77c-4bb9-8009-7252391538d1`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:06:22,749::task::579::TaskManager.Task::(_updateState) Task=`5b76a30d-f77c-4bb9-8009-7252391538d1`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:06:22,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:06:22,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:06:22,749::task::974::TaskManager.Task::(_decref) Task=`5b76a30d-f77c-4bb9-8009-7252391538d1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:22,788::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:06:22,788::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:23,065::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:23,789::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:06:23,790::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:06:23,790::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:06:23,915::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:06:23,932::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297855 s, 1.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:06:23,936::task::579::TaskManager.Task::(_updateState) Task=`f7aa989c-c09c-476f-8023-8cbf2f36fd63`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:06:23,936::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:06:23,936::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:06:23,937::task::1168::TaskManager.Task::(prepare) Task=`f7aa989c-c09c-476f-8023-8cbf2f36fd63`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:06:23,937::task::579::TaskManager.Task::(_updateState) Task=`f7aa989c-c09c-476f-8023-8cbf2f36fd63`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:06:23,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:06:23,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:06:23,937::task::974::TaskManager.Task::(_decref) Task=`f7aa989c-c09c-476f-8023-8cbf2f36fd63`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:06:24,021::task::579::TaskManager.Task::(_updateState) Task=`be88bf33-7ce7-4c3d-817c-9cab1c841836`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:06:24,021::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:06:24,021::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:06:24,022::task::1168::TaskManager.Task::(prepare) Task=`be88bf33-7ce7-4c3d-817c-9cab1c841836`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:06:24,022::task::579::TaskManager.Task::(_updateState) Task=`be88bf33-7ce7-4c3d-817c-9cab1c841836`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:06:24,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:06:24,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:06:24,022::task::974::TaskManager.Task::(_decref) Task=`be88bf33-7ce7-4c3d-817c-9cab1c841836`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:24,791::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:06:24,791::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:25,066::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286135::DEBUG::2014-01-16 16:06:25,771::task::579::TaskManager.Task::(_updateState) Task=`cf4aa422-9668-4f96-89a5-d901a60b1f92`::moving from state init -> state preparing >Thread-286135::INFO::2014-01-16 16:06:25,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286135::INFO::2014-01-16 16:06:25,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297855', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219625', 'lastCheck': '5.5', 'valid': True}} >Thread-286135::DEBUG::2014-01-16 16:06:25,772::task::1168::TaskManager.Task::(prepare) Task=`cf4aa422-9668-4f96-89a5-d901a60b1f92`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297855', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219625', 'lastCheck': '5.5', 'valid': True}} >Thread-286135::DEBUG::2014-01-16 16:06:25,772::task::579::TaskManager.Task::(_updateState) Task=`cf4aa422-9668-4f96-89a5-d901a60b1f92`::moving from state preparing -> state finished >Thread-286135::DEBUG::2014-01-16 16:06:25,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286135::DEBUG::2014-01-16 16:06:25,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286135::DEBUG::2014-01-16 16:06:25,772::task::974::TaskManager.Task::(_decref) Task=`cf4aa422-9668-4f96-89a5-d901a60b1f92`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:25,792::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:06:25,792::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:26,069::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:06:26,069::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:06:26,070::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:26,793::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:27,071::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:27,795::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:06:27,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:06:28,792::task::579::TaskManager.Task::(_updateState) Task=`86371010-e840-4b54-9acf-535439d99a79`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:06:28,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:06:28,793::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:06:28,793::task::1168::TaskManager.Task::(prepare) Task=`86371010-e840-4b54-9acf-535439d99a79`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:06:28,793::task::579::TaskManager.Task::(_updateState) Task=`86371010-e840-4b54-9acf-535439d99a79`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:06:28,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:06:28,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:06:28,794::task::974::TaskManager.Task::(_decref) Task=`86371010-e840-4b54-9acf-535439d99a79`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:28,797::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:06:28,797::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:29,073::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:29,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:06:29,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:06:29,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:06:29,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:06:30,252::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:06:30,269::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000275461 s, 14.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:30,799::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:06:30,800::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:06:30,800::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:31,074::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:31,075::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:06:31,714::task::579::TaskManager.Task::(_updateState) Task=`93254a42-a010-4fa8-9ecf-b9b35433aae5`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:06:31,715::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:06:31,715::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:06:31,715::task::1168::TaskManager.Task::(prepare) Task=`93254a42-a010-4fa8-9ecf-b9b35433aae5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:06:31,715::task::579::TaskManager.Task::(_updateState) Task=`93254a42-a010-4fa8-9ecf-b9b35433aae5`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:06:31,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:06:31,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:06:31,716::task::974::TaskManager.Task::(_decref) Task=`93254a42-a010-4fa8-9ecf-b9b35433aae5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:31,801::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:06:31,802::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:06:32,212::task::579::TaskManager.Task::(_updateState) Task=`a42fdf66-5856-4660-b976-d17d3fc469bf`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:06:32,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:06:32,212::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:06:32,212::task::1168::TaskManager.Task::(prepare) Task=`a42fdf66-5856-4660-b976-d17d3fc469bf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:06:32,213::task::579::TaskManager.Task::(_updateState) Task=`a42fdf66-5856-4660-b976-d17d3fc469bf`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:06:32,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:06:32,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:06:32,213::task::974::TaskManager.Task::(_decref) Task=`a42fdf66-5856-4660-b976-d17d3fc469bf`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:06:32,228::task::579::TaskManager.Task::(_updateState) Task=`713a229a-bb08-4db9-be50-ca7b9083ed6a`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:06:32,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:06:32,229::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:06:32,229::task::1168::TaskManager.Task::(prepare) Task=`713a229a-bb08-4db9-be50-ca7b9083ed6a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:06:32,229::task::579::TaskManager.Task::(_updateState) Task=`713a229a-bb08-4db9-be50-ca7b9083ed6a`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:06:32,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:06:32,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:06:32,230::task::974::TaskManager.Task::(_decref) Task=`713a229a-bb08-4db9-be50-ca7b9083ed6a`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:06:32,398::task::579::TaskManager.Task::(_updateState) Task=`3ffb3ac0-cdfe-42d6-b53c-bf1fe079fd9f`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:06:32,399::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:06:32,399::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:06:32,399::task::1168::TaskManager.Task::(prepare) Task=`3ffb3ac0-cdfe-42d6-b53c-bf1fe079fd9f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:06:32,399::task::579::TaskManager.Task::(_updateState) Task=`3ffb3ac0-cdfe-42d6-b53c-bf1fe079fd9f`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:06:32,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:06:32,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:06:32,400::task::974::TaskManager.Task::(_decref) Task=`3ffb3ac0-cdfe-42d6-b53c-bf1fe079fd9f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:32,803::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:06:32,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:06:32,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:06:32,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:06:33,076::task::579::TaskManager.Task::(_updateState) Task=`b378fe3b-1512-45a2-8d46-bd3350427a2c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:06:33,076::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:06:33,077::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:06:33,077::task::1168::TaskManager.Task::(prepare) Task=`b378fe3b-1512-45a2-8d46-bd3350427a2c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-189817::DEBUG::2014-01-16 16:06:33,077::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:06:33,077::task::579::TaskManager.Task::(_updateState) Task=`b378fe3b-1512-45a2-8d46-bd3350427a2c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:06:33,078::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:06:33,078::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:06:33,078::task::974::TaskManager.Task::(_decref) Task=`b378fe3b-1512-45a2-8d46-bd3350427a2c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:06:33,078::task::579::TaskManager.Task::(_updateState) Task=`7bf8b9ec-f505-46a8-aeaa-92db4a95d3c3`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:06:33,079::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:06:33,079::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:06:33,079::task::1168::TaskManager.Task::(prepare) Task=`7bf8b9ec-f505-46a8-aeaa-92db4a95d3c3`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:06:33,079::task::579::TaskManager.Task::(_updateState) Task=`7bf8b9ec-f505-46a8-aeaa-92db4a95d3c3`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:06:33,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:06:33,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:06:33,080::task::974::TaskManager.Task::(_decref) Task=`7bf8b9ec-f505-46a8-aeaa-92db4a95d3c3`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:06:33,080::task::579::TaskManager.Task::(_updateState) Task=`2956e36b-a723-44e9-8419-3bd82ca13c07`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:06:33,080::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:06:33,080::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:06:33,080::task::1168::TaskManager.Task::(prepare) Task=`2956e36b-a723-44e9-8419-3bd82ca13c07`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:06:33,081::task::579::TaskManager.Task::(_updateState) Task=`2956e36b-a723-44e9-8419-3bd82ca13c07`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:06:33,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:06:33,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:06:33,081::task::974::TaskManager.Task::(_decref) Task=`2956e36b-a723-44e9-8419-3bd82ca13c07`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:06:33,382::task::579::TaskManager.Task::(_updateState) Task=`d059adae-3015-4173-aad4-434d82872e65`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:06:33,383::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:06:33,383::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:06:33,383::task::1168::TaskManager.Task::(prepare) Task=`d059adae-3015-4173-aad4-434d82872e65`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:06:33,383::task::579::TaskManager.Task::(_updateState) Task=`d059adae-3015-4173-aad4-434d82872e65`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:06:33,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:06:33,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:06:33,384::task::974::TaskManager.Task::(_decref) Task=`d059adae-3015-4173-aad4-434d82872e65`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:06:33,709::task::579::TaskManager.Task::(_updateState) Task=`1881b421-499b-4342-8207-700865d3868d`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:06:33,709::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:06:33,709::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:06:33,709::task::1168::TaskManager.Task::(prepare) Task=`1881b421-499b-4342-8207-700865d3868d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:06:33,710::task::579::TaskManager.Task::(_updateState) Task=`1881b421-499b-4342-8207-700865d3868d`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:06:33,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:06:33,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:06:33,710::task::974::TaskManager.Task::(_decref) Task=`1881b421-499b-4342-8207-700865d3868d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:33,805::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:06:33,940::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:06:33,958::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276058 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:34,807::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:06:34,807::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:06:34,808::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:06:34,808::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:34,808::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:06:34,809::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:06:35,079::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:35,810::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:36,081::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:36,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:06:36,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:06:36,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:37,083::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:37,813::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:06:37,813::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:06:37,813::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:38,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:06:38,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:06:38,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:06:38,815::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:39,085::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:39,817::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:06:40,274::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:06:40,290::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258917 s, 15.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:40,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:06:40,818::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:41,087::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:41,089::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:06:41,089::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:06:41,090::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:06:41,370::task::579::TaskManager.Task::(_updateState) Task=`f75d649c-ffb6-4e39-98de-862683e117bf`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:06:41,370::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:06:41,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:06:41,370::task::1168::TaskManager.Task::(prepare) Task=`f75d649c-ffb6-4e39-98de-862683e117bf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:06:41,371::task::579::TaskManager.Task::(_updateState) Task=`f75d649c-ffb6-4e39-98de-862683e117bf`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:06:41,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:06:41,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:06:41,371::task::974::TaskManager.Task::(_decref) Task=`f75d649c-ffb6-4e39-98de-862683e117bf`::ref 0 aborting False >Thread-286141::DEBUG::2014-01-16 16:06:41,639::task::579::TaskManager.Task::(_updateState) Task=`5166f617-ba5e-4deb-8e2c-e7ce44b13e3e`::moving from state init -> state preparing >Thread-286141::INFO::2014-01-16 16:06:41,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286141::INFO::2014-01-16 16:06:41,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276058', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258917', 'lastCheck': '1.3', 'valid': True}} >Thread-286141::DEBUG::2014-01-16 16:06:41,639::task::1168::TaskManager.Task::(prepare) Task=`5166f617-ba5e-4deb-8e2c-e7ce44b13e3e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276058', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258917', 'lastCheck': '1.3', 'valid': True}} >Thread-286141::DEBUG::2014-01-16 16:06:41,640::task::579::TaskManager.Task::(_updateState) Task=`5166f617-ba5e-4deb-8e2c-e7ce44b13e3e`::moving from state preparing -> state finished >Thread-286141::DEBUG::2014-01-16 16:06:41,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286141::DEBUG::2014-01-16 16:06:41,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286141::DEBUG::2014-01-16 16:06:41,640::task::974::TaskManager.Task::(_decref) Task=`5166f617-ba5e-4deb-8e2c-e7ce44b13e3e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:41,818::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:42,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:43,092::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:43,820::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:06:43,967::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:06:43,985::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000246791 s, 1.5 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 16:06:44,215::task::579::TaskManager.Task::(_updateState) Task=`7636f014-e18c-4bd5-be6c-f7e264f57791`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:06:44,215::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:06:44,215::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:06:44,216::task::1168::TaskManager.Task::(prepare) Task=`7636f014-e18c-4bd5-be6c-f7e264f57791`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:06:44,216::task::579::TaskManager.Task::(_updateState) Task=`7636f014-e18c-4bd5-be6c-f7e264f57791`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:06:44,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:06:44,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:06:44,216::task::974::TaskManager.Task::(_decref) Task=`7636f014-e18c-4bd5-be6c-f7e264f57791`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:06:44,217::task::579::TaskManager.Task::(_updateState) Task=`05370f48-bd04-43e1-a8a6-a4d38a668d38`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:06:44,217::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:06:44,217::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:06:44,217::task::1168::TaskManager.Task::(prepare) Task=`05370f48-bd04-43e1-a8a6-a4d38a668d38`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:06:44,217::task::579::TaskManager.Task::(_updateState) Task=`05370f48-bd04-43e1-a8a6-a4d38a668d38`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:06:44,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:06:44,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:06:44,218::task::974::TaskManager.Task::(_decref) Task=`05370f48-bd04-43e1-a8a6-a4d38a668d38`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:06:44,218::task::579::TaskManager.Task::(_updateState) Task=`df73bc5b-334f-436c-a64f-2cd0dcac8776`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:06:44,218::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:06:44,219::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:06:44,219::task::1168::TaskManager.Task::(prepare) Task=`df73bc5b-334f-436c-a64f-2cd0dcac8776`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:06:44,219::task::579::TaskManager.Task::(_updateState) Task=`df73bc5b-334f-436c-a64f-2cd0dcac8776`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:06:44,219::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:06:44,219::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:06:44,219::task::974::TaskManager.Task::(_decref) Task=`df73bc5b-334f-436c-a64f-2cd0dcac8776`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:44,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:45,093::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:06:45,330::task::579::TaskManager.Task::(_updateState) Task=`d26c3998-4b57-451e-bf2a-d20e715ef54e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:06:45,330::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:06:45,330::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:06:45,330::task::1168::TaskManager.Task::(prepare) Task=`d26c3998-4b57-451e-bf2a-d20e715ef54e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:06:45,331::task::579::TaskManager.Task::(_updateState) Task=`d26c3998-4b57-451e-bf2a-d20e715ef54e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:06:45,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:06:45,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:06:45,331::task::974::TaskManager.Task::(_decref) Task=`d26c3998-4b57-451e-bf2a-d20e715ef54e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:45,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:46,095::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:46,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:06:46,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:47,097::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:47,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:48,825::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:49,098::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:49,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:06:50,296::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:06:50,312::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000228018 s, 18.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:50,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:51,100::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:06:51,101::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:51,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:06:51,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:06:51,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:06:52,270::task::579::TaskManager.Task::(_updateState) Task=`cfa012f6-0cd5-4152-9523-b24a487afaef`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:06:52,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:06:52,270::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:06:52,270::task::1168::TaskManager.Task::(prepare) Task=`cfa012f6-0cd5-4152-9523-b24a487afaef`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:06:52,271::task::579::TaskManager.Task::(_updateState) Task=`cfa012f6-0cd5-4152-9523-b24a487afaef`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:06:52,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:06:52,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:06:52,271::task::974::TaskManager.Task::(_decref) Task=`cfa012f6-0cd5-4152-9523-b24a487afaef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:52,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:06:52,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:53,102::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:53,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:06:53,833::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:06:53,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:06:53,993::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:06:54,010::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251906 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:06:54,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:06:54,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:55,104::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:06:55,829::task::579::TaskManager.Task::(_updateState) Task=`b3900130-014c-46ac-8d65-64f66f44e006`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:06:55,829::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:06:55,829::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:06:55,830::task::1168::TaskManager.Task::(prepare) Task=`b3900130-014c-46ac-8d65-64f66f44e006`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:06:55,830::task::579::TaskManager.Task::(_updateState) Task=`b3900130-014c-46ac-8d65-64f66f44e006`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:06:55,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:06:55,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:06:55,830::task::974::TaskManager.Task::(_decref) Task=`b3900130-014c-46ac-8d65-64f66f44e006`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:06:55,830::task::579::TaskManager.Task::(_updateState) Task=`ed9467ac-b6f1-4bac-bb49-2630b7eb59b3`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:06:55,831::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:06:55,831::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:06:55,831::task::1168::TaskManager.Task::(prepare) Task=`ed9467ac-b6f1-4bac-bb49-2630b7eb59b3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:06:55,831::task::579::TaskManager.Task::(_updateState) Task=`ed9467ac-b6f1-4bac-bb49-2630b7eb59b3`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:06:55,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:06:55,832::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:06:55,832::task::974::TaskManager.Task::(_decref) Task=`ed9467ac-b6f1-4bac-bb49-2630b7eb59b3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:55,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:06:55,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:56,106::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:06:56,106::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:06:56,107::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:06:56,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:57,109::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286147::DEBUG::2014-01-16 16:06:57,403::task::579::TaskManager.Task::(_updateState) Task=`04ee769d-c701-4ecf-a272-4da2ef6cb061`::moving from state init -> state preparing >Thread-286147::INFO::2014-01-16 16:06:57,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286147::INFO::2014-01-16 16:06:57,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251906', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228018', 'lastCheck': '7.1', 'valid': True}} >Thread-286147::DEBUG::2014-01-16 16:06:57,403::task::1168::TaskManager.Task::(prepare) Task=`04ee769d-c701-4ecf-a272-4da2ef6cb061`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251906', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228018', 'lastCheck': '7.1', 'valid': True}} >Thread-286147::DEBUG::2014-01-16 16:06:57,404::task::579::TaskManager.Task::(_updateState) Task=`04ee769d-c701-4ecf-a272-4da2ef6cb061`::moving from state preparing -> state finished >Thread-286147::DEBUG::2014-01-16 16:06:57,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286147::DEBUG::2014-01-16 16:06:57,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286147::DEBUG::2014-01-16 16:06:57,404::task::974::TaskManager.Task::(_decref) Task=`04ee769d-c701-4ecf-a272-4da2ef6cb061`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:57,838::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:06:57,838::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:06:58,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:06:58,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:06:59,110::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:06:59,536::task::579::TaskManager.Task::(_updateState) Task=`d2ffaf24-5444-4954-a83f-648be34ed44c`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:06:59,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:06:59,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:06:59,536::task::1168::TaskManager.Task::(prepare) Task=`d2ffaf24-5444-4954-a83f-648be34ed44c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:06:59,537::task::579::TaskManager.Task::(_updateState) Task=`d2ffaf24-5444-4954-a83f-648be34ed44c`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:06:59,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:06:59,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:06:59,537::task::974::TaskManager.Task::(_decref) Task=`d2ffaf24-5444-4954-a83f-648be34ed44c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:06:59,840::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:06:59,840::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:06:59,841::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:06:59,841::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:07:00,319::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:07:00,336::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000182495 s, 22.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:00,842::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:07:00,842::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:07:00,842::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:01,112::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:01,113::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:01,844::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:07:01,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:07:02,145::task::579::TaskManager.Task::(_updateState) Task=`ff284e11-55f5-4d9e-aff4-a0430963cbf5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:07:02,145::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:07:02,145::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:07:02,146::task::1168::TaskManager.Task::(prepare) Task=`ff284e11-55f5-4d9e-aff4-a0430963cbf5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:07:02,146::task::579::TaskManager.Task::(_updateState) Task=`ff284e11-55f5-4d9e-aff4-a0430963cbf5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:07:02,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:07:02,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:07:02,146::task::974::TaskManager.Task::(_decref) Task=`ff284e11-55f5-4d9e-aff4-a0430963cbf5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:07:02,147::task::579::TaskManager.Task::(_updateState) Task=`af88787d-07eb-4ef2-b7cf-dd5afb18b325`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:07:02,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:07:02,147::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:07:02,147::task::1168::TaskManager.Task::(prepare) Task=`af88787d-07eb-4ef2-b7cf-dd5afb18b325`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:07:02,147::task::579::TaskManager.Task::(_updateState) Task=`af88787d-07eb-4ef2-b7cf-dd5afb18b325`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:07:02,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:07:02,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:07:02,148::task::974::TaskManager.Task::(_decref) Task=`af88787d-07eb-4ef2-b7cf-dd5afb18b325`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:07:02,823::task::579::TaskManager.Task::(_updateState) Task=`1f784202-8fa7-4178-b98d-d86d144f9e9c`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:07:02,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:07:02,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:07:02,824::task::1168::TaskManager.Task::(prepare) Task=`1f784202-8fa7-4178-b98d-d86d144f9e9c`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:07:02,824::task::579::TaskManager.Task::(_updateState) Task=`1f784202-8fa7-4178-b98d-d86d144f9e9c`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:07:02,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:07:02,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:07:02,825::task::974::TaskManager.Task::(_decref) Task=`1f784202-8fa7-4178-b98d-d86d144f9e9c`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:07:02,829::task::579::TaskManager.Task::(_updateState) Task=`dbf9ef8d-d2f4-4c02-81a1-f893c2d03a34`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:07:02,829::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:07:02,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:07:02,830::task::1168::TaskManager.Task::(prepare) Task=`dbf9ef8d-d2f4-4c02-81a1-f893c2d03a34`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:07:02,830::task::579::TaskManager.Task::(_updateState) Task=`dbf9ef8d-d2f4-4c02-81a1-f893c2d03a34`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:07:02,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:07:02,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:07:02,830::task::974::TaskManager.Task::(_decref) Task=`dbf9ef8d-d2f4-4c02-81a1-f893c2d03a34`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:02,845::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:07:02,845::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:07:02,845::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:07:02,845::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:03,114::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:07:03,809::task::579::TaskManager.Task::(_updateState) Task=`79846d64-1565-4625-8baf-d5e26b77d3f7`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:07:03,810::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:07:03,810::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:07:03,810::task::1168::TaskManager.Task::(prepare) Task=`79846d64-1565-4625-8baf-d5e26b77d3f7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:07:03,811::task::579::TaskManager.Task::(_updateState) Task=`79846d64-1565-4625-8baf-d5e26b77d3f7`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:07:03,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:07:03,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:07:03,811::task::974::TaskManager.Task::(_decref) Task=`79846d64-1565-4625-8baf-d5e26b77d3f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:03,846::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:07:03,888::task::579::TaskManager.Task::(_updateState) Task=`ac3a8d70-5397-4bc5-b4eb-fd9614383524`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:07:03,888::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:07:03,889::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:07:03,889::task::1168::TaskManager.Task::(prepare) Task=`ac3a8d70-5397-4bc5-b4eb-fd9614383524`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:07:03,889::task::579::TaskManager.Task::(_updateState) Task=`ac3a8d70-5397-4bc5-b4eb-fd9614383524`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:07:03,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:07:03,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:07:03,889::task::974::TaskManager.Task::(_decref) Task=`ac3a8d70-5397-4bc5-b4eb-fd9614383524`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:07:03,890::task::579::TaskManager.Task::(_updateState) Task=`4636f8cb-02e2-47a7-abec-802bc48da31b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:07:03,890::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:07:03,890::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:07:03,890::task::1168::TaskManager.Task::(prepare) Task=`4636f8cb-02e2-47a7-abec-802bc48da31b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:07:03,890::task::579::TaskManager.Task::(_updateState) Task=`4636f8cb-02e2-47a7-abec-802bc48da31b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:07:03,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:07:03,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:07:03,891::task::974::TaskManager.Task::(_decref) Task=`4636f8cb-02e2-47a7-abec-802bc48da31b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:07:04,019::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:07:04,038::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274635 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:07:04,041::task::579::TaskManager.Task::(_updateState) Task=`abf09d73-0ea0-4b70-b3ec-af5c12d5f132`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:07:04,042::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:07:04,043::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:07:04,043::task::1168::TaskManager.Task::(prepare) Task=`abf09d73-0ea0-4b70-b3ec-af5c12d5f132`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:07:04,044::task::579::TaskManager.Task::(_updateState) Task=`abf09d73-0ea0-4b70-b3ec-af5c12d5f132`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:07:04,044::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:07:04,044::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:07:04,044::task::974::TaskManager.Task::(_decref) Task=`abf09d73-0ea0-4b70-b3ec-af5c12d5f132`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:04,847::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:07:04,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:07:04,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:07:04,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:04,848::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:07:04,849::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-184546::DEBUG::2014-01-16 16:07:04,881::task::579::TaskManager.Task::(_updateState) Task=`91ad651d-0450-43be-aad3-1159e0a4b483`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:07:04,881::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:07:04,882::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:07:04,882::task::1168::TaskManager.Task::(prepare) Task=`91ad651d-0450-43be-aad3-1159e0a4b483`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:07:04,882::task::579::TaskManager.Task::(_updateState) Task=`91ad651d-0450-43be-aad3-1159e0a4b483`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:07:04,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:07:04,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:07:04,882::task::974::TaskManager.Task::(_decref) Task=`91ad651d-0450-43be-aad3-1159e0a4b483`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:07:05,116::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:07:05,773::task::579::TaskManager.Task::(_updateState) Task=`a74eb637-8470-4469-a2af-671e8ee08f5a`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:07:05,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:07:05,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:07:05,773::task::1168::TaskManager.Task::(prepare) Task=`a74eb637-8470-4469-a2af-671e8ee08f5a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:07:05,774::task::579::TaskManager.Task::(_updateState) Task=`a74eb637-8470-4469-a2af-671e8ee08f5a`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:07:05,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:07:05,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:07:05,774::task::974::TaskManager.Task::(_decref) Task=`a74eb637-8470-4469-a2af-671e8ee08f5a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:05,850::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:06,118::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:06,852::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:07:06,852::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:07:06,852::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:07,119::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:07,854::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:07:07,854::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:07:07,854::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:07:08,832::task::579::TaskManager.Task::(_updateState) Task=`bf045232-6ec1-4d4f-bdca-2a7e5d7a8a99`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:07:08,832::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:07:08,832::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:07:08,833::task::1168::TaskManager.Task::(prepare) Task=`bf045232-6ec1-4d4f-bdca-2a7e5d7a8a99`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:07:08,833::task::579::TaskManager.Task::(_updateState) Task=`bf045232-6ec1-4d4f-bdca-2a7e5d7a8a99`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:07:08,833::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:07:08,833::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:07:08,833::task::974::TaskManager.Task::(_decref) Task=`bf045232-6ec1-4d4f-bdca-2a7e5d7a8a99`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:08,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:07:08,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:07:08,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:07:08,855::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:09,120::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:09,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:07:10,342::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:07:10,359::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00021363 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:10,858::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:07:10,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:11,122::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:11,122::task::579::TaskManager.Task::(_updateState) Task=`c96bbf58-8352-4c14-bab5-48fc54ea9031`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:07:11,122::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:07:11,123::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:07:11,123::task::1168::TaskManager.Task::(prepare) Task=`c96bbf58-8352-4c14-bab5-48fc54ea9031`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:07:11,123::task::579::TaskManager.Task::(_updateState) Task=`c96bbf58-8352-4c14-bab5-48fc54ea9031`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:07:11,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:07:11,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:07:11,124::task::974::TaskManager.Task::(_decref) Task=`c96bbf58-8352-4c14-bab5-48fc54ea9031`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:07:11,126::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:07:11,126::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:07:11,127::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:11,129::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:11,130::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:11,859::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:07:12,480::task::579::TaskManager.Task::(_updateState) Task=`9bfc90c4-3fe3-4e29-8815-d6885dfae9cc`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:07:12,481::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:07:12,481::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:07:12,481::task::1168::TaskManager.Task::(prepare) Task=`9bfc90c4-3fe3-4e29-8815-d6885dfae9cc`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:07:12,481::task::579::TaskManager.Task::(_updateState) Task=`9bfc90c4-3fe3-4e29-8815-d6885dfae9cc`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:07:12,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:07:12,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:07:12,482::task::974::TaskManager.Task::(_decref) Task=`9bfc90c4-3fe3-4e29-8815-d6885dfae9cc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:12,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:13,131::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286153::DEBUG::2014-01-16 16:07:13,206::task::579::TaskManager.Task::(_updateState) Task=`a2765f44-4988-4612-b005-4d2e25e835b4`::moving from state init -> state preparing >Thread-286153::INFO::2014-01-16 16:07:13,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286153::INFO::2014-01-16 16:07:13,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274635', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021363', 'lastCheck': '2.8', 'valid': True}} >Thread-286153::DEBUG::2014-01-16 16:07:13,207::task::1168::TaskManager.Task::(prepare) Task=`a2765f44-4988-4612-b005-4d2e25e835b4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274635', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021363', 'lastCheck': '2.8', 'valid': True}} >Thread-286153::DEBUG::2014-01-16 16:07:13,207::task::579::TaskManager.Task::(_updateState) Task=`a2765f44-4988-4612-b005-4d2e25e835b4`::moving from state preparing -> state finished >Thread-286153::DEBUG::2014-01-16 16:07:13,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286153::DEBUG::2014-01-16 16:07:13,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286153::DEBUG::2014-01-16 16:07:13,208::task::974::TaskManager.Task::(_decref) Task=`a2765f44-4988-4612-b005-4d2e25e835b4`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:07:13,693::task::579::TaskManager.Task::(_updateState) Task=`c9d317e0-de3d-46c7-a6be-f74dd58c92d2`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:07:13,693::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:07:13,694::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:07:13,694::task::1168::TaskManager.Task::(prepare) Task=`c9d317e0-de3d-46c7-a6be-f74dd58c92d2`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:07:13,694::task::579::TaskManager.Task::(_updateState) Task=`c9d317e0-de3d-46c7-a6be-f74dd58c92d2`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:07:13,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:07:13,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:07:13,694::task::974::TaskManager.Task::(_decref) Task=`c9d317e0-de3d-46c7-a6be-f74dd58c92d2`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:07:13,695::task::579::TaskManager.Task::(_updateState) Task=`e835bea8-9604-4438-9e60-655e471de05a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:07:13,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:07:13,695::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:07:13,695::task::1168::TaskManager.Task::(prepare) Task=`e835bea8-9604-4438-9e60-655e471de05a`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:07:13,695::task::579::TaskManager.Task::(_updateState) Task=`e835bea8-9604-4438-9e60-655e471de05a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:07:13,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:07:13,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:07:13,696::task::974::TaskManager.Task::(_decref) Task=`e835bea8-9604-4438-9e60-655e471de05a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:13,861::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:07:14,044::task::579::TaskManager.Task::(_updateState) Task=`59619226-2a26-4442-a80c-d001d190b1ac`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:07:14,045::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:07:14,046::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:07:14,047::task::1168::TaskManager.Task::(prepare) Task=`59619226-2a26-4442-a80c-d001d190b1ac`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:07:14,047::task::579::TaskManager.Task::(_updateState) Task=`59619226-2a26-4442-a80c-d001d190b1ac`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:07:14,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:07:14,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:07:14,048::task::974::TaskManager.Task::(_decref) Task=`59619226-2a26-4442-a80c-d001d190b1ac`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:07:14,052::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:07:14,068::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000249786 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:14,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:15,132::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:15,863::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:16,133::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:16,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:07:16,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:17,134::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:17,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:18,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:19,136::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:19,867::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:07:20,367::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:07:20,388::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213598 s, 19.2 MB/s\n'; <rc> = 0 >Thread-189046::DEBUG::2014-01-16 16:07:20,548::task::579::TaskManager.Task::(_updateState) Task=`824faddc-c776-48c8-a71b-1c51914432b0`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:07:20,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:07:20,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:07:20,549::task::1168::TaskManager.Task::(prepare) Task=`824faddc-c776-48c8-a71b-1c51914432b0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:07:20,550::task::579::TaskManager.Task::(_updateState) Task=`824faddc-c776-48c8-a71b-1c51914432b0`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:07:20,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:07:20,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:07:20,550::task::974::TaskManager.Task::(_decref) Task=`824faddc-c776-48c8-a71b-1c51914432b0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:20,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:21,137::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:21,138::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:21,869::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:07:21,869::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:07:21,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:07:22,812::task::579::TaskManager.Task::(_updateState) Task=`e03b7e85-6939-4aa2-b9a4-b58a7b208edb`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:07:22,813::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:07:22,813::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:07:22,813::task::1168::TaskManager.Task::(prepare) Task=`e03b7e85-6939-4aa2-b9a4-b58a7b208edb`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:07:22,813::task::579::TaskManager.Task::(_updateState) Task=`e03b7e85-6939-4aa2-b9a4-b58a7b208edb`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:07:22,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:07:22,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:07:22,814::task::974::TaskManager.Task::(_decref) Task=`e03b7e85-6939-4aa2-b9a4-b58a7b208edb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:22,871::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:07:22,871::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:23,139::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:23,871::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:07:23,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:07:23,872::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:07:24,079::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:07:24,098::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000302 s, 1.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:07:24,113::task::579::TaskManager.Task::(_updateState) Task=`cad448d3-e251-4d38-82f4-5388197f5bb0`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:07:24,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:07:24,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:07:24,114::task::1168::TaskManager.Task::(prepare) Task=`cad448d3-e251-4d38-82f4-5388197f5bb0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:07:24,114::task::579::TaskManager.Task::(_updateState) Task=`cad448d3-e251-4d38-82f4-5388197f5bb0`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:07:24,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:07:24,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:07:24,115::task::974::TaskManager.Task::(_decref) Task=`cad448d3-e251-4d38-82f4-5388197f5bb0`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:07:24,194::task::579::TaskManager.Task::(_updateState) Task=`cff77336-7699-494c-819b-4c9b927cd048`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:07:24,195::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:07:24,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:07:24,195::task::1168::TaskManager.Task::(prepare) Task=`cff77336-7699-494c-819b-4c9b927cd048`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:07:24,195::task::579::TaskManager.Task::(_updateState) Task=`cff77336-7699-494c-819b-4c9b927cd048`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:07:24,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:07:24,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:07:24,196::task::974::TaskManager.Task::(_decref) Task=`cff77336-7699-494c-819b-4c9b927cd048`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:24,873::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:07:24,873::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:25,140::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:25,874::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:07:25,875::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:26,143::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:07:26,143::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:07:26,146::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:26,875::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:27,147::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:27,877::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:07:27,877::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:28,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:07:28,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:07:28,977::task::579::TaskManager.Task::(_updateState) Task=`7e7073d7-2bce-44ca-89b6-7123dee439b4`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:07:28,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:07:28,978::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:07:28,978::task::1168::TaskManager.Task::(prepare) Task=`7e7073d7-2bce-44ca-89b6-7123dee439b4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:07:28,978::task::579::TaskManager.Task::(_updateState) Task=`7e7073d7-2bce-44ca-89b6-7123dee439b4`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:07:28,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:07:28,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:07:28,979::task::974::TaskManager.Task::(_decref) Task=`7e7073d7-2bce-44ca-89b6-7123dee439b4`::ref 0 aborting False >Thread-286159::DEBUG::2014-01-16 16:07:29,046::task::579::TaskManager.Task::(_updateState) Task=`cb1f60b9-8b1e-410e-ac59-5b9b51f4dc10`::moving from state init -> state preparing >Thread-286159::INFO::2014-01-16 16:07:29,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286159::INFO::2014-01-16 16:07:29,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000302', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213598', 'lastCheck': '8.6', 'valid': True}} >Thread-286159::DEBUG::2014-01-16 16:07:29,047::task::1168::TaskManager.Task::(prepare) Task=`cb1f60b9-8b1e-410e-ac59-5b9b51f4dc10`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000302', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213598', 'lastCheck': '8.6', 'valid': True}} >Thread-286159::DEBUG::2014-01-16 16:07:29,047::task::579::TaskManager.Task::(_updateState) Task=`cb1f60b9-8b1e-410e-ac59-5b9b51f4dc10`::moving from state preparing -> state finished >Thread-286159::DEBUG::2014-01-16 16:07:29,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286159::DEBUG::2014-01-16 16:07:29,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286159::DEBUG::2014-01-16 16:07:29,047::task::974::TaskManager.Task::(_decref) Task=`cb1f60b9-8b1e-410e-ac59-5b9b51f4dc10`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:07:29,148::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:29,880::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:07:29,880::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:07:29,880::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:07:29,880::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:07:30,402::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:07:30,426::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000309423 s, 13.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:30,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:07:30,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:07:30,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:31,149::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:31,150::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:07:31,878::task::579::TaskManager.Task::(_updateState) Task=`05a683ea-4eff-4bb7-982e-9755b5fe9e8c`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:07:31,879::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:07:31,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:07:31,879::task::1168::TaskManager.Task::(prepare) Task=`05a683ea-4eff-4bb7-982e-9755b5fe9e8c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:07:31,879::task::579::TaskManager.Task::(_updateState) Task=`05a683ea-4eff-4bb7-982e-9755b5fe9e8c`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:07:31,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:07:31,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:07:31,880::task::974::TaskManager.Task::(_decref) Task=`05a683ea-4eff-4bb7-982e-9755b5fe9e8c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:31,883::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:07:31,884::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:07:32,396::task::579::TaskManager.Task::(_updateState) Task=`d0a92391-a9d1-4a4a-8b08-3f942b08dbcd`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:07:32,397::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:07:32,397::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:07:32,397::task::1168::TaskManager.Task::(prepare) Task=`d0a92391-a9d1-4a4a-8b08-3f942b08dbcd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:07:32,397::task::579::TaskManager.Task::(_updateState) Task=`d0a92391-a9d1-4a4a-8b08-3f942b08dbcd`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:07:32,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:07:32,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:07:32,398::task::974::TaskManager.Task::(_decref) Task=`d0a92391-a9d1-4a4a-8b08-3f942b08dbcd`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:07:32,433::task::579::TaskManager.Task::(_updateState) Task=`a88182ee-31ca-4e58-ab11-ad30f660bdde`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:07:32,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:07:32,434::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:07:32,434::task::1168::TaskManager.Task::(prepare) Task=`a88182ee-31ca-4e58-ab11-ad30f660bdde`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:07:32,434::task::579::TaskManager.Task::(_updateState) Task=`a88182ee-31ca-4e58-ab11-ad30f660bdde`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:07:32,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:07:32,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:07:32,435::task::974::TaskManager.Task::(_decref) Task=`a88182ee-31ca-4e58-ab11-ad30f660bdde`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:07:32,567::task::579::TaskManager.Task::(_updateState) Task=`8c0fa9e6-3e7f-4ea2-8033-2b25a58ac21b`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:07:32,567::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:07:32,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:07:32,568::task::1168::TaskManager.Task::(prepare) Task=`8c0fa9e6-3e7f-4ea2-8033-2b25a58ac21b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:07:32,568::task::579::TaskManager.Task::(_updateState) Task=`8c0fa9e6-3e7f-4ea2-8033-2b25a58ac21b`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:07:32,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:07:32,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:07:32,568::task::974::TaskManager.Task::(_decref) Task=`8c0fa9e6-3e7f-4ea2-8033-2b25a58ac21b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:32,885::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:07:32,885::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:07:32,886::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:07:32,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:33,151::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:07:33,362::task::579::TaskManager.Task::(_updateState) Task=`76623bf9-345d-48ab-b8b1-8be7c36cf961`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:07:33,362::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:07:33,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:07:33,363::task::1168::TaskManager.Task::(prepare) Task=`76623bf9-345d-48ab-b8b1-8be7c36cf961`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:07:33,363::task::579::TaskManager.Task::(_updateState) Task=`76623bf9-345d-48ab-b8b1-8be7c36cf961`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:07:33,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:07:33,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:07:33,363::task::974::TaskManager.Task::(_decref) Task=`76623bf9-345d-48ab-b8b1-8be7c36cf961`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:07:33,364::task::579::TaskManager.Task::(_updateState) Task=`9207a843-3a5f-4b28-afce-35795ff7eeec`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:07:33,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:07:33,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:07:33,364::task::1168::TaskManager.Task::(prepare) Task=`9207a843-3a5f-4b28-afce-35795ff7eeec`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:07:33,364::task::579::TaskManager.Task::(_updateState) Task=`9207a843-3a5f-4b28-afce-35795ff7eeec`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:07:33,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:07:33,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:07:33,365::task::974::TaskManager.Task::(_decref) Task=`9207a843-3a5f-4b28-afce-35795ff7eeec`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:07:33,365::task::579::TaskManager.Task::(_updateState) Task=`6e4e7aea-4073-4401-8988-82bb5120b080`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:07:33,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:07:33,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:07:33,365::task::1168::TaskManager.Task::(prepare) Task=`6e4e7aea-4073-4401-8988-82bb5120b080`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:07:33,366::task::579::TaskManager.Task::(_updateState) Task=`6e4e7aea-4073-4401-8988-82bb5120b080`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:07:33,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:07:33,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:07:33,366::task::974::TaskManager.Task::(_decref) Task=`6e4e7aea-4073-4401-8988-82bb5120b080`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:07:33,546::task::579::TaskManager.Task::(_updateState) Task=`b478adbd-e7bd-41b2-8507-4d7e2df03ff4`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:07:33,546::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:07:33,547::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:07:33,547::task::1168::TaskManager.Task::(prepare) Task=`b478adbd-e7bd-41b2-8507-4d7e2df03ff4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:07:33,547::task::579::TaskManager.Task::(_updateState) Task=`b478adbd-e7bd-41b2-8507-4d7e2df03ff4`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:07:33,547::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:07:33,547::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:07:33,547::task::974::TaskManager.Task::(_decref) Task=`b478adbd-e7bd-41b2-8507-4d7e2df03ff4`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:07:33,875::task::579::TaskManager.Task::(_updateState) Task=`03af5b71-2bc3-4e13-b826-c5b026530cca`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:07:33,875::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:07:33,875::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:07:33,875::task::1168::TaskManager.Task::(prepare) Task=`03af5b71-2bc3-4e13-b826-c5b026530cca`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:07:33,876::task::579::TaskManager.Task::(_updateState) Task=`03af5b71-2bc3-4e13-b826-c5b026530cca`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:07:33,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:07:33,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:07:33,876::task::974::TaskManager.Task::(_decref) Task=`03af5b71-2bc3-4e13-b826-c5b026530cca`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:33,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:07:34,108::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:07:34,125::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00024594 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:34,888::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:07:34,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:07:34,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:07:34,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:34,889::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:07:34,891::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:07:35,153::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:35,892::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:36,154::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:36,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:07:36,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:07:36,893::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:37,156::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:37,894::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:07:37,895::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:07:37,895::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:38,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:07:38,897::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:07:38,897::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:07:38,897::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:39,157::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:39,898::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:07:40,434::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:07:40,462::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287809 s, 14.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:40,899::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:07:40,900::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:41,159::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:41,160::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:07:41,161::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:07:41,168::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:07:41,537::task::579::TaskManager.Task::(_updateState) Task=`556e01a9-f59f-4ee9-9bfd-844d2affdffb`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:07:41,537::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:07:41,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:07:41,538::task::1168::TaskManager.Task::(prepare) Task=`556e01a9-f59f-4ee9-9bfd-844d2affdffb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:07:41,538::task::579::TaskManager.Task::(_updateState) Task=`556e01a9-f59f-4ee9-9bfd-844d2affdffb`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:07:41,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:07:41,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:07:41,538::task::974::TaskManager.Task::(_decref) Task=`556e01a9-f59f-4ee9-9bfd-844d2affdffb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:41,901::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:42,902::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:43,169::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:43,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:07:44,134::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:07:44,150::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308059 s, 1.2 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 16:07:44,792::task::579::TaskManager.Task::(_updateState) Task=`338cb8aa-a061-4e6f-9a00-fd758f448a3c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:07:44,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:07:44,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:07:44,793::task::1168::TaskManager.Task::(prepare) Task=`338cb8aa-a061-4e6f-9a00-fd758f448a3c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:07:44,793::task::579::TaskManager.Task::(_updateState) Task=`338cb8aa-a061-4e6f-9a00-fd758f448a3c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:07:44,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:07:44,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:07:44,793::task::974::TaskManager.Task::(_decref) Task=`338cb8aa-a061-4e6f-9a00-fd758f448a3c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:07:44,794::task::579::TaskManager.Task::(_updateState) Task=`ebfa1e47-3600-490b-bddf-e1b0a6cf233f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:07:44,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:07:44,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:07:44,794::task::1168::TaskManager.Task::(prepare) Task=`ebfa1e47-3600-490b-bddf-e1b0a6cf233f`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:07:44,794::task::579::TaskManager.Task::(_updateState) Task=`ebfa1e47-3600-490b-bddf-e1b0a6cf233f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:07:44,794::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:07:44,795::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:07:44,795::task::974::TaskManager.Task::(_decref) Task=`ebfa1e47-3600-490b-bddf-e1b0a6cf233f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:07:44,795::task::579::TaskManager.Task::(_updateState) Task=`1e2d3a58-f310-42b4-ba93-2ec9e8532d4c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:07:44,795::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:07:44,796::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:07:44,796::task::1168::TaskManager.Task::(prepare) Task=`1e2d3a58-f310-42b4-ba93-2ec9e8532d4c`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:07:44,796::task::579::TaskManager.Task::(_updateState) Task=`1e2d3a58-f310-42b4-ba93-2ec9e8532d4c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:07:44,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:07:44,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:07:44,796::task::974::TaskManager.Task::(_decref) Task=`1e2d3a58-f310-42b4-ba93-2ec9e8532d4c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:44,905::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286165::DEBUG::2014-01-16 16:07:45,041::task::579::TaskManager.Task::(_updateState) Task=`88941031-bee0-42b7-b087-d938d5f1c749`::moving from state init -> state preparing >Thread-286165::INFO::2014-01-16 16:07:45,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286165::INFO::2014-01-16 16:07:45,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308059', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287809', 'lastCheck': '4.6', 'valid': True}} >Thread-286165::DEBUG::2014-01-16 16:07:45,042::task::1168::TaskManager.Task::(prepare) Task=`88941031-bee0-42b7-b087-d938d5f1c749`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308059', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287809', 'lastCheck': '4.6', 'valid': True}} >Thread-286165::DEBUG::2014-01-16 16:07:45,042::task::579::TaskManager.Task::(_updateState) Task=`88941031-bee0-42b7-b087-d938d5f1c749`::moving from state preparing -> state finished >Thread-286165::DEBUG::2014-01-16 16:07:45,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286165::DEBUG::2014-01-16 16:07:45,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286165::DEBUG::2014-01-16 16:07:45,042::task::974::TaskManager.Task::(_decref) Task=`88941031-bee0-42b7-b087-d938d5f1c749`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:07:45,170::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:07:45,517::task::579::TaskManager.Task::(_updateState) Task=`d9e44310-d8df-4ca5-a591-76b1a11f65e6`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:07:45,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:07:45,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:07:45,518::task::1168::TaskManager.Task::(prepare) Task=`d9e44310-d8df-4ca5-a591-76b1a11f65e6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:07:45,518::task::579::TaskManager.Task::(_updateState) Task=`d9e44310-d8df-4ca5-a591-76b1a11f65e6`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:07:45,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:07:45,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:07:45,519::task::974::TaskManager.Task::(_decref) Task=`d9e44310-d8df-4ca5-a591-76b1a11f65e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:45,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:46,172::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:46,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:07:46,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:47,173::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:47,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:48,909::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:49,174::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:49,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:07:50,467::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:07:50,495::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000333951 s, 12.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:50,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:51,176::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:07:51,177::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:51,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:07:51,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:07:51,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:07:52,493::task::579::TaskManager.Task::(_updateState) Task=`4a22b05a-b98f-4772-8bc7-42b88af18db1`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:07:52,494::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:07:52,494::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:07:52,494::task::1168::TaskManager.Task::(prepare) Task=`4a22b05a-b98f-4772-8bc7-42b88af18db1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:07:52,494::task::579::TaskManager.Task::(_updateState) Task=`4a22b05a-b98f-4772-8bc7-42b88af18db1`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:07:52,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:07:52,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:07:52,495::task::974::TaskManager.Task::(_decref) Task=`4a22b05a-b98f-4772-8bc7-42b88af18db1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:52,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:07:52,915::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:53,178::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:53,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:07:53,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:07:53,916::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:07:54,162::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:07:54,182::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000246447 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:07:54,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:07:54,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:55,179::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:55,918::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:07:55,918::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:07:56,052::task::579::TaskManager.Task::(_updateState) Task=`516fe459-00ac-46a2-a374-f173ca8b5d9a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:07:56,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:07:56,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:07:56,053::task::1168::TaskManager.Task::(prepare) Task=`516fe459-00ac-46a2-a374-f173ca8b5d9a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:07:56,053::task::579::TaskManager.Task::(_updateState) Task=`516fe459-00ac-46a2-a374-f173ca8b5d9a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:07:56,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:07:56,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:07:56,054::task::974::TaskManager.Task::(_decref) Task=`516fe459-00ac-46a2-a374-f173ca8b5d9a`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:07:56,054::task::579::TaskManager.Task::(_updateState) Task=`8f0320ee-b95f-457c-8a7d-be7e952a93c9`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:07:56,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:07:56,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:07:56,055::task::1168::TaskManager.Task::(prepare) Task=`8f0320ee-b95f-457c-8a7d-be7e952a93c9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:07:56,055::task::579::TaskManager.Task::(_updateState) Task=`8f0320ee-b95f-457c-8a7d-be7e952a93c9`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:07:56,055::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:07:56,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:07:56,055::task::974::TaskManager.Task::(_decref) Task=`8f0320ee-b95f-457c-8a7d-be7e952a93c9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:07:56,181::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:07:56,182::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:07:56,183::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:56,920::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:57,184::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:07:57,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:07:57,921::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:07:58,922::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:07:58,923::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:07:59,185::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:07:59,703::task::579::TaskManager.Task::(_updateState) Task=`571fc740-4168-452c-af76-c1b6b64fff72`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:07:59,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:07:59,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:07:59,704::task::1168::TaskManager.Task::(prepare) Task=`571fc740-4168-452c-af76-c1b6b64fff72`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:07:59,704::task::579::TaskManager.Task::(_updateState) Task=`571fc740-4168-452c-af76-c1b6b64fff72`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:07:59,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:07:59,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:07:59,705::task::974::TaskManager.Task::(_decref) Task=`571fc740-4168-452c-af76-c1b6b64fff72`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:07:59,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:07:59,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:07:59,924::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:07:59,924::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:08:00,502::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:08:00,529::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000292625 s, 14.0 MB/s\n'; <rc> = 0 >Thread-286171::DEBUG::2014-01-16 16:08:00,772::task::579::TaskManager.Task::(_updateState) Task=`802b41e8-204e-4c4b-b176-55f36fbad7cc`::moving from state init -> state preparing >Thread-286171::INFO::2014-01-16 16:08:00,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286171::INFO::2014-01-16 16:08:00,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246447', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292625', 'lastCheck': '0.2', 'valid': True}} >Thread-286171::DEBUG::2014-01-16 16:08:00,773::task::1168::TaskManager.Task::(prepare) Task=`802b41e8-204e-4c4b-b176-55f36fbad7cc`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246447', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292625', 'lastCheck': '0.2', 'valid': True}} >Thread-286171::DEBUG::2014-01-16 16:08:00,773::task::579::TaskManager.Task::(_updateState) Task=`802b41e8-204e-4c4b-b176-55f36fbad7cc`::moving from state preparing -> state finished >Thread-286171::DEBUG::2014-01-16 16:08:00,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286171::DEBUG::2014-01-16 16:08:00,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286171::DEBUG::2014-01-16 16:08:00,774::task::974::TaskManager.Task::(_decref) Task=`802b41e8-204e-4c4b-b176-55f36fbad7cc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:00,925::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:08:00,926::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:08:00,926::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:01,187::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:01,188::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:01,927::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:08:01,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:08:02,363::task::579::TaskManager.Task::(_updateState) Task=`5db91766-a3d6-4756-8a08-185a704fe6ea`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:08:02,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:08:02,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:08:02,364::task::1168::TaskManager.Task::(prepare) Task=`5db91766-a3d6-4756-8a08-185a704fe6ea`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:08:02,364::task::579::TaskManager.Task::(_updateState) Task=`5db91766-a3d6-4756-8a08-185a704fe6ea`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:08:02,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:08:02,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:08:02,364::task::974::TaskManager.Task::(_decref) Task=`5db91766-a3d6-4756-8a08-185a704fe6ea`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:08:02,365::task::579::TaskManager.Task::(_updateState) Task=`1837b3ee-3ed2-4801-b19c-1d70c19b1191`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:08:02,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:08:02,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:08:02,365::task::1168::TaskManager.Task::(prepare) Task=`1837b3ee-3ed2-4801-b19c-1d70c19b1191`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:08:02,366::task::579::TaskManager.Task::(_updateState) Task=`1837b3ee-3ed2-4801-b19c-1d70c19b1191`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:08:02,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:08:02,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:08:02,366::task::974::TaskManager.Task::(_decref) Task=`1837b3ee-3ed2-4801-b19c-1d70c19b1191`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:08:02,900::task::579::TaskManager.Task::(_updateState) Task=`fe2f4730-17b4-4b1f-b5b8-a89f6af75447`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:08:02,900::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:08:02,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:08:02,902::task::1168::TaskManager.Task::(prepare) Task=`fe2f4730-17b4-4b1f-b5b8-a89f6af75447`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:08:02,902::task::579::TaskManager.Task::(_updateState) Task=`fe2f4730-17b4-4b1f-b5b8-a89f6af75447`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:08:02,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:08:02,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:08:02,902::task::974::TaskManager.Task::(_decref) Task=`fe2f4730-17b4-4b1f-b5b8-a89f6af75447`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:08:02,905::task::579::TaskManager.Task::(_updateState) Task=`631a3edc-6b35-4946-87d8-fd867173e360`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:08:02,905::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:08:02,906::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:08:02,906::task::1168::TaskManager.Task::(prepare) Task=`631a3edc-6b35-4946-87d8-fd867173e360`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:08:02,906::task::579::TaskManager.Task::(_updateState) Task=`631a3edc-6b35-4946-87d8-fd867173e360`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:08:02,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:08:02,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:08:02,907::task::974::TaskManager.Task::(_decref) Task=`631a3edc-6b35-4946-87d8-fd867173e360`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:02,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:08:02,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:08:02,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:08:02,929::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:03,189::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:03,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 16:08:03,976::task::579::TaskManager.Task::(_updateState) Task=`5bc3715f-40fb-484a-b372-ce4fa5b3c643`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:08:03,976::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:08:03,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-16399::DEBUG::2014-01-16 16:08:03,977::task::579::TaskManager.Task::(_updateState) Task=`01c306fa-238d-4a8d-8d72-4994cbfc2c73`::moving from state init -> state preparing >Thread-26403::DEBUG::2014-01-16 16:08:03,977::task::1168::TaskManager.Task::(prepare) Task=`5bc3715f-40fb-484a-b372-ce4fa5b3c643`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-16399::INFO::2014-01-16 16:08:03,977::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-26403::DEBUG::2014-01-16 16:08:03,977::task::579::TaskManager.Task::(_updateState) Task=`5bc3715f-40fb-484a-b372-ce4fa5b3c643`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:08:03,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:08:03,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:08:03,978::task::974::TaskManager.Task::(_decref) Task=`5bc3715f-40fb-484a-b372-ce4fa5b3c643`::ref 0 aborting False >Thread-16399::INFO::2014-01-16 16:08:03,978::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:08:03,978::task::1168::TaskManager.Task::(prepare) Task=`01c306fa-238d-4a8d-8d72-4994cbfc2c73`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:08:03,979::task::579::TaskManager.Task::(_updateState) Task=`01c306fa-238d-4a8d-8d72-4994cbfc2c73`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:08:03,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:08:03,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:08:03,979::task::974::TaskManager.Task::(_decref) Task=`01c306fa-238d-4a8d-8d72-4994cbfc2c73`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:08:03,979::task::579::TaskManager.Task::(_updateState) Task=`35549ea4-b6c4-45ec-9a04-5e2e658e88a3`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:08:03,979::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:08:03,980::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:08:03,980::task::1168::TaskManager.Task::(prepare) Task=`35549ea4-b6c4-45ec-9a04-5e2e658e88a3`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:08:03,980::task::579::TaskManager.Task::(_updateState) Task=`35549ea4-b6c4-45ec-9a04-5e2e658e88a3`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:08:03,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:08:03,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:08:03,980::task::974::TaskManager.Task::(_decref) Task=`35549ea4-b6c4-45ec-9a04-5e2e658e88a3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:08:04,191::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:08:04,207::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258898 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:08:04,210::task::579::TaskManager.Task::(_updateState) Task=`88d14048-f71b-4736-8b84-4a5c953d206e`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:08:04,211::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:08:04,211::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:08:04,211::task::1168::TaskManager.Task::(prepare) Task=`88d14048-f71b-4736-8b84-4a5c953d206e`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:08:04,212::task::579::TaskManager.Task::(_updateState) Task=`88d14048-f71b-4736-8b84-4a5c953d206e`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:08:04,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:08:04,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:08:04,212::task::974::TaskManager.Task::(_decref) Task=`88d14048-f71b-4736-8b84-4a5c953d206e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:04,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:08:04,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:08:04,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:08:04,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:04,933::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:08:04,933::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-184546::DEBUG::2014-01-16 16:08:05,052::task::579::TaskManager.Task::(_updateState) Task=`8bed5f9e-3e57-48b5-9ecf-1a3d59707204`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:08:05,052::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:08:05,052::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:08:05,053::task::1168::TaskManager.Task::(prepare) Task=`8bed5f9e-3e57-48b5-9ecf-1a3d59707204`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:08:05,053::task::579::TaskManager.Task::(_updateState) Task=`8bed5f9e-3e57-48b5-9ecf-1a3d59707204`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:08:05,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:08:05,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:08:05,053::task::974::TaskManager.Task::(_decref) Task=`8bed5f9e-3e57-48b5-9ecf-1a3d59707204`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:08:05,190::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:05,934::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:08:05,942::task::579::TaskManager.Task::(_updateState) Task=`29e01647-eccd-40db-8f0d-141427250e9f`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:08:05,942::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:08:05,943::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:08:05,943::task::1168::TaskManager.Task::(prepare) Task=`29e01647-eccd-40db-8f0d-141427250e9f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:08:05,943::task::579::TaskManager.Task::(_updateState) Task=`29e01647-eccd-40db-8f0d-141427250e9f`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:08:05,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:08:05,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:08:05,943::task::974::TaskManager.Task::(_decref) Task=`29e01647-eccd-40db-8f0d-141427250e9f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:08:06,192::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:06,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:08:06,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:08:06,936::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:07,193::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:07,937::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:08:07,937::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:08:07,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:08,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:08:08,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:08:08,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:08:08,939::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:08:09,004::task::579::TaskManager.Task::(_updateState) Task=`d874623b-d00f-4402-bc72-2fcf3de3f727`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:08:09,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:08:09,005::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:08:09,005::task::1168::TaskManager.Task::(prepare) Task=`d874623b-d00f-4402-bc72-2fcf3de3f727`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:08:09,005::task::579::TaskManager.Task::(_updateState) Task=`d874623b-d00f-4402-bc72-2fcf3de3f727`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:08:09,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:08:09,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:08:09,005::task::974::TaskManager.Task::(_decref) Task=`d874623b-d00f-4402-bc72-2fcf3de3f727`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:08:09,194::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:09,941::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:08:10,534::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:08:10,562::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00029861 s, 13.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:10,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:08:10,942::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:11,196::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:11,196::task::579::TaskManager.Task::(_updateState) Task=`fa7141fb-aa44-4e5f-994b-fac3f1f001e0`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:08:11,196::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:08:11,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:08:11,197::task::1168::TaskManager.Task::(prepare) Task=`fa7141fb-aa44-4e5f-994b-fac3f1f001e0`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:08:11,197::task::579::TaskManager.Task::(_updateState) Task=`fa7141fb-aa44-4e5f-994b-fac3f1f001e0`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:08:11,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:08:11,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:08:11,198::task::974::TaskManager.Task::(_decref) Task=`fa7141fb-aa44-4e5f-994b-fac3f1f001e0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:08:11,199::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:08:11,200::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:08:11,201::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:11,202::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:11,203::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:11,943::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:08:12,644::task::579::TaskManager.Task::(_updateState) Task=`f3051677-0b66-4818-ac3c-7808fc02cafb`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:08:12,645::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:08:12,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:08:12,645::task::1168::TaskManager.Task::(prepare) Task=`f3051677-0b66-4818-ac3c-7808fc02cafb`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:08:12,645::task::579::TaskManager.Task::(_updateState) Task=`f3051677-0b66-4818-ac3c-7808fc02cafb`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:08:12,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:08:12,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:08:12,646::task::974::TaskManager.Task::(_decref) Task=`f3051677-0b66-4818-ac3c-7808fc02cafb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:12,945::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:13,204::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:13,946::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:08:14,070::task::579::TaskManager.Task::(_updateState) Task=`3a506e8b-1c2f-41f0-b6f1-a7028d977bb2`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:08:14,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:08:14,071::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:08:14,071::task::1168::TaskManager.Task::(prepare) Task=`3a506e8b-1c2f-41f0-b6f1-a7028d977bb2`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:08:14,071::task::579::TaskManager.Task::(_updateState) Task=`3a506e8b-1c2f-41f0-b6f1-a7028d977bb2`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:08:14,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:08:14,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:08:14,071::task::974::TaskManager.Task::(_decref) Task=`3a506e8b-1c2f-41f0-b6f1-a7028d977bb2`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:08:14,072::task::579::TaskManager.Task::(_updateState) Task=`a5d3e2b1-3d37-4d84-a1c1-c5c3435eb43e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:08:14,072::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:08:14,072::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:08:14,072::task::1168::TaskManager.Task::(prepare) Task=`a5d3e2b1-3d37-4d84-a1c1-c5c3435eb43e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:08:14,072::task::579::TaskManager.Task::(_updateState) Task=`a5d3e2b1-3d37-4d84-a1c1-c5c3435eb43e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:08:14,072::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:08:14,072::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:08:14,073::task::974::TaskManager.Task::(_decref) Task=`a5d3e2b1-3d37-4d84-a1c1-c5c3435eb43e`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:08:14,151::task::579::TaskManager.Task::(_updateState) Task=`03efd56a-bc78-4c00-96d9-5ff03feebf01`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:08:14,152::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:08:14,153::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:08:14,153::task::1168::TaskManager.Task::(prepare) Task=`03efd56a-bc78-4c00-96d9-5ff03feebf01`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:08:14,153::task::579::TaskManager.Task::(_updateState) Task=`03efd56a-bc78-4c00-96d9-5ff03feebf01`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:08:14,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:08:14,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:08:14,154::task::974::TaskManager.Task::(_decref) Task=`03efd56a-bc78-4c00-96d9-5ff03feebf01`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:08:14,216::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:08:14,232::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000348768 s, 1.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:14,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:15,206::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:15,949::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:16,207::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286177::DEBUG::2014-01-16 16:08:16,617::task::579::TaskManager.Task::(_updateState) Task=`f553d41d-4fc2-4547-b007-35c25b4eda76`::moving from state init -> state preparing >Thread-286177::INFO::2014-01-16 16:08:16,617::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286177::INFO::2014-01-16 16:08:16,617::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000348768', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029861', 'lastCheck': '6.1', 'valid': True}} >Thread-286177::DEBUG::2014-01-16 16:08:16,618::task::1168::TaskManager.Task::(prepare) Task=`f553d41d-4fc2-4547-b007-35c25b4eda76`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000348768', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029861', 'lastCheck': '6.1', 'valid': True}} >Thread-286177::DEBUG::2014-01-16 16:08:16,618::task::579::TaskManager.Task::(_updateState) Task=`f553d41d-4fc2-4547-b007-35c25b4eda76`::moving from state preparing -> state finished >Thread-286177::DEBUG::2014-01-16 16:08:16,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286177::DEBUG::2014-01-16 16:08:16,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286177::DEBUG::2014-01-16 16:08:16,618::task::974::TaskManager.Task::(_decref) Task=`f553d41d-4fc2-4547-b007-35c25b4eda76`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:16,950::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:08:16,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:17,208::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:17,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:18,953::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:19,210::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:19,954::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:08:20,568::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:08:20,598::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000243815 s, 16.8 MB/s\n'; <rc> = 0 >Thread-189046::DEBUG::2014-01-16 16:08:20,722::task::579::TaskManager.Task::(_updateState) Task=`e5c84d83-78fb-486c-a349-189029ba486a`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:08:20,723::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:08:20,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:08:20,723::task::1168::TaskManager.Task::(prepare) Task=`e5c84d83-78fb-486c-a349-189029ba486a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:08:20,723::task::579::TaskManager.Task::(_updateState) Task=`e5c84d83-78fb-486c-a349-189029ba486a`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:08:20,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:08:20,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:08:20,724::task::974::TaskManager.Task::(_decref) Task=`e5c84d83-78fb-486c-a349-189029ba486a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:20,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:21,211::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:21,212::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:21,956::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:08:21,956::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:08:21,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:08:22,874::task::579::TaskManager.Task::(_updateState) Task=`3d1e9106-72ed-49b2-9b80-ea12dfd51d8e`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:08:22,875::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:08:22,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:08:22,876::task::1168::TaskManager.Task::(prepare) Task=`3d1e9106-72ed-49b2-9b80-ea12dfd51d8e`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:08:22,876::task::579::TaskManager.Task::(_updateState) Task=`3d1e9106-72ed-49b2-9b80-ea12dfd51d8e`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:08:22,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:08:22,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:08:22,877::task::974::TaskManager.Task::(_decref) Task=`3d1e9106-72ed-49b2-9b80-ea12dfd51d8e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:22,958::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:08:22,958::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:23,213::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:23,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:08:23,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:08:23,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:08:24,239::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:08:24,255::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000367516 s, 993 kB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:08:24,279::task::579::TaskManager.Task::(_updateState) Task=`26a53051-d01c-498a-901b-15214bba819f`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:08:24,280::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:08:24,280::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:08:24,280::task::1168::TaskManager.Task::(prepare) Task=`26a53051-d01c-498a-901b-15214bba819f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:08:24,280::task::579::TaskManager.Task::(_updateState) Task=`26a53051-d01c-498a-901b-15214bba819f`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:08:24,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:08:24,281::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:08:24,281::task::974::TaskManager.Task::(_decref) Task=`26a53051-d01c-498a-901b-15214bba819f`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:08:24,353::task::579::TaskManager.Task::(_updateState) Task=`f8535976-7c43-419e-b92f-508471cf1799`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:08:24,353::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:08:24,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:08:24,353::task::1168::TaskManager.Task::(prepare) Task=`f8535976-7c43-419e-b92f-508471cf1799`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:08:24,353::task::579::TaskManager.Task::(_updateState) Task=`f8535976-7c43-419e-b92f-508471cf1799`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:08:24,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:08:24,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:08:24,354::task::974::TaskManager.Task::(_decref) Task=`f8535976-7c43-419e-b92f-508471cf1799`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:24,961::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:08:24,961::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:25,215::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:25,962::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:08:25,963::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:26,218::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:08:26,218::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:08:26,219::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:26,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:27,221::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:27,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:08:27,965::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:28,967::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:08:28,967::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:08:29,140::task::579::TaskManager.Task::(_updateState) Task=`a2fc70d7-7a3e-4a2c-abf1-d0ca806bdaed`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:08:29,141::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:08:29,141::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:08:29,141::task::1168::TaskManager.Task::(prepare) Task=`a2fc70d7-7a3e-4a2c-abf1-d0ca806bdaed`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:08:29,141::task::579::TaskManager.Task::(_updateState) Task=`a2fc70d7-7a3e-4a2c-abf1-d0ca806bdaed`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:08:29,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:08:29,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:08:29,142::task::974::TaskManager.Task::(_decref) Task=`a2fc70d7-7a3e-4a2c-abf1-d0ca806bdaed`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:08:29,222::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:29,968::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:08:29,969::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:08:29,969::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:08:29,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:08:30,603::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:08:30,630::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000229534 s, 17.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:30,971::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:08:30,971::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:08:30,971::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:31,224::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:31,225::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:31,972::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:08:31,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:08:32,041::task::579::TaskManager.Task::(_updateState) Task=`77021bcd-c2c1-462e-b808-b973ad5d232c`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:08:32,041::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:08:32,041::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:08:32,041::task::1168::TaskManager.Task::(prepare) Task=`77021bcd-c2c1-462e-b808-b973ad5d232c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:08:32,042::task::579::TaskManager.Task::(_updateState) Task=`77021bcd-c2c1-462e-b808-b973ad5d232c`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:08:32,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:08:32,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:08:32,042::task::974::TaskManager.Task::(_decref) Task=`77021bcd-c2c1-462e-b808-b973ad5d232c`::ref 0 aborting False >Thread-286183::DEBUG::2014-01-16 16:08:32,404::task::579::TaskManager.Task::(_updateState) Task=`8e376179-7a0d-442a-b6a4-6c4d3fe0a9d5`::moving from state init -> state preparing >Thread-286183::INFO::2014-01-16 16:08:32,404::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286183::INFO::2014-01-16 16:08:32,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000367516', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229534', 'lastCheck': '1.8', 'valid': True}} >Thread-286183::DEBUG::2014-01-16 16:08:32,405::task::1168::TaskManager.Task::(prepare) Task=`8e376179-7a0d-442a-b6a4-6c4d3fe0a9d5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000367516', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229534', 'lastCheck': '1.8', 'valid': True}} >Thread-286183::DEBUG::2014-01-16 16:08:32,405::task::579::TaskManager.Task::(_updateState) Task=`8e376179-7a0d-442a-b6a4-6c4d3fe0a9d5`::moving from state preparing -> state finished >Thread-286183::DEBUG::2014-01-16 16:08:32,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286183::DEBUG::2014-01-16 16:08:32,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286183::DEBUG::2014-01-16 16:08:32,405::task::974::TaskManager.Task::(_decref) Task=`8e376179-7a0d-442a-b6a4-6c4d3fe0a9d5`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:08:32,629::task::579::TaskManager.Task::(_updateState) Task=`d5cf83f2-55f7-4b24-a6c7-bee50cb01102`::moving from state init -> state preparing >Thread-16393::DEBUG::2014-01-16 16:08:32,629::task::579::TaskManager.Task::(_updateState) Task=`dfaab56b-37ae-42ae-892c-a28773c0e599`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:08:32,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16393::INFO::2014-01-16 16:08:32,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16398::INFO::2014-01-16 16:08:32,634::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::INFO::2014-01-16 16:08:32,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:08:32,636::task::1168::TaskManager.Task::(prepare) Task=`d5cf83f2-55f7-4b24-a6c7-bee50cb01102`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:08:32,637::task::1168::TaskManager.Task::(prepare) Task=`dfaab56b-37ae-42ae-892c-a28773c0e599`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:08:32,638::task::579::TaskManager.Task::(_updateState) Task=`d5cf83f2-55f7-4b24-a6c7-bee50cb01102`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:08:32,639::task::579::TaskManager.Task::(_updateState) Task=`dfaab56b-37ae-42ae-892c-a28773c0e599`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:08:32,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:08:32,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:08:32,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:08:32,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:08:32,641::task::974::TaskManager.Task::(_decref) Task=`d5cf83f2-55f7-4b24-a6c7-bee50cb01102`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:08:32,642::task::974::TaskManager.Task::(_decref) Task=`dfaab56b-37ae-42ae-892c-a28773c0e599`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:08:32,722::task::579::TaskManager.Task::(_updateState) Task=`bf4e3009-1b19-400a-91f2-3832d58dd137`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:08:32,723::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:08:32,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:08:32,723::task::1168::TaskManager.Task::(prepare) Task=`bf4e3009-1b19-400a-91f2-3832d58dd137`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:08:32,723::task::579::TaskManager.Task::(_updateState) Task=`bf4e3009-1b19-400a-91f2-3832d58dd137`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:08:32,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:08:32,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:08:32,724::task::974::TaskManager.Task::(_decref) Task=`bf4e3009-1b19-400a-91f2-3832d58dd137`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:32,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:08:32,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:08:32,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:08:32,975::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:33,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:08:33,629::task::579::TaskManager.Task::(_updateState) Task=`2e0854cc-48ac-4ea0-80f3-ba042a6d7f57`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:08:33,629::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:08:33,630::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:08:33,630::task::1168::TaskManager.Task::(prepare) Task=`2e0854cc-48ac-4ea0-80f3-ba042a6d7f57`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:08:33,630::task::579::TaskManager.Task::(_updateState) Task=`2e0854cc-48ac-4ea0-80f3-ba042a6d7f57`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:08:33,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:08:33,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:08:33,630::task::974::TaskManager.Task::(_decref) Task=`2e0854cc-48ac-4ea0-80f3-ba042a6d7f57`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:08:33,631::task::579::TaskManager.Task::(_updateState) Task=`9b085a3e-9ad8-4996-b4b4-85b815f535bb`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:08:33,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:08:33,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:08:33,631::task::1168::TaskManager.Task::(prepare) Task=`9b085a3e-9ad8-4996-b4b4-85b815f535bb`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:08:33,631::task::579::TaskManager.Task::(_updateState) Task=`9b085a3e-9ad8-4996-b4b4-85b815f535bb`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:08:33,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:08:33,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:08:33,632::task::974::TaskManager.Task::(_decref) Task=`9b085a3e-9ad8-4996-b4b4-85b815f535bb`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:08:33,632::task::579::TaskManager.Task::(_updateState) Task=`e07e6b87-be2c-48ef-aa95-dd388f37470c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:08:33,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:08:33,632::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:08:33,632::task::1168::TaskManager.Task::(prepare) Task=`e07e6b87-be2c-48ef-aa95-dd388f37470c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:08:33,633::task::579::TaskManager.Task::(_updateState) Task=`e07e6b87-be2c-48ef-aa95-dd388f37470c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:08:33,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:08:33,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:08:33,633::task::974::TaskManager.Task::(_decref) Task=`e07e6b87-be2c-48ef-aa95-dd388f37470c`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:08:33,700::task::579::TaskManager.Task::(_updateState) Task=`c8c3e64a-ba08-4966-91a9-7ee3ed863b6f`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:08:33,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:08:33,700::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:08:33,700::task::1168::TaskManager.Task::(prepare) Task=`c8c3e64a-ba08-4966-91a9-7ee3ed863b6f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:08:33,700::task::579::TaskManager.Task::(_updateState) Task=`c8c3e64a-ba08-4966-91a9-7ee3ed863b6f`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:08:33,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:08:33,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:08:33,701::task::974::TaskManager.Task::(_decref) Task=`c8c3e64a-ba08-4966-91a9-7ee3ed863b6f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:33,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 16:08:34,033::task::579::TaskManager.Task::(_updateState) Task=`3379f759-d269-4724-a935-a8fd9dbc32b2`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:08:34,034::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:08:34,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:08:34,034::task::1168::TaskManager.Task::(prepare) Task=`3379f759-d269-4724-a935-a8fd9dbc32b2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:08:34,034::task::579::TaskManager.Task::(_updateState) Task=`3379f759-d269-4724-a935-a8fd9dbc32b2`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:08:34,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:08:34,035::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:08:34,035::task::974::TaskManager.Task::(_decref) Task=`3379f759-d269-4724-a935-a8fd9dbc32b2`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:08:34,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:08:34,278::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000318969 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:34,977::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:08:34,977::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:08:34,977::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:08:34,977::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:34,978::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:08:34,978::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:08:35,228::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:35,980::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:36,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:36,981::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:08:36,981::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:08:36,981::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:37,230::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:37,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:08:37,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:08:37,982::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:38,983::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:08:38,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:08:38,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:08:38,984::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:39,231::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:39,985::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:08:40,636::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:08:40,660::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000326074 s, 12.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:40,986::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:08:40,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:41,233::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:41,235::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:08:41,235::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:08:41,236::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:08:41,691::task::579::TaskManager.Task::(_updateState) Task=`b7f59142-ccc9-4d5d-b657-2993c1b76a1c`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:08:41,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:08:41,692::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:08:41,692::task::1168::TaskManager.Task::(prepare) Task=`b7f59142-ccc9-4d5d-b657-2993c1b76a1c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:08:41,692::task::579::TaskManager.Task::(_updateState) Task=`b7f59142-ccc9-4d5d-b657-2993c1b76a1c`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:08:41,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:08:41,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:08:41,693::task::974::TaskManager.Task::(_decref) Task=`b7f59142-ccc9-4d5d-b657-2993c1b76a1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:41,988::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:42,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:43,237::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:43,990::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:08:44,285::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:08:44,304::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000283528 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:44,991::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:45,239::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:08:45,361::task::579::TaskManager.Task::(_updateState) Task=`777b02ba-121d-4f98-969e-569d113205c9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:08:45,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:08:45,361::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:08:45,362::task::1168::TaskManager.Task::(prepare) Task=`777b02ba-121d-4f98-969e-569d113205c9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:08:45,362::task::579::TaskManager.Task::(_updateState) Task=`777b02ba-121d-4f98-969e-569d113205c9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:08:45,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:08:45,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:08:45,362::task::974::TaskManager.Task::(_decref) Task=`777b02ba-121d-4f98-969e-569d113205c9`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:08:45,362::task::579::TaskManager.Task::(_updateState) Task=`df30583c-6f35-4845-b4b0-8da6ede7eb9d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:08:45,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:08:45,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:08:45,363::task::1168::TaskManager.Task::(prepare) Task=`df30583c-6f35-4845-b4b0-8da6ede7eb9d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:08:45,363::task::579::TaskManager.Task::(_updateState) Task=`df30583c-6f35-4845-b4b0-8da6ede7eb9d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:08:45,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:08:45,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:08:45,364::task::974::TaskManager.Task::(_decref) Task=`df30583c-6f35-4845-b4b0-8da6ede7eb9d`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:08:45,364::task::579::TaskManager.Task::(_updateState) Task=`2722556e-6ea5-4611-8620-56849d037c09`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:08:45,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:08:45,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:08:45,364::task::1168::TaskManager.Task::(prepare) Task=`2722556e-6ea5-4611-8620-56849d037c09`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:08:45,365::task::579::TaskManager.Task::(_updateState) Task=`2722556e-6ea5-4611-8620-56849d037c09`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:08:45,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:08:45,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:08:45,365::task::974::TaskManager.Task::(_decref) Task=`2722556e-6ea5-4611-8620-56849d037c09`::ref 0 aborting False >Thread-221160::DEBUG::2014-01-16 16:08:45,692::task::579::TaskManager.Task::(_updateState) Task=`27ef9d68-ffa0-4da2-9637-a35563ebfb54`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:08:45,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:08:45,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:08:45,693::task::1168::TaskManager.Task::(prepare) Task=`27ef9d68-ffa0-4da2-9637-a35563ebfb54`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:08:45,693::task::579::TaskManager.Task::(_updateState) Task=`27ef9d68-ffa0-4da2-9637-a35563ebfb54`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:08:45,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:08:45,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:08:45,693::task::974::TaskManager.Task::(_decref) Task=`27ef9d68-ffa0-4da2-9637-a35563ebfb54`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:45,993::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:46,240::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:46,994::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:08:46,994::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:47,241::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:47,996::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286189::DEBUG::2014-01-16 16:08:48,558::task::579::TaskManager.Task::(_updateState) Task=`f5659a6c-15ca-487a-b22a-7fb169bf1191`::moving from state init -> state preparing >Thread-286189::INFO::2014-01-16 16:08:48,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286189::INFO::2014-01-16 16:08:48,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283528', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326074', 'lastCheck': '7.9', 'valid': True}} >Thread-286189::DEBUG::2014-01-16 16:08:48,559::task::1168::TaskManager.Task::(prepare) Task=`f5659a6c-15ca-487a-b22a-7fb169bf1191`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283528', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326074', 'lastCheck': '7.9', 'valid': True}} >Thread-286189::DEBUG::2014-01-16 16:08:48,559::task::579::TaskManager.Task::(_updateState) Task=`f5659a6c-15ca-487a-b22a-7fb169bf1191`::moving from state preparing -> state finished >Thread-286189::DEBUG::2014-01-16 16:08:48,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286189::DEBUG::2014-01-16 16:08:48,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286189::DEBUG::2014-01-16 16:08:48,560::task::974::TaskManager.Task::(_decref) Task=`f5659a6c-15ca-487a-b22a-7fb169bf1191`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:48,997::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:49,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:49,998::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:08:50,665::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:08:50,691::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000293282 s, 14.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:50,999::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:51,244::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:08:51,245::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:52,000::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:08:52,001::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:08:52,001::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:08:52,689::task::579::TaskManager.Task::(_updateState) Task=`2ef07adc-50c1-433e-9242-63cab27d7354`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:08:52,690::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:08:52,690::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:08:52,690::task::1168::TaskManager.Task::(prepare) Task=`2ef07adc-50c1-433e-9242-63cab27d7354`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:08:52,690::task::579::TaskManager.Task::(_updateState) Task=`2ef07adc-50c1-433e-9242-63cab27d7354`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:08:52,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:08:52,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:08:52,691::task::974::TaskManager.Task::(_decref) Task=`2ef07adc-50c1-433e-9242-63cab27d7354`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:53,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:08:53,002::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:53,246::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:54,003::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:08:54,003::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:08:54,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:08:54,312::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:08:54,329::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266743 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:08:55,005::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:08:55,005::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:55,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:56,006::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:08:56,006::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:56,250::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:08:56,251::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:08:56,252::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:08:56,279::task::579::TaskManager.Task::(_updateState) Task=`14a579b6-de32-492c-ae20-2451e859c6b5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:08:56,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:08:56,280::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:08:56,280::task::1168::TaskManager.Task::(prepare) Task=`14a579b6-de32-492c-ae20-2451e859c6b5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:08:56,280::task::579::TaskManager.Task::(_updateState) Task=`14a579b6-de32-492c-ae20-2451e859c6b5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:08:56,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:08:56,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:08:56,281::task::974::TaskManager.Task::(_decref) Task=`14a579b6-de32-492c-ae20-2451e859c6b5`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:08:56,281::task::579::TaskManager.Task::(_updateState) Task=`4eef24ba-5751-4ba1-9a25-51a7b5086bc5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:08:56,281::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:08:56,281::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:08:56,282::task::1168::TaskManager.Task::(prepare) Task=`4eef24ba-5751-4ba1-9a25-51a7b5086bc5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:08:56,282::task::579::TaskManager.Task::(_updateState) Task=`4eef24ba-5751-4ba1-9a25-51a7b5086bc5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:08:56,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:08:56,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:08:56,282::task::974::TaskManager.Task::(_decref) Task=`4eef24ba-5751-4ba1-9a25-51a7b5086bc5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:08:57,007::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:57,253::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:08:58,008::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:08:58,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:08:59,009::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:08:59,010::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:08:59,254::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:08:59,858::task::579::TaskManager.Task::(_updateState) Task=`64f72ac2-83fb-462e-be70-967f055adb51`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:08:59,858::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:08:59,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:08:59,859::task::1168::TaskManager.Task::(prepare) Task=`64f72ac2-83fb-462e-be70-967f055adb51`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:08:59,859::task::579::TaskManager.Task::(_updateState) Task=`64f72ac2-83fb-462e-be70-967f055adb51`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:08:59,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:08:59,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:08:59,859::task::974::TaskManager.Task::(_decref) Task=`64f72ac2-83fb-462e-be70-967f055adb51`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:00,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:09:00,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:09:00,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:09:00,012::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:09:00,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:09:00,721::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000333834 s, 12.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:01,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:09:01,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:09:01,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:01,256::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:01,257::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:02,015::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:09:02,015::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:09:02,574::task::579::TaskManager.Task::(_updateState) Task=`53ffc6f8-a28c-4f1e-b5b5-cf5cf88635ba`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:09:02,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:09:02,575::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:09:02,575::task::1168::TaskManager.Task::(prepare) Task=`53ffc6f8-a28c-4f1e-b5b5-cf5cf88635ba`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:09:02,576::task::579::TaskManager.Task::(_updateState) Task=`53ffc6f8-a28c-4f1e-b5b5-cf5cf88635ba`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:09:02,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:09:02,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:09:02,576::task::974::TaskManager.Task::(_decref) Task=`53ffc6f8-a28c-4f1e-b5b5-cf5cf88635ba`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:09:02,576::task::579::TaskManager.Task::(_updateState) Task=`d03be5f6-1564-4716-894d-69c60fc191bf`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:09:02,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:09:02,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:09:02,577::task::1168::TaskManager.Task::(prepare) Task=`d03be5f6-1564-4716-894d-69c60fc191bf`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:09:02,577::task::579::TaskManager.Task::(_updateState) Task=`d03be5f6-1564-4716-894d-69c60fc191bf`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:09:02,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:09:02,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:09:02,578::task::974::TaskManager.Task::(_decref) Task=`d03be5f6-1564-4716-894d-69c60fc191bf`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:09:02,976::task::579::TaskManager.Task::(_updateState) Task=`78c38089-ae59-4683-88f2-dc833956ba17`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:09:02,976::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:09:02,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:09:02,977::task::1168::TaskManager.Task::(prepare) Task=`78c38089-ae59-4683-88f2-dc833956ba17`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:09:02,977::task::579::TaskManager.Task::(_updateState) Task=`78c38089-ae59-4683-88f2-dc833956ba17`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:09:02,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:09:02,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:09:02,977::task::974::TaskManager.Task::(_decref) Task=`78c38089-ae59-4683-88f2-dc833956ba17`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:09:02,978::task::579::TaskManager.Task::(_updateState) Task=`03de9819-3523-4308-a55b-b2e74f3ae563`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:09:02,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:09:02,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:09:02,979::task::1168::TaskManager.Task::(prepare) Task=`03de9819-3523-4308-a55b-b2e74f3ae563`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:09:02,979::task::579::TaskManager.Task::(_updateState) Task=`03de9819-3523-4308-a55b-b2e74f3ae563`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:09:02,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:09:02,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:09:02,979::task::974::TaskManager.Task::(_decref) Task=`03de9819-3523-4308-a55b-b2e74f3ae563`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:03,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:09:03,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:09:03,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:09:03,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:03,258::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:04,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:09:04,079::task::579::TaskManager.Task::(_updateState) Task=`be43fbda-f445-40fb-9e66-4d6dadbea870`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:09:04,079::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:09:04,079::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:09:04,079::task::1168::TaskManager.Task::(prepare) Task=`be43fbda-f445-40fb-9e66-4d6dadbea870`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:09:04,080::task::579::TaskManager.Task::(_updateState) Task=`be43fbda-f445-40fb-9e66-4d6dadbea870`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:09:04,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:09:04,080::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:09:04,080::task::974::TaskManager.Task::(_decref) Task=`be43fbda-f445-40fb-9e66-4d6dadbea870`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:09:04,080::task::579::TaskManager.Task::(_updateState) Task=`f35110bc-4698-4931-be3b-3f308484312e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:09:04,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:09:04,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:09:04,081::task::1168::TaskManager.Task::(prepare) Task=`f35110bc-4698-4931-be3b-3f308484312e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:09:04,081::task::579::TaskManager.Task::(_updateState) Task=`f35110bc-4698-4931-be3b-3f308484312e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:09:04,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:09:04,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:09:04,081::task::974::TaskManager.Task::(_decref) Task=`f35110bc-4698-4931-be3b-3f308484312e`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:09:04,146::task::579::TaskManager.Task::(_updateState) Task=`3ed6c96f-9076-4ee7-a18a-d9aa31e515d9`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:09:04,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:09:04,147::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:09:04,147::task::1168::TaskManager.Task::(prepare) Task=`3ed6c96f-9076-4ee7-a18a-d9aa31e515d9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:09:04,147::task::579::TaskManager.Task::(_updateState) Task=`3ed6c96f-9076-4ee7-a18a-d9aa31e515d9`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:09:04,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:09:04,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:09:04,148::task::974::TaskManager.Task::(_decref) Task=`3ed6c96f-9076-4ee7-a18a-d9aa31e515d9`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:09:04,337::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:09:04,353::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281423 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:09:04,360::task::579::TaskManager.Task::(_updateState) Task=`714c3d15-d5a9-4b78-b809-ebda547ec9ae`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:09:04,360::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:09:04,361::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:09:04,361::task::1168::TaskManager.Task::(prepare) Task=`714c3d15-d5a9-4b78-b809-ebda547ec9ae`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:09:04,361::task::579::TaskManager.Task::(_updateState) Task=`714c3d15-d5a9-4b78-b809-ebda547ec9ae`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:09:04,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:09:04,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:09:04,362::task::974::TaskManager.Task::(_decref) Task=`714c3d15-d5a9-4b78-b809-ebda547ec9ae`::ref 0 aborting False >Thread-286195::DEBUG::2014-01-16 16:09:04,905::task::579::TaskManager.Task::(_updateState) Task=`73b00ebc-5104-49a9-a858-cc71bd5f9d18`::moving from state init -> state preparing >Thread-286195::INFO::2014-01-16 16:09:04,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286195::INFO::2014-01-16 16:09:04,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281423', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333834', 'lastCheck': '4.2', 'valid': True}} >Thread-286195::DEBUG::2014-01-16 16:09:04,906::task::1168::TaskManager.Task::(prepare) Task=`73b00ebc-5104-49a9-a858-cc71bd5f9d18`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281423', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333834', 'lastCheck': '4.2', 'valid': True}} >Thread-286195::DEBUG::2014-01-16 16:09:04,906::task::579::TaskManager.Task::(_updateState) Task=`73b00ebc-5104-49a9-a858-cc71bd5f9d18`::moving from state preparing -> state finished >Thread-286195::DEBUG::2014-01-16 16:09:04,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286195::DEBUG::2014-01-16 16:09:04,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286195::DEBUG::2014-01-16 16:09:04,907::task::974::TaskManager.Task::(_decref) Task=`73b00ebc-5104-49a9-a858-cc71bd5f9d18`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:05,019::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:09:05,020::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:09:05,020::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:09:05,020::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:05,020::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:09:05,020::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-184546::DEBUG::2014-01-16 16:09:05,225::task::579::TaskManager.Task::(_updateState) Task=`32bae54b-a979-4e65-b02f-0c79eae08e9e`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:09:05,225::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:09:05,226::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:09:05,226::task::1168::TaskManager.Task::(prepare) Task=`32bae54b-a979-4e65-b02f-0c79eae08e9e`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:09:05,226::task::579::TaskManager.Task::(_updateState) Task=`32bae54b-a979-4e65-b02f-0c79eae08e9e`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:09:05,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:09:05,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:09:05,226::task::974::TaskManager.Task::(_decref) Task=`32bae54b-a979-4e65-b02f-0c79eae08e9e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:09:05,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:06,021::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:09:06,114::task::579::TaskManager.Task::(_updateState) Task=`dfc8ce6c-6624-4f31-ad0f-28a5ce32acad`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:09:06,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:09:06,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:09:06,115::task::1168::TaskManager.Task::(prepare) Task=`dfc8ce6c-6624-4f31-ad0f-28a5ce32acad`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:09:06,115::task::579::TaskManager.Task::(_updateState) Task=`dfc8ce6c-6624-4f31-ad0f-28a5ce32acad`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:09:06,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:09:06,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:09:06,115::task::974::TaskManager.Task::(_decref) Task=`dfc8ce6c-6624-4f31-ad0f-28a5ce32acad`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:09:06,261::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:07,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:09:07,023::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:09:07,023::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:07,263::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:08,024::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:09:08,024::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:09:08,024::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:09,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:09:09,026::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:09:09,026::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:09:09,026::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:09:09,170::task::579::TaskManager.Task::(_updateState) Task=`bc74d389-a002-4275-8b92-30d97b76108f`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:09:09,170::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:09:09,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:09:09,171::task::1168::TaskManager.Task::(prepare) Task=`bc74d389-a002-4275-8b92-30d97b76108f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:09:09,171::task::579::TaskManager.Task::(_updateState) Task=`bc74d389-a002-4275-8b92-30d97b76108f`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:09:09,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:09:09,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:09:09,171::task::974::TaskManager.Task::(_decref) Task=`bc74d389-a002-4275-8b92-30d97b76108f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:09:09,264::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:10,026::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:09:10,726::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:09:10,753::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00018263 s, 22.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:11,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:09:11,028::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:11,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:11,267::task::579::TaskManager.Task::(_updateState) Task=`193c8eab-eb57-4f03-aa62-f1cbea7a8550`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:09:11,268::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:09:11,268::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:09:11,268::task::1168::TaskManager.Task::(prepare) Task=`193c8eab-eb57-4f03-aa62-f1cbea7a8550`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:09:11,268::task::579::TaskManager.Task::(_updateState) Task=`193c8eab-eb57-4f03-aa62-f1cbea7a8550`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:09:11,269::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:09:11,269::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:09:11,269::task::974::TaskManager.Task::(_decref) Task=`193c8eab-eb57-4f03-aa62-f1cbea7a8550`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:09:11,272::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:09:11,272::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:09:11,273::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:11,276::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:11,277::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:12,029::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:09:12,801::task::579::TaskManager.Task::(_updateState) Task=`6226c7b3-9e7d-4a45-a9fd-39d8c42e3c9d`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:09:12,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:09:12,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:09:12,802::task::1168::TaskManager.Task::(prepare) Task=`6226c7b3-9e7d-4a45-a9fd-39d8c42e3c9d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:09:12,802::task::579::TaskManager.Task::(_updateState) Task=`6226c7b3-9e7d-4a45-a9fd-39d8c42e3c9d`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:09:12,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:09:12,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:09:12,803::task::974::TaskManager.Task::(_decref) Task=`6226c7b3-9e7d-4a45-a9fd-39d8c42e3c9d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:13,031::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:13,278::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:14,032::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:09:14,245::task::579::TaskManager.Task::(_updateState) Task=`909bd548-446f-4c76-88c7-c3a8be47a26a`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:09:14,245::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:09:14,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:09:14,246::task::1168::TaskManager.Task::(prepare) Task=`909bd548-446f-4c76-88c7-c3a8be47a26a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:09:14,246::task::579::TaskManager.Task::(_updateState) Task=`909bd548-446f-4c76-88c7-c3a8be47a26a`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:09:14,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:09:14,246::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:09:14,246::task::974::TaskManager.Task::(_decref) Task=`909bd548-446f-4c76-88c7-c3a8be47a26a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:09:14,360::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:09:14,376::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000366567 s, 996 kB/s\n'; <rc> = 0 >Thread-48925::DEBUG::2014-01-16 16:09:14,458::task::579::TaskManager.Task::(_updateState) Task=`24f1058d-db73-4bdd-9120-d66a113d950c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:09:14,458::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:09:14,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:09:14,459::task::1168::TaskManager.Task::(prepare) Task=`24f1058d-db73-4bdd-9120-d66a113d950c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:09:14,459::task::579::TaskManager.Task::(_updateState) Task=`24f1058d-db73-4bdd-9120-d66a113d950c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:09:14,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:09:14,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:09:14,459::task::974::TaskManager.Task::(_decref) Task=`24f1058d-db73-4bdd-9120-d66a113d950c`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:09:14,460::task::579::TaskManager.Task::(_updateState) Task=`c145f4f3-b0b1-4b26-adec-7d417161b6cf`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:09:14,460::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:09:14,460::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:09:14,460::task::1168::TaskManager.Task::(prepare) Task=`c145f4f3-b0b1-4b26-adec-7d417161b6cf`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:09:14,460::task::579::TaskManager.Task::(_updateState) Task=`c145f4f3-b0b1-4b26-adec-7d417161b6cf`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:09:14,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:09:14,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:09:14,461::task::974::TaskManager.Task::(_decref) Task=`c145f4f3-b0b1-4b26-adec-7d417161b6cf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:15,034::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:15,280::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:16,035::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:16,281::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:17,036::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:09:17,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:17,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:18,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:19,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:19,285::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:20,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:09:20,759::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:09:20,785::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024247 s, 16.9 MB/s\n'; <rc> = 0 >Thread-189046::DEBUG::2014-01-16 16:09:20,880::task::579::TaskManager.Task::(_updateState) Task=`32b85f0f-bebf-40ce-b79f-dc432a68fc18`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:09:20,880::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:09:20,881::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:09:20,881::task::1168::TaskManager.Task::(prepare) Task=`32b85f0f-bebf-40ce-b79f-dc432a68fc18`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:09:20,881::task::579::TaskManager.Task::(_updateState) Task=`32b85f0f-bebf-40ce-b79f-dc432a68fc18`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:09:20,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:09:20,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:09:20,882::task::974::TaskManager.Task::(_decref) Task=`32b85f0f-bebf-40ce-b79f-dc432a68fc18`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:21,040::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:21,286::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:21,287::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286201::DEBUG::2014-01-16 16:09:21,784::task::579::TaskManager.Task::(_updateState) Task=`7ace8ccf-eea9-4129-aea6-5a5754ddf5c9`::moving from state init -> state preparing >Thread-286201::INFO::2014-01-16 16:09:21,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286201::INFO::2014-01-16 16:09:21,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000366567', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024247', 'lastCheck': '1.0', 'valid': True}} >Thread-286201::DEBUG::2014-01-16 16:09:21,784::task::1168::TaskManager.Task::(prepare) Task=`7ace8ccf-eea9-4129-aea6-5a5754ddf5c9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000366567', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024247', 'lastCheck': '1.0', 'valid': True}} >Thread-286201::DEBUG::2014-01-16 16:09:21,785::task::579::TaskManager.Task::(_updateState) Task=`7ace8ccf-eea9-4129-aea6-5a5754ddf5c9`::moving from state preparing -> state finished >Thread-286201::DEBUG::2014-01-16 16:09:21,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286201::DEBUG::2014-01-16 16:09:21,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286201::DEBUG::2014-01-16 16:09:21,785::task::974::TaskManager.Task::(_decref) Task=`7ace8ccf-eea9-4129-aea6-5a5754ddf5c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:22,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:09:22,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:09:22,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:09:22,946::task::579::TaskManager.Task::(_updateState) Task=`fe4dcaab-f3c4-4473-b0f3-f8bf29e2a9bb`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:09:22,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:09:22,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:09:22,947::task::1168::TaskManager.Task::(prepare) Task=`fe4dcaab-f3c4-4473-b0f3-f8bf29e2a9bb`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:09:22,947::task::579::TaskManager.Task::(_updateState) Task=`fe4dcaab-f3c4-4473-b0f3-f8bf29e2a9bb`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:09:22,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:09:22,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:09:22,947::task::974::TaskManager.Task::(_decref) Task=`fe4dcaab-f3c4-4473-b0f3-f8bf29e2a9bb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:23,042::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:09:23,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:23,288::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:24,044::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:09:24,044::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:09:24,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:09:24,384::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:09:24,400::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000339341 s, 1.1 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:09:24,436::task::579::TaskManager.Task::(_updateState) Task=`0c9f17bd-4e00-476c-8cf3-b6b04b7785e1`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:09:24,437::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:09:24,437::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:09:24,437::task::1168::TaskManager.Task::(prepare) Task=`0c9f17bd-4e00-476c-8cf3-b6b04b7785e1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:09:24,437::task::579::TaskManager.Task::(_updateState) Task=`0c9f17bd-4e00-476c-8cf3-b6b04b7785e1`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:09:24,438::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:09:24,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:09:24,438::task::974::TaskManager.Task::(_decref) Task=`0c9f17bd-4e00-476c-8cf3-b6b04b7785e1`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:09:24,522::task::579::TaskManager.Task::(_updateState) Task=`50372c92-9ccd-4417-a024-30a37424812e`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:09:24,522::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:09:24,522::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:09:24,522::task::1168::TaskManager.Task::(prepare) Task=`50372c92-9ccd-4417-a024-30a37424812e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:09:24,523::task::579::TaskManager.Task::(_updateState) Task=`50372c92-9ccd-4417-a024-30a37424812e`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:09:24,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:09:24,523::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:09:24,523::task::974::TaskManager.Task::(_decref) Task=`50372c92-9ccd-4417-a024-30a37424812e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:25,046::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:09:25,046::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:25,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:26,048::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:09:26,048::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:26,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:09:26,292::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:09:26,293::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:27,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:27,294::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:28,050::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:09:28,050::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:29,050::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:09:29,051::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:29,296::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:09:29,317::task::579::TaskManager.Task::(_updateState) Task=`1f3a003e-6c42-4e7a-baf2-a9a4074fc77e`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:09:29,317::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:09:29,318::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:09:29,318::task::1168::TaskManager.Task::(prepare) Task=`1f3a003e-6c42-4e7a-baf2-a9a4074fc77e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:09:29,318::task::579::TaskManager.Task::(_updateState) Task=`1f3a003e-6c42-4e7a-baf2-a9a4074fc77e`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:09:29,318::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:09:29,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:09:29,318::task::974::TaskManager.Task::(_decref) Task=`1f3a003e-6c42-4e7a-baf2-a9a4074fc77e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:30,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:09:30,052::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:09:30,052::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:09:30,052::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:09:30,791::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:09:30,814::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00225667 s, 1.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:31,053::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:09:31,053::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:09:31,054::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:31,298::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:31,299::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:32,054::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:09:32,055::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:09:32,224::task::579::TaskManager.Task::(_updateState) Task=`de897983-d7e7-4a0b-8146-bca8ab490573`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:09:32,225::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:09:32,226::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:09:32,226::task::1168::TaskManager.Task::(prepare) Task=`de897983-d7e7-4a0b-8146-bca8ab490573`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:09:32,226::task::579::TaskManager.Task::(_updateState) Task=`de897983-d7e7-4a0b-8146-bca8ab490573`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:09:32,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:09:32,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:09:32,227::task::974::TaskManager.Task::(_decref) Task=`de897983-d7e7-4a0b-8146-bca8ab490573`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:09:32,834::task::579::TaskManager.Task::(_updateState) Task=`314acf2b-3e11-4eb8-b252-44d849283645`::moving from state init -> state preparing >Thread-16398::DEBUG::2014-01-16 16:09:32,835::task::579::TaskManager.Task::(_updateState) Task=`dc53b8ee-9b85-4d89-b75f-dfa531afd04a`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:09:32,835::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16398::INFO::2014-01-16 16:09:32,836::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16393::INFO::2014-01-16 16:09:32,837::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:09:32,838::task::1168::TaskManager.Task::(prepare) Task=`314acf2b-3e11-4eb8-b252-44d849283645`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::INFO::2014-01-16 16:09:32,838::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:09:32,839::task::579::TaskManager.Task::(_updateState) Task=`314acf2b-3e11-4eb8-b252-44d849283645`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:09:32,839::task::1168::TaskManager.Task::(prepare) Task=`dc53b8ee-9b85-4d89-b75f-dfa531afd04a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:09:32,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:09:32,840::task::579::TaskManager.Task::(_updateState) Task=`dc53b8ee-9b85-4d89-b75f-dfa531afd04a`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:09:32,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:09:32,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:09:32,842::task::974::TaskManager.Task::(_decref) Task=`314acf2b-3e11-4eb8-b252-44d849283645`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:09:32,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:09:32,843::task::974::TaskManager.Task::(_decref) Task=`dc53b8ee-9b85-4d89-b75f-dfa531afd04a`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:09:32,883::task::579::TaskManager.Task::(_updateState) Task=`061f79ce-ef65-4852-b783-4cb135fb017b`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:09:32,884::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:09:32,884::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:09:32,884::task::1168::TaskManager.Task::(prepare) Task=`061f79ce-ef65-4852-b783-4cb135fb017b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:09:32,884::task::579::TaskManager.Task::(_updateState) Task=`061f79ce-ef65-4852-b783-4cb135fb017b`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:09:32,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:09:32,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:09:32,885::task::974::TaskManager.Task::(_decref) Task=`061f79ce-ef65-4852-b783-4cb135fb017b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:33,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:09:33,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:09:33,057::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:09:33,057::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:33,300::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:09:33,865::task::579::TaskManager.Task::(_updateState) Task=`ffde1fe9-a676-4d46-8a5d-bc10734aff84`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:09:33,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:09:33,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:09:33,866::task::1168::TaskManager.Task::(prepare) Task=`ffde1fe9-a676-4d46-8a5d-bc10734aff84`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:09:33,866::task::579::TaskManager.Task::(_updateState) Task=`ffde1fe9-a676-4d46-8a5d-bc10734aff84`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:09:33,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:09:33,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:09:33,867::task::974::TaskManager.Task::(_decref) Task=`ffde1fe9-a676-4d46-8a5d-bc10734aff84`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:09:33,910::task::579::TaskManager.Task::(_updateState) Task=`27e4b7a2-0bc2-44cc-905f-45b1481a7a9a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:09:33,910::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:09:33,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:09:33,910::task::1168::TaskManager.Task::(prepare) Task=`27e4b7a2-0bc2-44cc-905f-45b1481a7a9a`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:09:33,910::task::579::TaskManager.Task::(_updateState) Task=`27e4b7a2-0bc2-44cc-905f-45b1481a7a9a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:09:33,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:09:33,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:09:33,911::task::974::TaskManager.Task::(_decref) Task=`27e4b7a2-0bc2-44cc-905f-45b1481a7a9a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:09:33,911::task::579::TaskManager.Task::(_updateState) Task=`e65fc32d-a67e-41a6-8861-2b97eb146627`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:09:33,911::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:09:33,912::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:09:33,912::task::1168::TaskManager.Task::(prepare) Task=`e65fc32d-a67e-41a6-8861-2b97eb146627`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:09:33,912::task::579::TaskManager.Task::(_updateState) Task=`e65fc32d-a67e-41a6-8861-2b97eb146627`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:09:33,912::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:09:33,912::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:09:33,912::task::974::TaskManager.Task::(_decref) Task=`e65fc32d-a67e-41a6-8861-2b97eb146627`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:09:33,912::task::579::TaskManager.Task::(_updateState) Task=`725b4c23-ff23-45c6-be22-d5f3c09ca2e2`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:09:33,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:09:33,913::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:09:33,913::task::1168::TaskManager.Task::(prepare) Task=`725b4c23-ff23-45c6-be22-d5f3c09ca2e2`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:09:33,913::task::579::TaskManager.Task::(_updateState) Task=`725b4c23-ff23-45c6-be22-d5f3c09ca2e2`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:09:33,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:09:33,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:09:33,913::task::974::TaskManager.Task::(_decref) Task=`725b4c23-ff23-45c6-be22-d5f3c09ca2e2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:34,058::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 16:09:34,211::task::579::TaskManager.Task::(_updateState) Task=`452be31f-1315-402f-ae10-5cec91fdd1cd`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:09:34,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:09:34,212::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:09:34,212::task::1168::TaskManager.Task::(prepare) Task=`452be31f-1315-402f-ae10-5cec91fdd1cd`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:09:34,212::task::579::TaskManager.Task::(_updateState) Task=`452be31f-1315-402f-ae10-5cec91fdd1cd`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:09:34,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:09:34,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:09:34,212::task::974::TaskManager.Task::(_decref) Task=`452be31f-1315-402f-ae10-5cec91fdd1cd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:09:34,408::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:09:34,424::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297629 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:35,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:09:35,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:09:35,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:09:35,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:35,060::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:09:35,060::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:09:35,302::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:36,061::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:36,303::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:37,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:09:37,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:09:37,063::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:37,305::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286207::DEBUG::2014-01-16 16:09:37,684::task::579::TaskManager.Task::(_updateState) Task=`69c73074-1307-4415-8f39-57310c64afb5`::moving from state init -> state preparing >Thread-286207::INFO::2014-01-16 16:09:37,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286207::INFO::2014-01-16 16:09:37,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297629', 'lastCheck': '3.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00225667', 'lastCheck': '6.9', 'valid': True}} >Thread-286207::DEBUG::2014-01-16 16:09:37,684::task::1168::TaskManager.Task::(prepare) Task=`69c73074-1307-4415-8f39-57310c64afb5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297629', 'lastCheck': '3.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00225667', 'lastCheck': '6.9', 'valid': True}} >Thread-286207::DEBUG::2014-01-16 16:09:37,684::task::579::TaskManager.Task::(_updateState) Task=`69c73074-1307-4415-8f39-57310c64afb5`::moving from state preparing -> state finished >Thread-286207::DEBUG::2014-01-16 16:09:37,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286207::DEBUG::2014-01-16 16:09:37,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286207::DEBUG::2014-01-16 16:09:37,685::task::974::TaskManager.Task::(_decref) Task=`69c73074-1307-4415-8f39-57310c64afb5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:38,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:09:38,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:09:38,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:39,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:09:39,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:09:39,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:09:39,066::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:39,306::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:40,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:09:40,821::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:09:40,846::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268296 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:41,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:09:41,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:41,308::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:41,310::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:09:41,311::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:09:41,312::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:09:41,856::task::579::TaskManager.Task::(_updateState) Task=`bf87ef72-77d4-4fd4-ba96-292703d21705`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:09:41,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:09:41,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:09:41,857::task::1168::TaskManager.Task::(prepare) Task=`bf87ef72-77d4-4fd4-ba96-292703d21705`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:09:41,857::task::579::TaskManager.Task::(_updateState) Task=`bf87ef72-77d4-4fd4-ba96-292703d21705`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:09:41,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:09:41,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:09:41,858::task::974::TaskManager.Task::(_decref) Task=`bf87ef72-77d4-4fd4-ba96-292703d21705`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:42,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:43,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:43,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:44,072::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:09:44,432::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:09:44,448::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000295256 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:45,073::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:45,315::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:09:45,878::task::579::TaskManager.Task::(_updateState) Task=`058a7060-1d5a-4136-ad4f-41ab6841ffb2`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:09:45,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:09:45,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:09:45,879::task::1168::TaskManager.Task::(prepare) Task=`058a7060-1d5a-4136-ad4f-41ab6841ffb2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:09:45,879::task::579::TaskManager.Task::(_updateState) Task=`058a7060-1d5a-4136-ad4f-41ab6841ffb2`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:09:45,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:09:45,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:09:45,880::task::974::TaskManager.Task::(_decref) Task=`058a7060-1d5a-4136-ad4f-41ab6841ffb2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:09:45,936::task::579::TaskManager.Task::(_updateState) Task=`48c42e2c-fdc4-452e-9268-e4674aca54f3`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:09:45,936::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:09:45,937::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:09:45,937::task::1168::TaskManager.Task::(prepare) Task=`48c42e2c-fdc4-452e-9268-e4674aca54f3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:09:45,937::task::579::TaskManager.Task::(_updateState) Task=`48c42e2c-fdc4-452e-9268-e4674aca54f3`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:09:45,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:09:45,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:09:45,937::task::974::TaskManager.Task::(_decref) Task=`48c42e2c-fdc4-452e-9268-e4674aca54f3`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:09:45,938::task::579::TaskManager.Task::(_updateState) Task=`f3d2e3ed-65a4-45a1-883b-c655c154177d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:09:45,938::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:09:45,938::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:09:45,938::task::1168::TaskManager.Task::(prepare) Task=`f3d2e3ed-65a4-45a1-883b-c655c154177d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:09:45,938::task::579::TaskManager.Task::(_updateState) Task=`f3d2e3ed-65a4-45a1-883b-c655c154177d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:09:45,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:09:45,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:09:45,939::task::974::TaskManager.Task::(_decref) Task=`f3d2e3ed-65a4-45a1-883b-c655c154177d`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:09:45,939::task::579::TaskManager.Task::(_updateState) Task=`9ca01926-21fa-485c-ba3f-c59c90165132`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:09:45,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:09:45,939::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:09:45,939::task::1168::TaskManager.Task::(prepare) Task=`9ca01926-21fa-485c-ba3f-c59c90165132`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:09:45,939::task::579::TaskManager.Task::(_updateState) Task=`9ca01926-21fa-485c-ba3f-c59c90165132`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:09:45,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:09:45,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:09:45,940::task::974::TaskManager.Task::(_decref) Task=`9ca01926-21fa-485c-ba3f-c59c90165132`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:46,074::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:46,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:47,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:09:47,076::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:47,318::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:48,077::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:49,078::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:49,320::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:50,078::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:09:50,851::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:09:50,872::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00406177 s, 1.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:51,079::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:51,322::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:09:51,323::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:52,081::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:09:52,081::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:09:52,081::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:09:52,873::task::579::TaskManager.Task::(_updateState) Task=`b361589e-29c5-4f3c-b5ac-246298701290`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:09:52,873::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:09:52,874::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:09:52,874::task::1168::TaskManager.Task::(prepare) Task=`b361589e-29c5-4f3c-b5ac-246298701290`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:09:52,874::task::579::TaskManager.Task::(_updateState) Task=`b361589e-29c5-4f3c-b5ac-246298701290`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:09:52,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:09:52,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:09:52,874::task::974::TaskManager.Task::(_decref) Task=`b361589e-29c5-4f3c-b5ac-246298701290`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:53,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:09:53,082::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:53,325::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286213::DEBUG::2014-01-16 16:09:53,623::task::579::TaskManager.Task::(_updateState) Task=`99af1098-6215-466a-b71c-83631c8fbeb0`::moving from state init -> state preparing >Thread-286213::INFO::2014-01-16 16:09:53,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286213::INFO::2014-01-16 16:09:53,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295256', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00406177', 'lastCheck': '2.7', 'valid': True}} >Thread-286213::DEBUG::2014-01-16 16:09:53,624::task::1168::TaskManager.Task::(prepare) Task=`99af1098-6215-466a-b71c-83631c8fbeb0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295256', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00406177', 'lastCheck': '2.7', 'valid': True}} >Thread-286213::DEBUG::2014-01-16 16:09:53,624::task::579::TaskManager.Task::(_updateState) Task=`99af1098-6215-466a-b71c-83631c8fbeb0`::moving from state preparing -> state finished >Thread-286213::DEBUG::2014-01-16 16:09:53,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286213::DEBUG::2014-01-16 16:09:53,624::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286213::DEBUG::2014-01-16 16:09:53,624::task::974::TaskManager.Task::(_decref) Task=`99af1098-6215-466a-b71c-83631c8fbeb0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:54,084::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:09:54,084::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:09:54,084::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:09:54,455::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:09:54,472::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000302563 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:09:55,085::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:09:55,085::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:55,326::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:56,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:09:56,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:56,329::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:09:56,329::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:09:56,331::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:09:56,510::task::579::TaskManager.Task::(_updateState) Task=`d4d36cd6-139b-46bc-8106-7aceaebaaa78`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:09:56,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:09:56,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:09:56,511::task::1168::TaskManager.Task::(prepare) Task=`d4d36cd6-139b-46bc-8106-7aceaebaaa78`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:09:56,511::task::579::TaskManager.Task::(_updateState) Task=`d4d36cd6-139b-46bc-8106-7aceaebaaa78`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:09:56,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:09:56,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:09:56,512::task::974::TaskManager.Task::(_decref) Task=`d4d36cd6-139b-46bc-8106-7aceaebaaa78`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:09:56,512::task::579::TaskManager.Task::(_updateState) Task=`f323887f-18db-4fcd-977a-20e6d8f05942`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:09:56,512::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:09:56,513::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:09:56,513::task::1168::TaskManager.Task::(prepare) Task=`f323887f-18db-4fcd-977a-20e6d8f05942`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:09:56,513::task::579::TaskManager.Task::(_updateState) Task=`f323887f-18db-4fcd-977a-20e6d8f05942`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:09:56,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:09:56,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:09:56,513::task::974::TaskManager.Task::(_decref) Task=`f323887f-18db-4fcd-977a-20e6d8f05942`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:09:57,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:57,332::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:09:58,089::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:09:58,089::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:09:59,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:09:59,090::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:09:59,334::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:10:00,023::task::579::TaskManager.Task::(_updateState) Task=`2a9cd01d-2054-47e4-9852-a5ea2aabcf1a`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:10:00,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:10:00,024::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:10:00,024::task::1168::TaskManager.Task::(prepare) Task=`2a9cd01d-2054-47e4-9852-a5ea2aabcf1a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:10:00,024::task::579::TaskManager.Task::(_updateState) Task=`2a9cd01d-2054-47e4-9852-a5ea2aabcf1a`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:10:00,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:10:00,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:10:00,024::task::974::TaskManager.Task::(_decref) Task=`2a9cd01d-2054-47e4-9852-a5ea2aabcf1a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:00,091::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:10:00,091::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:10:00,092::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:10:00,092::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:00,876::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:10:00,877::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:10:00,877::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:10:00,877::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:10:00,879::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:00,901::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000327929 s, 6.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:10:00,902::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000327929 s, 6.2 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:10:00,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:10:00,904::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:10:00,904::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:10:00,904::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:10:00,904::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:10:00,905::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:10:00,905::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:10:00,905::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:10:00,906::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:10:01,092::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:10:01,093::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:10:01,093::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:01,117::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:10:01,120::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:10:01,120::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:10:01,122::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:10:01,122::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:10:01,122::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:10:01,123::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:01,291::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:10:01,294::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:01,310::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000211988 s, 19.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:10:01,336::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:01,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:02,095::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:10:02,095::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:10:02,793::task::579::TaskManager.Task::(_updateState) Task=`f4752460-6341-4f2f-86f7-a720477b23fb`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:10:02,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:10:02,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:10:02,794::task::1168::TaskManager.Task::(prepare) Task=`f4752460-6341-4f2f-86f7-a720477b23fb`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:10:02,794::task::579::TaskManager.Task::(_updateState) Task=`f4752460-6341-4f2f-86f7-a720477b23fb`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:10:02,794::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:10:02,795::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:10:02,795::task::974::TaskManager.Task::(_decref) Task=`f4752460-6341-4f2f-86f7-a720477b23fb`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:10:02,795::task::579::TaskManager.Task::(_updateState) Task=`97af7384-cffd-458f-b44d-a7d05ac0de3f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:10:02,795::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:10:02,795::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:10:02,796::task::1168::TaskManager.Task::(prepare) Task=`97af7384-cffd-458f-b44d-a7d05ac0de3f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:10:02,796::task::579::TaskManager.Task::(_updateState) Task=`97af7384-cffd-458f-b44d-a7d05ac0de3f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:10:02,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:10:02,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:10:02,796::task::974::TaskManager.Task::(_decref) Task=`97af7384-cffd-458f-b44d-a7d05ac0de3f`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:10:03,047::task::579::TaskManager.Task::(_updateState) Task=`c2487c85-c50e-43ce-86d3-8fc2d5c93d4f`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:10:03,048::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:10:03,048::task::579::TaskManager.Task::(_updateState) Task=`75c36846-d18c-4204-99e9-359fc7461f61`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:10:03,049::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:10:03,049::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:10:03,050::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:10:03,050::task::1168::TaskManager.Task::(prepare) Task=`c2487c85-c50e-43ce-86d3-8fc2d5c93d4f`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:10:03,050::task::1168::TaskManager.Task::(prepare) Task=`75c36846-d18c-4204-99e9-359fc7461f61`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:10:03,050::task::579::TaskManager.Task::(_updateState) Task=`c2487c85-c50e-43ce-86d3-8fc2d5c93d4f`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:10:03,051::task::579::TaskManager.Task::(_updateState) Task=`75c36846-d18c-4204-99e9-359fc7461f61`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:10:03,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:10:03,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:10:03,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:10:03,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:10:03,052::task::974::TaskManager.Task::(_decref) Task=`c2487c85-c50e-43ce-86d3-8fc2d5c93d4f`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:10:03,052::task::974::TaskManager.Task::(_decref) Task=`75c36846-d18c-4204-99e9-359fc7461f61`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:03,096::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:10:03,097::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:10:03,097::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:10:03,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:03,338::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:04,098::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:10:04,181::task::579::TaskManager.Task::(_updateState) Task=`9127bada-4a59-4e32-a625-1a8cb1889143`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:10:04,181::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:10:04,183::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:10:04,183::task::1168::TaskManager.Task::(prepare) Task=`9127bada-4a59-4e32-a625-1a8cb1889143`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:10:04,183::task::579::TaskManager.Task::(_updateState) Task=`9127bada-4a59-4e32-a625-1a8cb1889143`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:10:04,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:10:04,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:10:04,183::task::974::TaskManager.Task::(_decref) Task=`9127bada-4a59-4e32-a625-1a8cb1889143`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:10:04,184::task::579::TaskManager.Task::(_updateState) Task=`94c3fc94-86ef-4131-862b-e5957a7e3145`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:10:04,184::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:10:04,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:10:04,184::task::1168::TaskManager.Task::(prepare) Task=`94c3fc94-86ef-4131-862b-e5957a7e3145`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:10:04,184::task::579::TaskManager.Task::(_updateState) Task=`94c3fc94-86ef-4131-862b-e5957a7e3145`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:10:04,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:10:04,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:10:04,185::task::974::TaskManager.Task::(_decref) Task=`94c3fc94-86ef-4131-862b-e5957a7e3145`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:10:04,311::task::579::TaskManager.Task::(_updateState) Task=`d736b01d-61ca-4f50-b290-a8125e1c8b83`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:10:04,311::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:10:04,312::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:10:04,312::task::1168::TaskManager.Task::(prepare) Task=`d736b01d-61ca-4f50-b290-a8125e1c8b83`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:10:04,312::task::579::TaskManager.Task::(_updateState) Task=`d736b01d-61ca-4f50-b290-a8125e1c8b83`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:10:04,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:10:04,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:10:04,313::task::974::TaskManager.Task::(_decref) Task=`d736b01d-61ca-4f50-b290-a8125e1c8b83`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:10:04,481::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:10:04,496::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00031129 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:10:04,510::task::579::TaskManager.Task::(_updateState) Task=`2856530b-f5a9-469c-91ef-dd0ce35acda7`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:10:04,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:10:04,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:10:04,511::task::1168::TaskManager.Task::(prepare) Task=`2856530b-f5a9-469c-91ef-dd0ce35acda7`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:10:04,511::task::579::TaskManager.Task::(_updateState) Task=`2856530b-f5a9-469c-91ef-dd0ce35acda7`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:10:04,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:10:04,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:10:04,511::task::974::TaskManager.Task::(_decref) Task=`2856530b-f5a9-469c-91ef-dd0ce35acda7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:05,099::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:10:05,099::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:10:05,100::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:10:05,100::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:05,100::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:10:05,101::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:10:05,340::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:10:05,405::task::579::TaskManager.Task::(_updateState) Task=`2a82533f-e5bf-48cf-a1d7-8c65de2375af`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:10:05,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:10:05,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:10:05,406::task::1168::TaskManager.Task::(prepare) Task=`2a82533f-e5bf-48cf-a1d7-8c65de2375af`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:10:05,406::task::579::TaskManager.Task::(_updateState) Task=`2a82533f-e5bf-48cf-a1d7-8c65de2375af`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:10:05,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:10:05,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:10:05,407::task::974::TaskManager.Task::(_decref) Task=`2a82533f-e5bf-48cf-a1d7-8c65de2375af`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:06,102::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:10:06,312::task::579::TaskManager.Task::(_updateState) Task=`b3552a74-ed52-4484-bb51-6d0b919d50b7`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:10:06,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:10:06,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:10:06,313::task::1168::TaskManager.Task::(prepare) Task=`b3552a74-ed52-4484-bb51-6d0b919d50b7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:10:06,313::task::579::TaskManager.Task::(_updateState) Task=`b3552a74-ed52-4484-bb51-6d0b919d50b7`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:10:06,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:10:06,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:10:06,313::task::974::TaskManager.Task::(_decref) Task=`b3552a74-ed52-4484-bb51-6d0b919d50b7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:10:06,342::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:07,104::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:10:07,104::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:10:07,104::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:07,343::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:08,105::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:10:08,105::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:10:08,105::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:09,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:10:09,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:10:09,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:10:09,106::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:09,344::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:10:09,352::task::579::TaskManager.Task::(_updateState) Task=`44c1b5e5-2b0e-440b-928c-3cdf59493886`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:10:09,353::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:10:09,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:10:09,353::task::1168::TaskManager.Task::(prepare) Task=`44c1b5e5-2b0e-440b-928c-3cdf59493886`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:10:09,353::task::579::TaskManager.Task::(_updateState) Task=`44c1b5e5-2b0e-440b-928c-3cdf59493886`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:10:09,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:10:09,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:10:09,354::task::974::TaskManager.Task::(_decref) Task=`44c1b5e5-2b0e-440b-928c-3cdf59493886`::ref 0 aborting False >Thread-286219::DEBUG::2014-01-16 16:10:09,399::task::579::TaskManager.Task::(_updateState) Task=`ea50d7bf-8265-4a6b-a01f-81f8cc526e89`::moving from state init -> state preparing >Thread-286219::INFO::2014-01-16 16:10:09,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286219::INFO::2014-01-16 16:10:09,400::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031129', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000211988', 'lastCheck': '8.1', 'valid': True}} >Thread-286219::DEBUG::2014-01-16 16:10:09,400::task::1168::TaskManager.Task::(prepare) Task=`ea50d7bf-8265-4a6b-a01f-81f8cc526e89`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031129', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000211988', 'lastCheck': '8.1', 'valid': True}} >Thread-286219::DEBUG::2014-01-16 16:10:09,400::task::579::TaskManager.Task::(_updateState) Task=`ea50d7bf-8265-4a6b-a01f-81f8cc526e89`::moving from state preparing -> state finished >Thread-286219::DEBUG::2014-01-16 16:10:09,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286219::DEBUG::2014-01-16 16:10:09,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286219::DEBUG::2014-01-16 16:10:09,400::task::974::TaskManager.Task::(_decref) Task=`ea50d7bf-8265-4a6b-a01f-81f8cc526e89`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:10,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:11,108::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:10:11,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:11,316::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:11,331::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000187554 s, 21.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:10:11,346::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:11,347::task::579::TaskManager.Task::(_updateState) Task=`8f2ea683-295d-4725-aeba-0c7f42e1581f`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:10:11,347::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:10:11,348::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:10:11,348::task::1168::TaskManager.Task::(prepare) Task=`8f2ea683-295d-4725-aeba-0c7f42e1581f`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:10:11,348::task::579::TaskManager.Task::(_updateState) Task=`8f2ea683-295d-4725-aeba-0c7f42e1581f`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:10:11,348::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:10:11,349::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:10:11,349::task::974::TaskManager.Task::(_decref) Task=`8f2ea683-295d-4725-aeba-0c7f42e1581f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:10:11,351::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:10:11,351::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:10:11,359::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:11,361::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:11,362::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:12,110::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:10:12,982::task::579::TaskManager.Task::(_updateState) Task=`b063a3b8-c3ad-4ba5-acb0-7fc637077f21`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:10:12,983::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:10:12,983::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:10:12,983::task::1168::TaskManager.Task::(prepare) Task=`b063a3b8-c3ad-4ba5-acb0-7fc637077f21`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:10:12,984::task::579::TaskManager.Task::(_updateState) Task=`b063a3b8-c3ad-4ba5-acb0-7fc637077f21`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:10:12,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:10:12,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:10:12,984::task::974::TaskManager.Task::(_decref) Task=`b063a3b8-c3ad-4ba5-acb0-7fc637077f21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:13,110::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:13,364::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:14,111::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:10:14,326::task::579::TaskManager.Task::(_updateState) Task=`79a7438b-99ad-42f7-ac2e-26ebe54bfa7a`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:10:14,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:10:14,328::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:10:14,328::task::1168::TaskManager.Task::(prepare) Task=`79a7438b-99ad-42f7-ac2e-26ebe54bfa7a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:10:14,328::task::579::TaskManager.Task::(_updateState) Task=`79a7438b-99ad-42f7-ac2e-26ebe54bfa7a`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:10:14,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:10:14,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:10:14,328::task::974::TaskManager.Task::(_decref) Task=`79a7438b-99ad-42f7-ac2e-26ebe54bfa7a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:10:14,504::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:10:14,519::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266213 s, 1.4 MB/s\n'; <rc> = 0 >Thread-48925::DEBUG::2014-01-16 16:10:14,843::task::579::TaskManager.Task::(_updateState) Task=`a969a766-a134-4630-a4fd-bead744f9b3a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:10:14,843::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:10:14,844::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:10:14,844::task::1168::TaskManager.Task::(prepare) Task=`a969a766-a134-4630-a4fd-bead744f9b3a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:10:14,844::task::579::TaskManager.Task::(_updateState) Task=`a969a766-a134-4630-a4fd-bead744f9b3a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:10:14,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:10:14,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:10:14,845::task::974::TaskManager.Task::(_decref) Task=`a969a766-a134-4630-a4fd-bead744f9b3a`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:10:14,845::task::579::TaskManager.Task::(_updateState) Task=`9d94b970-ac62-467b-8d13-aed9099cd585`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:10:14,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:10:14,845::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:10:14,846::task::1168::TaskManager.Task::(prepare) Task=`9d94b970-ac62-467b-8d13-aed9099cd585`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:10:14,846::task::579::TaskManager.Task::(_updateState) Task=`9d94b970-ac62-467b-8d13-aed9099cd585`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:10:14,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:10:14,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:10:14,846::task::974::TaskManager.Task::(_decref) Task=`9d94b970-ac62-467b-8d13-aed9099cd585`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:15,113::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:15,366::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:16,113::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:16,367::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:17,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:10:17,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:17,368::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:18,116::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:19,117::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:19,370::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:20,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:10:21,053::task::579::TaskManager.Task::(_updateState) Task=`10410516-a01d-49f8-9506-ee33ec76ede6`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:10:21,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:10:21,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:10:21,054::task::1168::TaskManager.Task::(prepare) Task=`10410516-a01d-49f8-9506-ee33ec76ede6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:10:21,054::task::579::TaskManager.Task::(_updateState) Task=`10410516-a01d-49f8-9506-ee33ec76ede6`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:10:21,055::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:10:21,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:10:21,055::task::974::TaskManager.Task::(_decref) Task=`10410516-a01d-49f8-9506-ee33ec76ede6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:21,119::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:21,336::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:21,353::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000282944 s, 14.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:10:21,371::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:21,373::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:22,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:10:22,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:10:22,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:10:23,011::task::579::TaskManager.Task::(_updateState) Task=`7d7f1502-b7f8-4dbc-a0ae-2859e32c865f`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:10:23,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:10:23,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:10:23,014::task::1168::TaskManager.Task::(prepare) Task=`7d7f1502-b7f8-4dbc-a0ae-2859e32c865f`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:10:23,014::task::579::TaskManager.Task::(_updateState) Task=`7d7f1502-b7f8-4dbc-a0ae-2859e32c865f`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:10:23,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:10:23,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:10:23,015::task::974::TaskManager.Task::(_decref) Task=`7d7f1502-b7f8-4dbc-a0ae-2859e32c865f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:23,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:10:23,123::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:23,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:24,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:10:24,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:10:24,125::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:10:24,529::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:10:24,547::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291185 s, 1.3 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:10:24,607::task::579::TaskManager.Task::(_updateState) Task=`8baef9c4-8fcd-4152-ac7d-c5c2c3ad9ae0`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:10:24,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:10:24,608::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:10:24,608::task::1168::TaskManager.Task::(prepare) Task=`8baef9c4-8fcd-4152-ac7d-c5c2c3ad9ae0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:10:24,608::task::579::TaskManager.Task::(_updateState) Task=`8baef9c4-8fcd-4152-ac7d-c5c2c3ad9ae0`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:10:24,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:10:24,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:10:24,609::task::974::TaskManager.Task::(_decref) Task=`8baef9c4-8fcd-4152-ac7d-c5c2c3ad9ae0`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:10:24,690::task::579::TaskManager.Task::(_updateState) Task=`c12e0bad-3b2f-49ad-ad3e-66d5cfc57d13`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:10:24,690::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:10:24,691::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:10:24,691::task::1168::TaskManager.Task::(prepare) Task=`c12e0bad-3b2f-49ad-ad3e-66d5cfc57d13`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:10:24,691::task::579::TaskManager.Task::(_updateState) Task=`c12e0bad-3b2f-49ad-ad3e-66d5cfc57d13`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:10:24,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:10:24,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:10:24,691::task::974::TaskManager.Task::(_decref) Task=`c12e0bad-3b2f-49ad-ad3e-66d5cfc57d13`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:25,126::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:10:25,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286225::DEBUG::2014-01-16 16:10:25,321::task::579::TaskManager.Task::(_updateState) Task=`75d77fd0-f8f7-4cef-9c6d-f907b6d8b3ea`::moving from state init -> state preparing >Thread-286225::INFO::2014-01-16 16:10:25,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286225::INFO::2014-01-16 16:10:25,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291185', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282944', 'lastCheck': '4.0', 'valid': True}} >Thread-286225::DEBUG::2014-01-16 16:10:25,322::task::1168::TaskManager.Task::(prepare) Task=`75d77fd0-f8f7-4cef-9c6d-f907b6d8b3ea`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291185', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282944', 'lastCheck': '4.0', 'valid': True}} >Thread-286225::DEBUG::2014-01-16 16:10:25,322::task::579::TaskManager.Task::(_updateState) Task=`75d77fd0-f8f7-4cef-9c6d-f907b6d8b3ea`::moving from state preparing -> state finished >Thread-286225::DEBUG::2014-01-16 16:10:25,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286225::DEBUG::2014-01-16 16:10:25,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286225::DEBUG::2014-01-16 16:10:25,322::task::974::TaskManager.Task::(_decref) Task=`75d77fd0-f8f7-4cef-9c6d-f907b6d8b3ea`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:10:25,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:26,128::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:10:26,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:26,378::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:10:26,378::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:10:26,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:27,129::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:27,388::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:28,130::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:10:28,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:29,132::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:10:29,132::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:29,389::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:10:29,493::task::579::TaskManager.Task::(_updateState) Task=`fbd17aa1-c0fb-4abd-b89d-4d7795558c60`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:10:29,494::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:10:29,494::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:10:29,494::task::1168::TaskManager.Task::(prepare) Task=`fbd17aa1-c0fb-4abd-b89d-4d7795558c60`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:10:29,494::task::579::TaskManager.Task::(_updateState) Task=`fbd17aa1-c0fb-4abd-b89d-4d7795558c60`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:10:29,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:10:29,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:10:29,495::task::974::TaskManager.Task::(_decref) Task=`fbd17aa1-c0fb-4abd-b89d-4d7795558c60`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:30,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:10:30,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:10:30,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:10:30,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:31,136::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:10:31,136::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:10:31,136::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:31,358::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:31,375::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000266342 s, 15.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:10:31,392::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:31,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:32,138::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:10:32,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:10:32,395::task::579::TaskManager.Task::(_updateState) Task=`da21bd35-a20d-4a8b-9bf3-31a2a16042d8`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:10:32,395::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:10:32,396::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:10:32,396::task::1168::TaskManager.Task::(prepare) Task=`da21bd35-a20d-4a8b-9bf3-31a2a16042d8`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:10:32,396::task::579::TaskManager.Task::(_updateState) Task=`da21bd35-a20d-4a8b-9bf3-31a2a16042d8`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:10:32,396::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:10:32,397::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:10:32,397::task::974::TaskManager.Task::(_decref) Task=`da21bd35-a20d-4a8b-9bf3-31a2a16042d8`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:10:33,054::task::579::TaskManager.Task::(_updateState) Task=`46d1f422-3111-43f5-ae21-ac6059be13ff`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:10:33,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:10:33,055::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:10:33,055::task::1168::TaskManager.Task::(prepare) Task=`46d1f422-3111-43f5-ae21-ac6059be13ff`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:10:33,055::task::579::TaskManager.Task::(_updateState) Task=`46d1f422-3111-43f5-ae21-ac6059be13ff`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:10:33,056::task::579::TaskManager.Task::(_updateState) Task=`e2266674-442b-4a15-94cc-be52bb4f2dc5`::moving from state init -> state preparing >Thread-16398::DEBUG::2014-01-16 16:10:33,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::INFO::2014-01-16 16:10:33,056::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16398::DEBUG::2014-01-16 16:10:33,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:10:33,057::task::974::TaskManager.Task::(_decref) Task=`46d1f422-3111-43f5-ae21-ac6059be13ff`::ref 0 aborting False >Thread-16393::INFO::2014-01-16 16:10:33,057::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:10:33,057::task::1168::TaskManager.Task::(prepare) Task=`e2266674-442b-4a15-94cc-be52bb4f2dc5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:10:33,057::task::579::TaskManager.Task::(_updateState) Task=`e2266674-442b-4a15-94cc-be52bb4f2dc5`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:10:33,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:10:33,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:10:33,058::task::974::TaskManager.Task::(_decref) Task=`e2266674-442b-4a15-94cc-be52bb4f2dc5`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:10:33,066::task::579::TaskManager.Task::(_updateState) Task=`f19111cc-f847-46c2-93b8-9a5e573d848f`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:10:33,066::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:10:33,066::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:10:33,067::task::1168::TaskManager.Task::(prepare) Task=`f19111cc-f847-46c2-93b8-9a5e573d848f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:10:33,067::task::579::TaskManager.Task::(_updateState) Task=`f19111cc-f847-46c2-93b8-9a5e573d848f`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:10:33,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:10:33,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:10:33,067::task::974::TaskManager.Task::(_decref) Task=`f19111cc-f847-46c2-93b8-9a5e573d848f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:33,140::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:10:33,140::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:10:33,140::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:10:33,140::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:33,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:10:34,035::task::579::TaskManager.Task::(_updateState) Task=`d0b0d011-5a27-4b10-80fd-557147219d57`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:10:34,036::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:10:34,036::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:10:34,036::task::1168::TaskManager.Task::(prepare) Task=`d0b0d011-5a27-4b10-80fd-557147219d57`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:10:34,036::task::579::TaskManager.Task::(_updateState) Task=`d0b0d011-5a27-4b10-80fd-557147219d57`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:10:34,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:10:34,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:10:34,037::task::974::TaskManager.Task::(_decref) Task=`d0b0d011-5a27-4b10-80fd-557147219d57`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:34,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:10:34,186::task::579::TaskManager.Task::(_updateState) Task=`f9fe13da-983c-4974-ad64-9212ba761945`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:10:34,187::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:10:34,187::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:10:34,187::task::1168::TaskManager.Task::(prepare) Task=`f9fe13da-983c-4974-ad64-9212ba761945`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:10:34,187::task::579::TaskManager.Task::(_updateState) Task=`f9fe13da-983c-4974-ad64-9212ba761945`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:10:34,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:10:34,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:10:34,188::task::974::TaskManager.Task::(_decref) Task=`f9fe13da-983c-4974-ad64-9212ba761945`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:10:34,188::task::579::TaskManager.Task::(_updateState) Task=`98265bcc-1398-4d4c-a873-3ab87ba14166`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:10:34,188::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:10:34,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:10:34,188::task::1168::TaskManager.Task::(prepare) Task=`98265bcc-1398-4d4c-a873-3ab87ba14166`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:10:34,189::task::579::TaskManager.Task::(_updateState) Task=`98265bcc-1398-4d4c-a873-3ab87ba14166`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:10:34,189::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:10:34,189::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:10:34,189::task::974::TaskManager.Task::(_decref) Task=`98265bcc-1398-4d4c-a873-3ab87ba14166`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:10:34,189::task::579::TaskManager.Task::(_updateState) Task=`81637d18-ee41-4f74-a0d2-633f3c838a1e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:10:34,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:10:34,190::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:10:34,190::task::1168::TaskManager.Task::(prepare) Task=`81637d18-ee41-4f74-a0d2-633f3c838a1e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:10:34,190::task::579::TaskManager.Task::(_updateState) Task=`81637d18-ee41-4f74-a0d2-633f3c838a1e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:10:34,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:10:34,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:10:34,190::task::974::TaskManager.Task::(_decref) Task=`81637d18-ee41-4f74-a0d2-633f3c838a1e`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:10:34,397::task::579::TaskManager.Task::(_updateState) Task=`f5f15c8c-2dca-4a37-858e-9f83b4d82870`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:10:34,397::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:10:34,397::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:10:34,398::task::1168::TaskManager.Task::(prepare) Task=`f5f15c8c-2dca-4a37-858e-9f83b4d82870`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:10:34,398::task::579::TaskManager.Task::(_updateState) Task=`f5f15c8c-2dca-4a37-858e-9f83b4d82870`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:10:34,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:10:34,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:10:34,398::task::974::TaskManager.Task::(_decref) Task=`f5f15c8c-2dca-4a37-858e-9f83b4d82870`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:10:34,555::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:10:34,571::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267223 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:10:35,143::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:10:35,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:10:35,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:10:35,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:35,144::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:10:35,146::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:10:35,402::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:36,148::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:36,404::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:37,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:10:37,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:10:37,150::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:37,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:38,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:10:38,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:10:38,151::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:39,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:10:39,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:10:39,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:10:39,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:39,406::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:40,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286231::DEBUG::2014-01-16 16:10:41,036::task::579::TaskManager.Task::(_updateState) Task=`8b5e1a0f-2395-48d3-8f5e-2e3aa24c2614`::moving from state init -> state preparing >Thread-286231::INFO::2014-01-16 16:10:41,036::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286231::INFO::2014-01-16 16:10:41,037::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267223', 'lastCheck': '6.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266342', 'lastCheck': '9.7', 'valid': True}} >Thread-286231::DEBUG::2014-01-16 16:10:41,037::task::1168::TaskManager.Task::(prepare) Task=`8b5e1a0f-2395-48d3-8f5e-2e3aa24c2614`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267223', 'lastCheck': '6.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266342', 'lastCheck': '9.7', 'valid': True}} >Thread-286231::DEBUG::2014-01-16 16:10:41,037::task::579::TaskManager.Task::(_updateState) Task=`8b5e1a0f-2395-48d3-8f5e-2e3aa24c2614`::moving from state preparing -> state finished >Thread-286231::DEBUG::2014-01-16 16:10:41,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286231::DEBUG::2014-01-16 16:10:41,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286231::DEBUG::2014-01-16 16:10:41,037::task::974::TaskManager.Task::(_decref) Task=`8b5e1a0f-2395-48d3-8f5e-2e3aa24c2614`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:41,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:10:41,155::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:41,381::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:10:41,398::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000242509 s, 16.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:10:41,408::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:10:41,410::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:10:41,410::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:10:41,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:10:42,037::task::579::TaskManager.Task::(_updateState) Task=`0805d6b3-56f9-47bc-959f-ca1e230de110`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:10:42,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:10:42,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:10:42,038::task::1168::TaskManager.Task::(prepare) Task=`0805d6b3-56f9-47bc-959f-ca1e230de110`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:10:42,038::task::579::TaskManager.Task::(_updateState) Task=`0805d6b3-56f9-47bc-959f-ca1e230de110`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:10:42,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:10:42,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:10:42,039::task::974::TaskManager.Task::(_decref) Task=`0805d6b3-56f9-47bc-959f-ca1e230de110`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:42,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:43,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:43,413::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:44,159::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:10:44,578::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:10:44,594::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029673 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:10:45,160::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:45,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:10:46,079::task::579::TaskManager.Task::(_updateState) Task=`65ddef4f-70ba-4586-ab8a-b3bd3c8559fd`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:10:46,079::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:10:46,079::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:10:46,080::task::1168::TaskManager.Task::(prepare) Task=`65ddef4f-70ba-4586-ab8a-b3bd3c8559fd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:10:46,080::task::579::TaskManager.Task::(_updateState) Task=`65ddef4f-70ba-4586-ab8a-b3bd3c8559fd`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:10:46,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:10:46,080::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:10:46,080::task::974::TaskManager.Task::(_decref) Task=`65ddef4f-70ba-4586-ab8a-b3bd3c8559fd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:46,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:46,416::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:10:46,527::task::579::TaskManager.Task::(_updateState) Task=`0eab443f-de9a-4fd0-86c0-2eeaae93b111`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:10:46,527::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:10:46,528::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:10:46,528::task::1168::TaskManager.Task::(prepare) Task=`0eab443f-de9a-4fd0-86c0-2eeaae93b111`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:10:46,528::task::579::TaskManager.Task::(_updateState) Task=`0eab443f-de9a-4fd0-86c0-2eeaae93b111`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:10:46,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:10:46,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:10:46,528::task::974::TaskManager.Task::(_decref) Task=`0eab443f-de9a-4fd0-86c0-2eeaae93b111`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:10:46,529::task::579::TaskManager.Task::(_updateState) Task=`268bce2f-6f6f-4ce8-af25-7361838e98c6`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:10:46,529::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:10:46,529::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:10:46,529::task::1168::TaskManager.Task::(prepare) Task=`268bce2f-6f6f-4ce8-af25-7361838e98c6`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:10:46,529::task::579::TaskManager.Task::(_updateState) Task=`268bce2f-6f6f-4ce8-af25-7361838e98c6`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:10:46,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:10:46,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:10:46,530::task::974::TaskManager.Task::(_decref) Task=`268bce2f-6f6f-4ce8-af25-7361838e98c6`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:10:46,530::task::579::TaskManager.Task::(_updateState) Task=`0e470123-1351-4bae-ab3e-be5a18e18ef0`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:10:46,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:10:46,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:10:46,530::task::1168::TaskManager.Task::(prepare) Task=`0e470123-1351-4bae-ab3e-be5a18e18ef0`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:10:46,531::task::579::TaskManager.Task::(_updateState) Task=`0e470123-1351-4bae-ab3e-be5a18e18ef0`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:10:46,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:10:46,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:10:46,531::task::974::TaskManager.Task::(_decref) Task=`0e470123-1351-4bae-ab3e-be5a18e18ef0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:47,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:10:47,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:47,417::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:48,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:49,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:49,419::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:50,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:51,172::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:10:51,404::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:10:51,422::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:10:51,424::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000249911 s, 16.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:10:51,425::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:52,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:10:52,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:10:52,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:10:53,044::task::579::TaskManager.Task::(_updateState) Task=`7cce65b4-72c5-4c3e-a144-41fe4f27f6c7`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:10:53,044::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:10:53,044::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:10:53,045::task::1168::TaskManager.Task::(prepare) Task=`7cce65b4-72c5-4c3e-a144-41fe4f27f6c7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:10:53,045::task::579::TaskManager.Task::(_updateState) Task=`7cce65b4-72c5-4c3e-a144-41fe4f27f6c7`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:10:53,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:10:53,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:10:53,045::task::974::TaskManager.Task::(_decref) Task=`7cce65b4-72c5-4c3e-a144-41fe4f27f6c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:53,175::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:10:53,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:53,428::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:54,176::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:10:54,177::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:10:54,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:10:54,602::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:10:54,618::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000309231 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:10:55,178::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:10:55,178::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:55,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:56,179::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:10:56,180::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:56,432::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:10:56,432::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:10:56,433::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:10:56,742::task::579::TaskManager.Task::(_updateState) Task=`06e23709-f718-43cc-9950-a4acf1b0abd7`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:10:56,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:10:56,743::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:10:56,743::task::1168::TaskManager.Task::(prepare) Task=`06e23709-f718-43cc-9950-a4acf1b0abd7`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:10:56,743::task::579::TaskManager.Task::(_updateState) Task=`06e23709-f718-43cc-9950-a4acf1b0abd7`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:10:56,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:10:56,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:10:56,744::task::974::TaskManager.Task::(_decref) Task=`06e23709-f718-43cc-9950-a4acf1b0abd7`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:10:56,744::task::579::TaskManager.Task::(_updateState) Task=`2119dd33-dc2e-4c52-9e6d-ce81a86500ef`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:10:56,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:10:56,745::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:10:56,745::task::1168::TaskManager.Task::(prepare) Task=`2119dd33-dc2e-4c52-9e6d-ce81a86500ef`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:10:56,745::task::579::TaskManager.Task::(_updateState) Task=`2119dd33-dc2e-4c52-9e6d-ce81a86500ef`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:10:56,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:10:56,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:10:56,745::task::974::TaskManager.Task::(_decref) Task=`2119dd33-dc2e-4c52-9e6d-ce81a86500ef`::ref 0 aborting False >Thread-286237::DEBUG::2014-01-16 16:10:56,784::task::579::TaskManager.Task::(_updateState) Task=`ab37af9d-cc15-4e6b-aee3-16349f745ce4`::moving from state init -> state preparing >Thread-286237::INFO::2014-01-16 16:10:56,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286237::INFO::2014-01-16 16:10:56,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309231', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249911', 'lastCheck': '5.4', 'valid': True}} >Thread-286237::DEBUG::2014-01-16 16:10:56,785::task::1168::TaskManager.Task::(prepare) Task=`ab37af9d-cc15-4e6b-aee3-16349f745ce4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309231', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249911', 'lastCheck': '5.4', 'valid': True}} >Thread-286237::DEBUG::2014-01-16 16:10:56,785::task::579::TaskManager.Task::(_updateState) Task=`ab37af9d-cc15-4e6b-aee3-16349f745ce4`::moving from state preparing -> state finished >Thread-286237::DEBUG::2014-01-16 16:10:56,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286237::DEBUG::2014-01-16 16:10:56,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286237::DEBUG::2014-01-16 16:10:56,785::task::974::TaskManager.Task::(_decref) Task=`ab37af9d-cc15-4e6b-aee3-16349f745ce4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:10:57,180::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:57,435::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:10:58,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:10:58,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:10:59,182::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:10:59,182::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:10:59,436::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:00,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:11:00,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:11:00,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:11:00,184::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:11:00,196::task::579::TaskManager.Task::(_updateState) Task=`b4664c5d-3b82-403b-ac7a-c107bbcd95fa`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:11:00,197::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:11:00,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:11:00,197::task::1168::TaskManager.Task::(prepare) Task=`b4664c5d-3b82-403b-ac7a-c107bbcd95fa`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:11:00,197::task::579::TaskManager.Task::(_updateState) Task=`b4664c5d-3b82-403b-ac7a-c107bbcd95fa`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:11:00,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:11:00,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:11:00,198::task::974::TaskManager.Task::(_decref) Task=`b4664c5d-3b82-403b-ac7a-c107bbcd95fa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:01,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:11:01,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:11:01,186::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:11:01,432::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:11:01,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:01,452::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:11:01,454::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000225181 s, 18.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:02,187::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:11:02,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:11:03,024::task::579::TaskManager.Task::(_updateState) Task=`a010147b-a9b2-49db-88a4-9396b7e8e52c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:11:03,025::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:11:03,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:11:03,025::task::1168::TaskManager.Task::(prepare) Task=`a010147b-a9b2-49db-88a4-9396b7e8e52c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:11:03,025::task::579::TaskManager.Task::(_updateState) Task=`a010147b-a9b2-49db-88a4-9396b7e8e52c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:11:03,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:11:03,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:11:03,026::task::974::TaskManager.Task::(_decref) Task=`a010147b-a9b2-49db-88a4-9396b7e8e52c`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:11:03,026::task::579::TaskManager.Task::(_updateState) Task=`66745a75-2782-47e6-b4da-d071d47a75bd`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:11:03,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:11:03,026::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:11:03,027::task::1168::TaskManager.Task::(prepare) Task=`66745a75-2782-47e6-b4da-d071d47a75bd`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:11:03,027::task::579::TaskManager.Task::(_updateState) Task=`66745a75-2782-47e6-b4da-d071d47a75bd`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:11:03,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:11:03,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:11:03,027::task::974::TaskManager.Task::(_decref) Task=`66745a75-2782-47e6-b4da-d071d47a75bd`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:11:03,144::task::579::TaskManager.Task::(_updateState) Task=`c4c41ac5-f7be-4976-ba41-54c69ad4e11b`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:11:03,145::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 16:11:03,145::task::579::TaskManager.Task::(_updateState) Task=`30192a42-ff62-49cf-ad1d-a09ab81a7094`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:11:03,146::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:11:03,146::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:11:03,146::task::1168::TaskManager.Task::(prepare) Task=`30192a42-ff62-49cf-ad1d-a09ab81a7094`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:11:03,146::task::579::TaskManager.Task::(_updateState) Task=`30192a42-ff62-49cf-ad1d-a09ab81a7094`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:11:03,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:11:03,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:11:03,147::task::974::TaskManager.Task::(_decref) Task=`30192a42-ff62-49cf-ad1d-a09ab81a7094`::ref 0 aborting False >Thread-251782::INFO::2014-01-16 16:11:03,147::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:11:03,147::task::1168::TaskManager.Task::(prepare) Task=`c4c41ac5-f7be-4976-ba41-54c69ad4e11b`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:11:03,147::task::579::TaskManager.Task::(_updateState) Task=`c4c41ac5-f7be-4976-ba41-54c69ad4e11b`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:11:03,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:11:03,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:11:03,148::task::974::TaskManager.Task::(_decref) Task=`c4c41ac5-f7be-4976-ba41-54c69ad4e11b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:03,187::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:11:03,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:11:03,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:11:03,188::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:03,454::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:04,190::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:11:04,275::task::579::TaskManager.Task::(_updateState) Task=`26f1fae0-1b08-4cc4-a799-16a99fd7efb9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:11:04,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:11:04,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:11:04,277::task::1168::TaskManager.Task::(prepare) Task=`26f1fae0-1b08-4cc4-a799-16a99fd7efb9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:11:04,277::task::579::TaskManager.Task::(_updateState) Task=`26f1fae0-1b08-4cc4-a799-16a99fd7efb9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:11:04,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:11:04,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:11:04,278::task::974::TaskManager.Task::(_decref) Task=`26f1fae0-1b08-4cc4-a799-16a99fd7efb9`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:11:04,278::task::579::TaskManager.Task::(_updateState) Task=`0e5603a1-06cb-4572-b5cf-5cdaf253411b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:11:04,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:11:04,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:11:04,279::task::1168::TaskManager.Task::(prepare) Task=`0e5603a1-06cb-4572-b5cf-5cdaf253411b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:11:04,279::task::579::TaskManager.Task::(_updateState) Task=`0e5603a1-06cb-4572-b5cf-5cdaf253411b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:11:04,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:11:04,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:11:04,279::task::974::TaskManager.Task::(_decref) Task=`0e5603a1-06cb-4572-b5cf-5cdaf253411b`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:11:04,500::task::579::TaskManager.Task::(_updateState) Task=`a1184e63-2aa6-4b88-8028-70910eb75649`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:11:04,500::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:11:04,501::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:11:04,501::task::1168::TaskManager.Task::(prepare) Task=`a1184e63-2aa6-4b88-8028-70910eb75649`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:11:04,501::task::579::TaskManager.Task::(_updateState) Task=`a1184e63-2aa6-4b88-8028-70910eb75649`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:11:04,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:11:04,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:11:04,501::task::974::TaskManager.Task::(_decref) Task=`a1184e63-2aa6-4b88-8028-70910eb75649`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:11:04,620::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:11:04,624::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:11:04,625::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:11:04,630::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:11:04,631::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:11:04,631::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:11:04,631::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:11:04,636::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:11:04,652::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258178 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:11:04,655::task::579::TaskManager.Task::(_updateState) Task=`f1b67287-3ac2-43e3-8eae-4a305a27e778`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:11:04,655::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:11:04,655::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:11:04,656::task::1168::TaskManager.Task::(prepare) Task=`f1b67287-3ac2-43e3-8eae-4a305a27e778`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:11:04,656::task::579::TaskManager.Task::(_updateState) Task=`f1b67287-3ac2-43e3-8eae-4a305a27e778`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:11:04,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:11:04,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:11:04,657::task::974::TaskManager.Task::(_decref) Task=`f1b67287-3ac2-43e3-8eae-4a305a27e778`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:05,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:11:05,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:11:05,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:11:05,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:05,192::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:11:05,193::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:11:05,456::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:11:05,592::task::579::TaskManager.Task::(_updateState) Task=`e01582c1-1e10-4b3e-a958-8262ca12ecce`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:11:05,592::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:11:05,593::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:11:05,593::task::1168::TaskManager.Task::(prepare) Task=`e01582c1-1e10-4b3e-a958-8262ca12ecce`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:11:05,593::task::579::TaskManager.Task::(_updateState) Task=`e01582c1-1e10-4b3e-a958-8262ca12ecce`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:11:05,593::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:11:05,593::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:11:05,593::task::974::TaskManager.Task::(_decref) Task=`e01582c1-1e10-4b3e-a958-8262ca12ecce`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:06,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:06,457::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:11:06,482::task::579::TaskManager.Task::(_updateState) Task=`4f1b5b10-b425-4c80-859f-07eb9657d016`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:11:06,482::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:11:06,483::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:11:06,483::task::1168::TaskManager.Task::(prepare) Task=`4f1b5b10-b425-4c80-859f-07eb9657d016`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:11:06,483::task::579::TaskManager.Task::(_updateState) Task=`4f1b5b10-b425-4c80-859f-07eb9657d016`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:11:06,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:11:06,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:11:06,483::task::974::TaskManager.Task::(_decref) Task=`4f1b5b10-b425-4c80-859f-07eb9657d016`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:07,195::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:11:07,195::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:11:07,195::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:07,459::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:08,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:11:08,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:11:08,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:09,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:11:09,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:11:09,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:11:09,198::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:09,460::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:11:09,530::task::579::TaskManager.Task::(_updateState) Task=`ec6a11c6-4861-4ab5-82fa-0ed3b26511f6`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:11:09,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:11:09,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:11:09,530::task::1168::TaskManager.Task::(prepare) Task=`ec6a11c6-4861-4ab5-82fa-0ed3b26511f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:11:09,531::task::579::TaskManager.Task::(_updateState) Task=`ec6a11c6-4861-4ab5-82fa-0ed3b26511f6`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:11:09,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:11:09,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:11:09,531::task::974::TaskManager.Task::(_decref) Task=`ec6a11c6-4861-4ab5-82fa-0ed3b26511f6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:10,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:11,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:11:11,200::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:11:11,459::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:11:11,476::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:11,480::task::579::TaskManager.Task::(_updateState) Task=`e44653e2-1d49-41f0-adf8-be9bfdec6981`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:11:11,482::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:11:11,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:11:11,489::task::1168::TaskManager.Task::(prepare) Task=`e44653e2-1d49-41f0-adf8-be9bfdec6981`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:11:11,490::task::579::TaskManager.Task::(_updateState) Task=`e44653e2-1d49-41f0-adf8-be9bfdec6981`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:11:11,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:11:11,493::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:11:11,495::task::974::TaskManager.Task::(_decref) Task=`e44653e2-1d49-41f0-adf8-be9bfdec6981`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:11:11,496::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000261908 s, 15.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:11:11,498::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:11:11,500::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:11:11,506::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:11,507::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:11,509::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:12,201::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286244::DEBUG::2014-01-16 16:11:12,500::task::579::TaskManager.Task::(_updateState) Task=`884f0563-790d-45dc-b85c-1119c2cae972`::moving from state init -> state preparing >Thread-286244::INFO::2014-01-16 16:11:12,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286244::INFO::2014-01-16 16:11:12,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258178', 'lastCheck': '7.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261908', 'lastCheck': '1.0', 'valid': True}} >Thread-286244::DEBUG::2014-01-16 16:11:12,501::task::1168::TaskManager.Task::(prepare) Task=`884f0563-790d-45dc-b85c-1119c2cae972`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258178', 'lastCheck': '7.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261908', 'lastCheck': '1.0', 'valid': True}} >Thread-286244::DEBUG::2014-01-16 16:11:12,501::task::579::TaskManager.Task::(_updateState) Task=`884f0563-790d-45dc-b85c-1119c2cae972`::moving from state preparing -> state finished >Thread-286244::DEBUG::2014-01-16 16:11:12,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286244::DEBUG::2014-01-16 16:11:12,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286244::DEBUG::2014-01-16 16:11:12,501::task::974::TaskManager.Task::(_decref) Task=`884f0563-790d-45dc-b85c-1119c2cae972`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:11:13,158::task::579::TaskManager.Task::(_updateState) Task=`7042d812-4b11-47c9-b61c-f6a00c198de4`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:11:13,158::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:11:13,158::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:11:13,158::task::1168::TaskManager.Task::(prepare) Task=`7042d812-4b11-47c9-b61c-f6a00c198de4`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:11:13,159::task::579::TaskManager.Task::(_updateState) Task=`7042d812-4b11-47c9-b61c-f6a00c198de4`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:11:13,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:11:13,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:11:13,159::task::974::TaskManager.Task::(_decref) Task=`7042d812-4b11-47c9-b61c-f6a00c198de4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:13,203::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:13,510::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:14,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:11:14,418::task::579::TaskManager.Task::(_updateState) Task=`ba0159a0-73f8-4d11-9634-83cfa495a7a0`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:11:14,418::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:11:14,420::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:11:14,420::task::1168::TaskManager.Task::(prepare) Task=`ba0159a0-73f8-4d11-9634-83cfa495a7a0`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:11:14,420::task::579::TaskManager.Task::(_updateState) Task=`ba0159a0-73f8-4d11-9634-83cfa495a7a0`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:11:14,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:11:14,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:11:14,420::task::974::TaskManager.Task::(_decref) Task=`ba0159a0-73f8-4d11-9634-83cfa495a7a0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:11:14,660::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:11:14,676::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000263095 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:15,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:11:15,239::task::579::TaskManager.Task::(_updateState) Task=`54b8e38c-9407-4c91-a449-f2b35137a59d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:11:15,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:11:15,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:11:15,240::task::1168::TaskManager.Task::(prepare) Task=`54b8e38c-9407-4c91-a449-f2b35137a59d`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:11:15,240::task::579::TaskManager.Task::(_updateState) Task=`54b8e38c-9407-4c91-a449-f2b35137a59d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:11:15,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:11:15,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:11:15,240::task::974::TaskManager.Task::(_decref) Task=`54b8e38c-9407-4c91-a449-f2b35137a59d`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:11:15,241::task::579::TaskManager.Task::(_updateState) Task=`9eb53568-62e3-4a2a-ad2b-3dc9f8324c2f`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:11:15,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:11:15,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:11:15,241::task::1168::TaskManager.Task::(prepare) Task=`9eb53568-62e3-4a2a-ad2b-3dc9f8324c2f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:11:15,241::task::579::TaskManager.Task::(_updateState) Task=`9eb53568-62e3-4a2a-ad2b-3dc9f8324c2f`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:11:15,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:11:15,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:11:15,242::task::974::TaskManager.Task::(_decref) Task=`9eb53568-62e3-4a2a-ad2b-3dc9f8324c2f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:11:15,512::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:16,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:16,513::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:17,206::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:11:17,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:17,514::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:18,208::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:19,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:19,516::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:20,210::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:21,211::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:11:21,234::task::579::TaskManager.Task::(_updateState) Task=`5a0e0f70-43cb-4ab3-b9ca-ec1ed7e0b709`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:11:21,234::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:11:21,235::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:11:21,235::task::1168::TaskManager.Task::(prepare) Task=`5a0e0f70-43cb-4ab3-b9ca-ec1ed7e0b709`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:11:21,235::task::579::TaskManager.Task::(_updateState) Task=`5a0e0f70-43cb-4ab3-b9ca-ec1ed7e0b709`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:11:21,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:11:21,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:11:21,235::task::974::TaskManager.Task::(_decref) Task=`5a0e0f70-43cb-4ab3-b9ca-ec1ed7e0b709`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:11:21,509::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:11:21,526::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:21,529::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:11:21,532::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241769 s, 16.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:22,212::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:11:22,212::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:11:22,212::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:11:23,091::task::579::TaskManager.Task::(_updateState) Task=`f807b540-f723-45c8-bc0d-048874ac95a6`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:11:23,092::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:11:23,093::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:11:23,093::task::1168::TaskManager.Task::(prepare) Task=`f807b540-f723-45c8-bc0d-048874ac95a6`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:11:23,093::task::579::TaskManager.Task::(_updateState) Task=`f807b540-f723-45c8-bc0d-048874ac95a6`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:11:23,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:11:23,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:11:23,094::task::974::TaskManager.Task::(_decref) Task=`f807b540-f723-45c8-bc0d-048874ac95a6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:23,213::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:11:23,214::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:23,532::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:24,215::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:11:24,215::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:11:24,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:11:24,683::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:11:24,700::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275615 s, 1.3 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:11:24,771::task::579::TaskManager.Task::(_updateState) Task=`c19037de-cc7f-48fb-b6d0-46270e3e2864`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:11:24,771::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:11:24,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:11:24,771::task::1168::TaskManager.Task::(prepare) Task=`c19037de-cc7f-48fb-b6d0-46270e3e2864`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:11:24,772::task::579::TaskManager.Task::(_updateState) Task=`c19037de-cc7f-48fb-b6d0-46270e3e2864`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:11:24,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:11:24,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:11:24,772::task::974::TaskManager.Task::(_decref) Task=`c19037de-cc7f-48fb-b6d0-46270e3e2864`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:11:24,856::task::579::TaskManager.Task::(_updateState) Task=`1c563f40-1b89-4b93-9a0a-63c87d9a34a0`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:11:24,856::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:11:24,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:11:24,857::task::1168::TaskManager.Task::(prepare) Task=`1c563f40-1b89-4b93-9a0a-63c87d9a34a0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:11:24,857::task::579::TaskManager.Task::(_updateState) Task=`1c563f40-1b89-4b93-9a0a-63c87d9a34a0`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:11:24,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:11:24,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:11:24,858::task::974::TaskManager.Task::(_decref) Task=`1c563f40-1b89-4b93-9a0a-63c87d9a34a0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:25,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:11:25,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:25,534::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:26,218::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:11:26,219::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:26,536::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:11:26,536::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:11:26,538::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:27,220::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:27,539::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:28,221::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:11:28,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286250::DEBUG::2014-01-16 16:11:28,428::task::579::TaskManager.Task::(_updateState) Task=`60bed146-ec54-4de0-b56c-09ce9a174e7d`::moving from state init -> state preparing >Thread-286250::INFO::2014-01-16 16:11:28,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286250::INFO::2014-01-16 16:11:28,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275615', 'lastCheck': '3.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241769', 'lastCheck': '6.9', 'valid': True}} >Thread-286250::DEBUG::2014-01-16 16:11:28,429::task::1168::TaskManager.Task::(prepare) Task=`60bed146-ec54-4de0-b56c-09ce9a174e7d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275615', 'lastCheck': '3.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241769', 'lastCheck': '6.9', 'valid': True}} >Thread-286250::DEBUG::2014-01-16 16:11:28,429::task::579::TaskManager.Task::(_updateState) Task=`60bed146-ec54-4de0-b56c-09ce9a174e7d`::moving from state preparing -> state finished >Thread-286250::DEBUG::2014-01-16 16:11:28,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286250::DEBUG::2014-01-16 16:11:28,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286250::DEBUG::2014-01-16 16:11:28,430::task::974::TaskManager.Task::(_decref) Task=`60bed146-ec54-4de0-b56c-09ce9a174e7d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:29,222::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:11:29,222::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:29,540::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:11:29,662::task::579::TaskManager.Task::(_updateState) Task=`a57bb1d4-b9aa-414a-8bbc-e9c3bf11202e`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:11:29,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:11:29,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:11:29,662::task::1168::TaskManager.Task::(prepare) Task=`a57bb1d4-b9aa-414a-8bbc-e9c3bf11202e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:11:29,663::task::579::TaskManager.Task::(_updateState) Task=`a57bb1d4-b9aa-414a-8bbc-e9c3bf11202e`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:11:29,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:11:29,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:11:29,663::task::974::TaskManager.Task::(_decref) Task=`a57bb1d4-b9aa-414a-8bbc-e9c3bf11202e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:30,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:11:30,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:11:30,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:11:30,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:31,226::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:11:31,226::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:11:31,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:11:31,538::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:11:31,554::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:31,557::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:11:31,560::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218042 s, 18.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:32,228::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:11:32,228::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:11:32,572::task::579::TaskManager.Task::(_updateState) Task=`b8a017b3-1518-40bb-ad57-238f0cde705d`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:11:32,572::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:11:32,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:11:32,573::task::1168::TaskManager.Task::(prepare) Task=`b8a017b3-1518-40bb-ad57-238f0cde705d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:11:32,573::task::579::TaskManager.Task::(_updateState) Task=`b8a017b3-1518-40bb-ad57-238f0cde705d`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:11:32,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:11:32,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:11:32,574::task::974::TaskManager.Task::(_decref) Task=`b8a017b3-1518-40bb-ad57-238f0cde705d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:33,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:11:33,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:11:33,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:11:33,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:11:33,243::task::579::TaskManager.Task::(_updateState) Task=`65e71dc6-9cfd-4256-895d-b2485dc347c4`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:11:33,243::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:11:33,244::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:11:33,244::task::1168::TaskManager.Task::(prepare) Task=`65e71dc6-9cfd-4256-895d-b2485dc347c4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:11:33,244::task::579::TaskManager.Task::(_updateState) Task=`65e71dc6-9cfd-4256-895d-b2485dc347c4`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:11:33,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:11:33,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:11:33,244::task::974::TaskManager.Task::(_decref) Task=`65e71dc6-9cfd-4256-895d-b2485dc347c4`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:11:33,246::task::579::TaskManager.Task::(_updateState) Task=`93e83e02-f5ef-4507-8ddb-eb22e44f040d`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:11:33,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:11:33,247::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:11:33,247::task::1168::TaskManager.Task::(prepare) Task=`93e83e02-f5ef-4507-8ddb-eb22e44f040d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:11:33,247::task::579::TaskManager.Task::(_updateState) Task=`93e83e02-f5ef-4507-8ddb-eb22e44f040d`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:11:33,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:11:33,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:11:33,247::task::974::TaskManager.Task::(_decref) Task=`93e83e02-f5ef-4507-8ddb-eb22e44f040d`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:11:33,260::task::579::TaskManager.Task::(_updateState) Task=`03981f99-f45e-44b8-9e28-778d1c293bb7`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:11:33,260::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:11:33,260::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:11:33,260::task::1168::TaskManager.Task::(prepare) Task=`03981f99-f45e-44b8-9e28-778d1c293bb7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:11:33,261::task::579::TaskManager.Task::(_updateState) Task=`03981f99-f45e-44b8-9e28-778d1c293bb7`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:11:33,261::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:11:33,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:11:33,261::task::974::TaskManager.Task::(_decref) Task=`03981f99-f45e-44b8-9e28-778d1c293bb7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:11:33,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:11:34,213::task::579::TaskManager.Task::(_updateState) Task=`df5047a4-1601-419b-ae55-39aa15a5d3f9`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:11:34,214::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:11:34,214::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:11:34,214::task::1168::TaskManager.Task::(prepare) Task=`df5047a4-1601-419b-ae55-39aa15a5d3f9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:11:34,214::task::579::TaskManager.Task::(_updateState) Task=`df5047a4-1601-419b-ae55-39aa15a5d3f9`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:11:34,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:11:34,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:11:34,215::task::974::TaskManager.Task::(_decref) Task=`df5047a4-1601-419b-ae55-39aa15a5d3f9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:34,231::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:11:34,461::task::579::TaskManager.Task::(_updateState) Task=`151cfdf7-d019-4284-8396-f1921f8301c7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:11:34,461::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:11:34,461::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:11:34,461::task::1168::TaskManager.Task::(prepare) Task=`151cfdf7-d019-4284-8396-f1921f8301c7`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:11:34,461::task::579::TaskManager.Task::(_updateState) Task=`151cfdf7-d019-4284-8396-f1921f8301c7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:11:34,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:11:34,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:11:34,462::task::974::TaskManager.Task::(_decref) Task=`151cfdf7-d019-4284-8396-f1921f8301c7`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:11:34,462::task::579::TaskManager.Task::(_updateState) Task=`a059082c-f832-4b92-8845-d50e14a1ffca`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:11:34,462::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:11:34,462::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:11:34,463::task::1168::TaskManager.Task::(prepare) Task=`a059082c-f832-4b92-8845-d50e14a1ffca`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:11:34,463::task::579::TaskManager.Task::(_updateState) Task=`a059082c-f832-4b92-8845-d50e14a1ffca`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:11:34,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:11:34,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:11:34,463::task::974::TaskManager.Task::(_decref) Task=`a059082c-f832-4b92-8845-d50e14a1ffca`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:11:34,463::task::579::TaskManager.Task::(_updateState) Task=`90241cbc-9745-4c6a-99d9-9860ed934443`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:11:34,463::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:11:34,464::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:11:34,464::task::1168::TaskManager.Task::(prepare) Task=`90241cbc-9745-4c6a-99d9-9860ed934443`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:11:34,464::task::579::TaskManager.Task::(_updateState) Task=`90241cbc-9745-4c6a-99d9-9860ed934443`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:11:34,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:11:34,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:11:34,464::task::974::TaskManager.Task::(_decref) Task=`90241cbc-9745-4c6a-99d9-9860ed934443`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:11:34,588::task::579::TaskManager.Task::(_updateState) Task=`f20f7536-4291-4160-8195-4b899d2b5cdc`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:11:34,588::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:11:34,588::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:11:34,588::task::1168::TaskManager.Task::(prepare) Task=`f20f7536-4291-4160-8195-4b899d2b5cdc`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:11:34,588::task::579::TaskManager.Task::(_updateState) Task=`f20f7536-4291-4160-8195-4b899d2b5cdc`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:11:34,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:11:34,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:11:34,589::task::974::TaskManager.Task::(_decref) Task=`f20f7536-4291-4160-8195-4b899d2b5cdc`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:11:34,708::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:11:34,724::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000250197 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:35,232::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:11:35,232::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:11:35,232::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:11:35,232::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:35,233::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:11:35,234::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:11:35,561::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:36,235::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:36,562::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:37,237::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:11:37,237::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:11:37,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:37,564::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:38,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:11:38,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:11:38,238::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:39,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:11:39,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:11:39,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:11:39,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:39,566::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:40,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:41,241::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:11:41,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:11:41,565::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:11:41,583::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:11:41,586::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026896 s, 15.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:11:41,587::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:11:41,588::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:11:41,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:11:42,203::task::579::TaskManager.Task::(_updateState) Task=`4a381ed5-6850-473c-b510-f2e82639ab8c`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:11:42,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:11:42,204::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:11:42,204::task::1168::TaskManager.Task::(prepare) Task=`4a381ed5-6850-473c-b510-f2e82639ab8c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:11:42,204::task::579::TaskManager.Task::(_updateState) Task=`4a381ed5-6850-473c-b510-f2e82639ab8c`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:11:42,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:11:42,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:11:42,205::task::974::TaskManager.Task::(_decref) Task=`4a381ed5-6850-473c-b510-f2e82639ab8c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:42,243::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:43,244::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:43,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:44,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286256::DEBUG::2014-01-16 16:11:44,639::task::579::TaskManager.Task::(_updateState) Task=`ba5e3938-7ae5-4fd5-b94d-f52c97a6b8e5`::moving from state init -> state preparing >Thread-286256::INFO::2014-01-16 16:11:44,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286256::INFO::2014-01-16 16:11:44,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250197', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026896', 'lastCheck': '3.0', 'valid': True}} >Thread-286256::DEBUG::2014-01-16 16:11:44,640::task::1168::TaskManager.Task::(prepare) Task=`ba5e3938-7ae5-4fd5-b94d-f52c97a6b8e5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250197', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026896', 'lastCheck': '3.0', 'valid': True}} >Thread-286256::DEBUG::2014-01-16 16:11:44,640::task::579::TaskManager.Task::(_updateState) Task=`ba5e3938-7ae5-4fd5-b94d-f52c97a6b8e5`::moving from state preparing -> state finished >Thread-286256::DEBUG::2014-01-16 16:11:44,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286256::DEBUG::2014-01-16 16:11:44,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286256::DEBUG::2014-01-16 16:11:44,640::task::974::TaskManager.Task::(_decref) Task=`ba5e3938-7ae5-4fd5-b94d-f52c97a6b8e5`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:11:44,732::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:11:44,749::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00033791 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:45,247::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:45,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:46,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:11:46,270::task::579::TaskManager.Task::(_updateState) Task=`261d2bc1-73d5-4417-8727-f494d9ee4f22`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:11:46,271::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:11:46,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:11:46,271::task::1168::TaskManager.Task::(prepare) Task=`261d2bc1-73d5-4417-8727-f494d9ee4f22`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:11:46,271::task::579::TaskManager.Task::(_updateState) Task=`261d2bc1-73d5-4417-8727-f494d9ee4f22`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:11:46,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:11:46,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:11:46,272::task::974::TaskManager.Task::(_decref) Task=`261d2bc1-73d5-4417-8727-f494d9ee4f22`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:11:46,597::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:11:47,112::task::579::TaskManager.Task::(_updateState) Task=`353fce17-a589-4b75-9896-8dad72adcbe2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:11:47,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:11:47,113::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:11:47,113::task::1168::TaskManager.Task::(prepare) Task=`353fce17-a589-4b75-9896-8dad72adcbe2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:11:47,113::task::579::TaskManager.Task::(_updateState) Task=`353fce17-a589-4b75-9896-8dad72adcbe2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:11:47,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:11:47,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:11:47,114::task::974::TaskManager.Task::(_decref) Task=`353fce17-a589-4b75-9896-8dad72adcbe2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:11:47,114::task::579::TaskManager.Task::(_updateState) Task=`718507ca-ba8d-4374-8714-a861f7d4f734`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:11:47,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:11:47,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:11:47,114::task::1168::TaskManager.Task::(prepare) Task=`718507ca-ba8d-4374-8714-a861f7d4f734`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:11:47,114::task::579::TaskManager.Task::(_updateState) Task=`718507ca-ba8d-4374-8714-a861f7d4f734`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:11:47,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:11:47,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:11:47,115::task::974::TaskManager.Task::(_decref) Task=`718507ca-ba8d-4374-8714-a861f7d4f734`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:11:47,115::task::579::TaskManager.Task::(_updateState) Task=`369b2328-b4f6-4407-8be4-477a290002d6`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:11:47,115::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:11:47,116::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:11:47,116::task::1168::TaskManager.Task::(prepare) Task=`369b2328-b4f6-4407-8be4-477a290002d6`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:11:47,116::task::579::TaskManager.Task::(_updateState) Task=`369b2328-b4f6-4407-8be4-477a290002d6`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:11:47,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:11:47,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:11:47,116::task::974::TaskManager.Task::(_decref) Task=`369b2328-b4f6-4407-8be4-477a290002d6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:47,250::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:11:47,250::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:47,598::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:48,250::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:49,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:49,600::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:50,252::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:51,253::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:11:51,595::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:11:51,611::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:11:51,614::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:11:51,617::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000229311 s, 17.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:52,254::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:11:52,255::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:11:52,255::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:11:53,221::task::579::TaskManager.Task::(_updateState) Task=`543fc52b-37a1-441a-b34d-4ceac8f47fd3`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:11:53,221::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:11:53,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:11:53,222::task::1168::TaskManager.Task::(prepare) Task=`543fc52b-37a1-441a-b34d-4ceac8f47fd3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:11:53,222::task::579::TaskManager.Task::(_updateState) Task=`543fc52b-37a1-441a-b34d-4ceac8f47fd3`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:11:53,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:11:53,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:11:53,223::task::974::TaskManager.Task::(_decref) Task=`543fc52b-37a1-441a-b34d-4ceac8f47fd3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:53,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:11:53,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:53,617::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:54,258::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:11:54,259::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:11:54,259::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:11:54,756::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:11:54,773::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000260653 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:11:55,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:11:55,261::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:55,619::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:56,262::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:11:56,263::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:56,621::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:11:56,621::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:11:56,622::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:11:56,976::task::579::TaskManager.Task::(_updateState) Task=`a7d9766a-40e2-4af2-bbb5-b2ada6bf75bf`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:11:56,977::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:11:56,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:11:56,978::task::1168::TaskManager.Task::(prepare) Task=`a7d9766a-40e2-4af2-bbb5-b2ada6bf75bf`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:11:56,978::task::579::TaskManager.Task::(_updateState) Task=`a7d9766a-40e2-4af2-bbb5-b2ada6bf75bf`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:11:56,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:11:56,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:11:56,978::task::974::TaskManager.Task::(_decref) Task=`a7d9766a-40e2-4af2-bbb5-b2ada6bf75bf`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:11:56,979::task::579::TaskManager.Task::(_updateState) Task=`61952337-8310-486a-9533-139c5b499974`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:11:56,979::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:11:56,980::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:11:56,980::task::1168::TaskManager.Task::(prepare) Task=`61952337-8310-486a-9533-139c5b499974`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:11:56,980::task::579::TaskManager.Task::(_updateState) Task=`61952337-8310-486a-9533-139c5b499974`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:11:56,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:11:56,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:11:56,981::task::974::TaskManager.Task::(_decref) Task=`61952337-8310-486a-9533-139c5b499974`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:11:57,264::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:57,624::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:11:58,265::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:11:58,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:11:59,267::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:11:59,268::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:11:59,625::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:00,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:12:00,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:12:00,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:12:00,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:12:00,363::task::579::TaskManager.Task::(_updateState) Task=`4bf3300c-e3e6-488a-bc60-01b25d3e1990`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:12:00,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:12:00,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:12:00,363::task::1168::TaskManager.Task::(prepare) Task=`4bf3300c-e3e6-488a-bc60-01b25d3e1990`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:12:00,363::task::579::TaskManager.Task::(_updateState) Task=`4bf3300c-e3e6-488a-bc60-01b25d3e1990`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:12:00,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:12:00,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:12:00,364::task::974::TaskManager.Task::(_decref) Task=`4bf3300c-e3e6-488a-bc60-01b25d3e1990`::ref 0 aborting False >Thread-286262::DEBUG::2014-01-16 16:12:00,609::task::579::TaskManager.Task::(_updateState) Task=`0ac7e074-6889-4878-aca2-8a4d68539ba8`::moving from state init -> state preparing >Thread-286262::INFO::2014-01-16 16:12:00,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286262::INFO::2014-01-16 16:12:00,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260653', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229311', 'lastCheck': '9.0', 'valid': True}} >Thread-286262::DEBUG::2014-01-16 16:12:00,610::task::1168::TaskManager.Task::(prepare) Task=`0ac7e074-6889-4878-aca2-8a4d68539ba8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260653', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229311', 'lastCheck': '9.0', 'valid': True}} >Thread-286262::DEBUG::2014-01-16 16:12:00,610::task::579::TaskManager.Task::(_updateState) Task=`0ac7e074-6889-4878-aca2-8a4d68539ba8`::moving from state preparing -> state finished >Thread-286262::DEBUG::2014-01-16 16:12:00,610::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286262::DEBUG::2014-01-16 16:12:00,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286262::DEBUG::2014-01-16 16:12:00,610::task::974::TaskManager.Task::(_decref) Task=`0ac7e074-6889-4878-aca2-8a4d68539ba8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:01,270::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:12:01,271::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:12:01,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:12:01,622::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:12:01,639::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:01,643::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:12:01,645::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000328697 s, 12.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:02,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:12:02,272::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:12:03,243::task::579::TaskManager.Task::(_updateState) Task=`291492a6-ada7-4f52-b0a1-e6fa5a571af7`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:12:03,244::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:12:03,244::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:12:03,244::task::1168::TaskManager.Task::(prepare) Task=`291492a6-ada7-4f52-b0a1-e6fa5a571af7`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:12:03,244::task::579::TaskManager.Task::(_updateState) Task=`291492a6-ada7-4f52-b0a1-e6fa5a571af7`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:12:03,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:12:03,245::task::579::TaskManager.Task::(_updateState) Task=`bed42503-74d6-4114-9478-8b0aecf29c69`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:12:03,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 16:12:03,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::INFO::2014-01-16 16:12:03,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:12:03,246::task::974::TaskManager.Task::(_decref) Task=`291492a6-ada7-4f52-b0a1-e6fa5a571af7`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:12:03,247::task::1168::TaskManager.Task::(prepare) Task=`bed42503-74d6-4114-9478-8b0aecf29c69`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:12:03,247::task::579::TaskManager.Task::(_updateState) Task=`bed42503-74d6-4114-9478-8b0aecf29c69`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:12:03,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:12:03,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:12:03,247::task::974::TaskManager.Task::(_decref) Task=`bed42503-74d6-4114-9478-8b0aecf29c69`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:12:03,250::task::579::TaskManager.Task::(_updateState) Task=`8f7d3706-3362-4c32-8b0a-7198301783a2`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:12:03,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:12:03,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:12:03,251::task::1168::TaskManager.Task::(prepare) Task=`8f7d3706-3362-4c32-8b0a-7198301783a2`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:12:03,251::task::579::TaskManager.Task::(_updateState) Task=`8f7d3706-3362-4c32-8b0a-7198301783a2`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:12:03,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:12:03,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:12:03,252::task::974::TaskManager.Task::(_decref) Task=`8f7d3706-3362-4c32-8b0a-7198301783a2`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:12:03,252::task::579::TaskManager.Task::(_updateState) Task=`1859f3bd-7de1-4fc4-9146-b3ad419458f4`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:12:03,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:12:03,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:12:03,253::task::1168::TaskManager.Task::(prepare) Task=`1859f3bd-7de1-4fc4-9146-b3ad419458f4`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:12:03,253::task::579::TaskManager.Task::(_updateState) Task=`1859f3bd-7de1-4fc4-9146-b3ad419458f4`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:12:03,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:12:03,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:12:03,253::task::974::TaskManager.Task::(_decref) Task=`1859f3bd-7de1-4fc4-9146-b3ad419458f4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:03,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:12:03,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:12:03,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:12:03,274::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:03,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:04,275::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:12:04,372::task::579::TaskManager.Task::(_updateState) Task=`bc684031-bbea-4956-b4ab-ea9d95a1a512`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:12:04,372::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:12:04,373::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:12:04,373::task::1168::TaskManager.Task::(prepare) Task=`bc684031-bbea-4956-b4ab-ea9d95a1a512`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:12:04,373::task::579::TaskManager.Task::(_updateState) Task=`bc684031-bbea-4956-b4ab-ea9d95a1a512`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:12:04,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:12:04,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:12:04,374::task::974::TaskManager.Task::(_decref) Task=`bc684031-bbea-4956-b4ab-ea9d95a1a512`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:12:04,374::task::579::TaskManager.Task::(_updateState) Task=`db49bac1-afa0-442b-9b9e-12209ed7243a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:12:04,374::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:12:04,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:12:04,375::task::1168::TaskManager.Task::(prepare) Task=`db49bac1-afa0-442b-9b9e-12209ed7243a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:12:04,375::task::579::TaskManager.Task::(_updateState) Task=`db49bac1-afa0-442b-9b9e-12209ed7243a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:12:04,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:12:04,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:12:04,376::task::974::TaskManager.Task::(_decref) Task=`db49bac1-afa0-442b-9b9e-12209ed7243a`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:12:04,671::task::579::TaskManager.Task::(_updateState) Task=`1da08195-f561-47b2-ad50-5c7116ff388c`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:12:04,671::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:12:04,672::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:12:04,672::task::1168::TaskManager.Task::(prepare) Task=`1da08195-f561-47b2-ad50-5c7116ff388c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:12:04,672::task::579::TaskManager.Task::(_updateState) Task=`1da08195-f561-47b2-ad50-5c7116ff388c`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:12:04,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:12:04,672::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:12:04,672::task::974::TaskManager.Task::(_decref) Task=`1da08195-f561-47b2-ad50-5c7116ff388c`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:12:04,784::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:12:04,802::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026005 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:12:04,805::task::579::TaskManager.Task::(_updateState) Task=`e9a73a97-4ef8-4f9b-969e-346b43da6a3d`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:12:04,805::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:12:04,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:12:04,806::task::1168::TaskManager.Task::(prepare) Task=`e9a73a97-4ef8-4f9b-969e-346b43da6a3d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:12:04,806::task::579::TaskManager.Task::(_updateState) Task=`e9a73a97-4ef8-4f9b-969e-346b43da6a3d`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:12:04,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:12:04,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:12:04,807::task::974::TaskManager.Task::(_decref) Task=`e9a73a97-4ef8-4f9b-969e-346b43da6a3d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:05,276::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:12:05,276::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:12:05,276::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:12:05,277::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:05,277::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:12:05,277::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:12:05,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:12:05,773::task::579::TaskManager.Task::(_updateState) Task=`c562d302-92a1-4580-a5d7-ccf3c3f81d8f`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:12:05,774::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:12:05,774::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:12:05,774::task::1168::TaskManager.Task::(prepare) Task=`c562d302-92a1-4580-a5d7-ccf3c3f81d8f`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:12:05,775::task::579::TaskManager.Task::(_updateState) Task=`c562d302-92a1-4580-a5d7-ccf3c3f81d8f`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:12:05,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:12:05,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:12:05,775::task::974::TaskManager.Task::(_decref) Task=`c562d302-92a1-4580-a5d7-ccf3c3f81d8f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:06,278::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:06,648::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:12:06,654::task::579::TaskManager.Task::(_updateState) Task=`34403f88-0ef5-4415-a40e-31fa602e0234`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:12:06,655::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:12:06,655::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:12:06,655::task::1168::TaskManager.Task::(prepare) Task=`34403f88-0ef5-4415-a40e-31fa602e0234`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:12:06,655::task::579::TaskManager.Task::(_updateState) Task=`34403f88-0ef5-4415-a40e-31fa602e0234`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:12:06,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:12:06,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:12:06,656::task::974::TaskManager.Task::(_decref) Task=`34403f88-0ef5-4415-a40e-31fa602e0234`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:07,280::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:12:07,280::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:12:07,280::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:07,649::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:08,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:12:08,282::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:12:08,282::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:09,282::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:12:09,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:12:09,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:12:09,284::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:09,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:12:09,697::task::579::TaskManager.Task::(_updateState) Task=`7c5557bc-c4dd-425c-b428-f3ae7230092f`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:12:09,697::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:12:09,698::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:12:09,698::task::1168::TaskManager.Task::(prepare) Task=`7c5557bc-c4dd-425c-b428-f3ae7230092f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:12:09,698::task::579::TaskManager.Task::(_updateState) Task=`7c5557bc-c4dd-425c-b428-f3ae7230092f`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:12:09,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:12:09,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:12:09,699::task::974::TaskManager.Task::(_decref) Task=`7c5557bc-c4dd-425c-b428-f3ae7230092f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:10,285::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:11,286::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:12:11,286::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:12:11,651::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:12:11,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:11,669::task::579::TaskManager.Task::(_updateState) Task=`a0f2e15e-dad5-4778-901c-171da43bbe97`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:12:11,671::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:12:11,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:12:11,675::task::1168::TaskManager.Task::(prepare) Task=`a0f2e15e-dad5-4778-901c-171da43bbe97`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:12:11,677::task::579::TaskManager.Task::(_updateState) Task=`a0f2e15e-dad5-4778-901c-171da43bbe97`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:12:11,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:12:11,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:12:11,682::task::974::TaskManager.Task::(_decref) Task=`a0f2e15e-dad5-4778-901c-171da43bbe97`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:12:11,684::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00030126 s, 13.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:12:11,685::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:12:11,687::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:12:11,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:11,696::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:11,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:12,287::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:13,288::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:12:13,328::task::579::TaskManager.Task::(_updateState) Task=`3bee15e5-6614-4391-a905-3cf4115f3589`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:12:13,328::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:12:13,329::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:12:13,329::task::1168::TaskManager.Task::(prepare) Task=`3bee15e5-6614-4391-a905-3cf4115f3589`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:12:13,329::task::579::TaskManager.Task::(_updateState) Task=`3bee15e5-6614-4391-a905-3cf4115f3589`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:12:13,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:12:13,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:12:13,330::task::974::TaskManager.Task::(_decref) Task=`3bee15e5-6614-4391-a905-3cf4115f3589`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:13,699::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:14,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:12:14,506::task::579::TaskManager.Task::(_updateState) Task=`0c3c7ce7-d75f-4823-b0a3-9ebcd45f150a`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:12:14,506::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:12:14,508::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:12:14,508::task::1168::TaskManager.Task::(prepare) Task=`0c3c7ce7-d75f-4823-b0a3-9ebcd45f150a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:12:14,508::task::579::TaskManager.Task::(_updateState) Task=`0c3c7ce7-d75f-4823-b0a3-9ebcd45f150a`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:12:14,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:12:14,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:12:14,508::task::974::TaskManager.Task::(_decref) Task=`0c3c7ce7-d75f-4823-b0a3-9ebcd45f150a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:12:14,809::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:12:14,825::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292814 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:15,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:12:15,616::task::579::TaskManager.Task::(_updateState) Task=`f64163ff-3dda-4c56-84cc-6de72e338470`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:12:15,617::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:12:15,617::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:12:15,617::task::1168::TaskManager.Task::(prepare) Task=`f64163ff-3dda-4c56-84cc-6de72e338470`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:12:15,617::task::579::TaskManager.Task::(_updateState) Task=`f64163ff-3dda-4c56-84cc-6de72e338470`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:12:15,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:12:15,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:12:15,618::task::974::TaskManager.Task::(_decref) Task=`f64163ff-3dda-4c56-84cc-6de72e338470`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:12:15,618::task::579::TaskManager.Task::(_updateState) Task=`cf998487-7c27-4258-9889-c055d5f4f1fd`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:12:15,618::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:12:15,619::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:12:15,619::task::1168::TaskManager.Task::(prepare) Task=`cf998487-7c27-4258-9889-c055d5f4f1fd`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:12:15,619::task::579::TaskManager.Task::(_updateState) Task=`cf998487-7c27-4258-9889-c055d5f4f1fd`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:12:15,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:12:15,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:12:15,619::task::974::TaskManager.Task::(_decref) Task=`cf998487-7c27-4258-9889-c055d5f4f1fd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:15,700::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:16,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286268::DEBUG::2014-01-16 16:12:16,506::task::579::TaskManager.Task::(_updateState) Task=`6e82965d-49f9-4339-91e5-a5ae4cd19073`::moving from state init -> state preparing >Thread-286268::INFO::2014-01-16 16:12:16,506::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286268::INFO::2014-01-16 16:12:16,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292814', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030126', 'lastCheck': '4.8', 'valid': True}} >Thread-286268::DEBUG::2014-01-16 16:12:16,507::task::1168::TaskManager.Task::(prepare) Task=`6e82965d-49f9-4339-91e5-a5ae4cd19073`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292814', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030126', 'lastCheck': '4.8', 'valid': True}} >Thread-286268::DEBUG::2014-01-16 16:12:16,507::task::579::TaskManager.Task::(_updateState) Task=`6e82965d-49f9-4339-91e5-a5ae4cd19073`::moving from state preparing -> state finished >Thread-286268::DEBUG::2014-01-16 16:12:16,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286268::DEBUG::2014-01-16 16:12:16,507::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286268::DEBUG::2014-01-16 16:12:16,507::task::974::TaskManager.Task::(_decref) Task=`6e82965d-49f9-4339-91e5-a5ae4cd19073`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:16,702::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:17,292::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:12:17,292::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:17,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:18,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:19,294::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:19,704::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:20,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:21,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:12:21,407::task::579::TaskManager.Task::(_updateState) Task=`5e7242fc-8c71-410f-b469-28319c96475c`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:12:21,407::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:12:21,407::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:12:21,407::task::1168::TaskManager.Task::(prepare) Task=`5e7242fc-8c71-410f-b469-28319c96475c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:12:21,408::task::579::TaskManager.Task::(_updateState) Task=`5e7242fc-8c71-410f-b469-28319c96475c`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:12:21,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:12:21,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:12:21,408::task::974::TaskManager.Task::(_decref) Task=`5e7242fc-8c71-410f-b469-28319c96475c`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:12:21,697::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:12:21,714::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:21,718::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:12:21,721::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000230886 s, 17.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:22,297::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:12:22,298::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:12:22,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:12:23,161::task::579::TaskManager.Task::(_updateState) Task=`0ff266c2-db0f-4ad6-aa44-ddb4ac1928e0`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:12:23,161::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:12:23,162::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:12:23,162::task::1168::TaskManager.Task::(prepare) Task=`0ff266c2-db0f-4ad6-aa44-ddb4ac1928e0`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:12:23,162::task::579::TaskManager.Task::(_updateState) Task=`0ff266c2-db0f-4ad6-aa44-ddb4ac1928e0`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:12:23,162::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:12:23,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:12:23,162::task::974::TaskManager.Task::(_decref) Task=`0ff266c2-db0f-4ad6-aa44-ddb4ac1928e0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:23,299::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:12:23,300::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:23,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:24,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:12:24,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:12:24,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:12:24,833::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:12:24,849::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0003065 s, 1.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:12:24,939::task::579::TaskManager.Task::(_updateState) Task=`524d652b-1a01-4da6-b7ff-4e8de0e6a961`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:12:24,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:12:24,939::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:12:24,940::task::1168::TaskManager.Task::(prepare) Task=`524d652b-1a01-4da6-b7ff-4e8de0e6a961`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:12:24,940::task::579::TaskManager.Task::(_updateState) Task=`524d652b-1a01-4da6-b7ff-4e8de0e6a961`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:12:24,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:12:24,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:12:24,940::task::974::TaskManager.Task::(_decref) Task=`524d652b-1a01-4da6-b7ff-4e8de0e6a961`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:12:25,023::task::579::TaskManager.Task::(_updateState) Task=`66e05022-3fb1-4678-a723-023df7a6cc63`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:12:25,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:12:25,024::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:12:25,024::task::1168::TaskManager.Task::(prepare) Task=`66e05022-3fb1-4678-a723-023df7a6cc63`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:12:25,024::task::579::TaskManager.Task::(_updateState) Task=`66e05022-3fb1-4678-a723-023df7a6cc63`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:12:25,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:12:25,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:12:25,025::task::974::TaskManager.Task::(_decref) Task=`66e05022-3fb1-4678-a723-023df7a6cc63`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:25,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:12:25,303::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:25,722::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:26,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:12:26,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:26,726::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:12:26,726::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:12:26,727::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:27,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:27,728::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:28,307::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:12:28,307::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:29,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:12:29,308::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:29,730::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:12:29,865::task::579::TaskManager.Task::(_updateState) Task=`f56f5a7f-aba0-4dee-af82-89ea76fdf6aa`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:12:29,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:12:29,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:12:29,866::task::1168::TaskManager.Task::(prepare) Task=`f56f5a7f-aba0-4dee-af82-89ea76fdf6aa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:12:29,866::task::579::TaskManager.Task::(_updateState) Task=`f56f5a7f-aba0-4dee-af82-89ea76fdf6aa`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:12:29,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:12:29,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:12:29,866::task::974::TaskManager.Task::(_decref) Task=`f56f5a7f-aba0-4dee-af82-89ea76fdf6aa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:30,309::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:12:30,310::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:12:30,310::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:12:30,310::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:31,311::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:12:31,311::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:12:31,311::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:12:31,727::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:12:31,743::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:31,748::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:12:31,750::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000293431 s, 14.0 MB/s\n'; <rc> = 0 >Thread-286274::DEBUG::2014-01-16 16:12:32,235::task::579::TaskManager.Task::(_updateState) Task=`a725943b-4359-4b6f-be54-1e2fe85d6156`::moving from state init -> state preparing >Thread-286274::INFO::2014-01-16 16:12:32,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286274::INFO::2014-01-16 16:12:32,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0003065', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293431', 'lastCheck': '0.5', 'valid': True}} >Thread-286274::DEBUG::2014-01-16 16:12:32,236::task::1168::TaskManager.Task::(prepare) Task=`a725943b-4359-4b6f-be54-1e2fe85d6156`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0003065', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293431', 'lastCheck': '0.5', 'valid': True}} >Thread-286274::DEBUG::2014-01-16 16:12:32,236::task::579::TaskManager.Task::(_updateState) Task=`a725943b-4359-4b6f-be54-1e2fe85d6156`::moving from state preparing -> state finished >Thread-286274::DEBUG::2014-01-16 16:12:32,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286274::DEBUG::2014-01-16 16:12:32,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286274::DEBUG::2014-01-16 16:12:32,237::task::974::TaskManager.Task::(_decref) Task=`a725943b-4359-4b6f-be54-1e2fe85d6156`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:32,313::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:12:32,315::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:12:32,738::task::579::TaskManager.Task::(_updateState) Task=`66cb2922-a296-476d-9951-020459673861`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:12:32,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:12:32,739::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:12:32,739::task::1168::TaskManager.Task::(prepare) Task=`66cb2922-a296-476d-9951-020459673861`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:12:32,739::task::579::TaskManager.Task::(_updateState) Task=`66cb2922-a296-476d-9951-020459673861`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:12:32,739::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:12:32,739::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:12:32,740::task::974::TaskManager.Task::(_decref) Task=`66cb2922-a296-476d-9951-020459673861`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:33,315::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:12:33,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:12:33,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:12:33,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:12:33,434::task::579::TaskManager.Task::(_updateState) Task=`d69de65c-3e06-47a5-a857-97f29e305060`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:12:33,434::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:12:33,435::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:12:33,435::task::1168::TaskManager.Task::(prepare) Task=`d69de65c-3e06-47a5-a857-97f29e305060`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:12:33,435::task::579::TaskManager.Task::(_updateState) Task=`d69de65c-3e06-47a5-a857-97f29e305060`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:12:33,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:12:33,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:12:33,435::task::974::TaskManager.Task::(_decref) Task=`d69de65c-3e06-47a5-a857-97f29e305060`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:12:33,446::task::579::TaskManager.Task::(_updateState) Task=`b9c6c7b6-6f06-482b-812f-199f2fea6143`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:12:33,447::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:12:33,447::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:12:33,447::task::1168::TaskManager.Task::(prepare) Task=`b9c6c7b6-6f06-482b-812f-199f2fea6143`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:12:33,447::task::579::TaskManager.Task::(_updateState) Task=`b9c6c7b6-6f06-482b-812f-199f2fea6143`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:12:33,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:12:33,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:12:33,448::task::974::TaskManager.Task::(_decref) Task=`b9c6c7b6-6f06-482b-812f-199f2fea6143`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:12:33,448::task::579::TaskManager.Task::(_updateState) Task=`bf516953-73ad-47d1-9995-9ab1ee802c96`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:12:33,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:12:33,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:12:33,448::task::1168::TaskManager.Task::(prepare) Task=`bf516953-73ad-47d1-9995-9ab1ee802c96`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:12:33,449::task::579::TaskManager.Task::(_updateState) Task=`bf516953-73ad-47d1-9995-9ab1ee802c96`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:12:33,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:12:33,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:12:33,449::task::974::TaskManager.Task::(_decref) Task=`bf516953-73ad-47d1-9995-9ab1ee802c96`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:33,751::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:34,317::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:12:34,373::task::579::TaskManager.Task::(_updateState) Task=`e546e177-4427-452e-b333-7579b0f39f39`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:12:34,373::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:12:34,373::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:12:34,373::task::1168::TaskManager.Task::(prepare) Task=`e546e177-4427-452e-b333-7579b0f39f39`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:12:34,374::task::579::TaskManager.Task::(_updateState) Task=`e546e177-4427-452e-b333-7579b0f39f39`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:12:34,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:12:34,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:12:34,374::task::974::TaskManager.Task::(_decref) Task=`e546e177-4427-452e-b333-7579b0f39f39`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:12:34,750::task::579::TaskManager.Task::(_updateState) Task=`c33192d7-032c-46cb-9c38-9deea850272c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:12:34,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:12:34,750::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:12:34,750::task::1168::TaskManager.Task::(prepare) Task=`c33192d7-032c-46cb-9c38-9deea850272c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:12:34,751::task::579::TaskManager.Task::(_updateState) Task=`c33192d7-032c-46cb-9c38-9deea850272c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:12:34,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:12:34,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:12:34,751::task::974::TaskManager.Task::(_decref) Task=`c33192d7-032c-46cb-9c38-9deea850272c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:12:34,751::task::579::TaskManager.Task::(_updateState) Task=`1626a152-a360-4ede-b397-73795b8a527a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:12:34,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-12152::DEBUG::2014-01-16 16:12:34,752::task::579::TaskManager.Task::(_updateState) Task=`2f755fc7-e481-4aa8-a670-0963cffa61e0`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:12:34,753::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-84377::INFO::2014-01-16 16:12:34,753::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:12:34,754::task::1168::TaskManager.Task::(prepare) Task=`1626a152-a360-4ede-b397-73795b8a527a`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-12152::INFO::2014-01-16 16:12:34,754::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-84377::DEBUG::2014-01-16 16:12:34,754::task::579::TaskManager.Task::(_updateState) Task=`1626a152-a360-4ede-b397-73795b8a527a`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:12:34,754::task::1168::TaskManager.Task::(prepare) Task=`2f755fc7-e481-4aa8-a670-0963cffa61e0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-84377::DEBUG::2014-01-16 16:12:34,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:12:34,755::task::579::TaskManager.Task::(_updateState) Task=`2f755fc7-e481-4aa8-a670-0963cffa61e0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:12:34,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:12:34,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:12:34,756::task::974::TaskManager.Task::(_decref) Task=`1626a152-a360-4ede-b397-73795b8a527a`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:12:34,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:12:34,757::task::579::TaskManager.Task::(_updateState) Task=`49166c0d-da1e-4caa-a7d3-b442b6e85f4d`::moving from state init -> state preparing >Thread-12152::DEBUG::2014-01-16 16:12:34,757::task::974::TaskManager.Task::(_decref) Task=`2f755fc7-e481-4aa8-a670-0963cffa61e0`::ref 0 aborting False >Thread-84377::INFO::2014-01-16 16:12:34,758::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:12:34,758::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:12:34,758::task::1168::TaskManager.Task::(prepare) Task=`49166c0d-da1e-4caa-a7d3-b442b6e85f4d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:12:34,759::task::579::TaskManager.Task::(_updateState) Task=`49166c0d-da1e-4caa-a7d3-b442b6e85f4d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:12:34,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:12:34,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:12:34,759::task::974::TaskManager.Task::(_decref) Task=`49166c0d-da1e-4caa-a7d3-b442b6e85f4d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:12:34,858::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:12:34,874::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289715 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:35,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:12:35,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:12:35,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:12:35,319::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:35,320::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:12:35,320::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:12:35,752::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:36,320::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:36,754::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:37,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:12:37,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:12:37,322::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:37,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:38,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:12:38,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:12:38,323::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:39,324::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:12:39,325::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:12:39,325::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:12:39,325::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:39,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:40,325::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:41,327::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:12:41,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:12:41,756::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:12:41,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:12:41,777::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022218 s, 18.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:12:41,778::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:12:41,780::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:12:41,785::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:42,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:12:42,372::task::579::TaskManager.Task::(_updateState) Task=`e755e1ad-4f07-4f6e-b49e-d6ad05d54e23`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:12:42,372::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:12:42,373::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:12:42,373::task::1168::TaskManager.Task::(prepare) Task=`e755e1ad-4f07-4f6e-b49e-d6ad05d54e23`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:12:42,373::task::579::TaskManager.Task::(_updateState) Task=`e755e1ad-4f07-4f6e-b49e-d6ad05d54e23`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:12:42,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:12:42,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:12:42,373::task::974::TaskManager.Task::(_decref) Task=`e755e1ad-4f07-4f6e-b49e-d6ad05d54e23`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:43,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:43,788::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:44,329::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:12:44,883::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:12:44,903::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00027252 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:45,330::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:45,789::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:46,331::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:12:46,446::task::579::TaskManager.Task::(_updateState) Task=`5bb3634a-31d0-4c0c-b73e-6d42e4e8da6e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:12:46,447::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:12:46,447::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:12:46,447::task::1168::TaskManager.Task::(prepare) Task=`5bb3634a-31d0-4c0c-b73e-6d42e4e8da6e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:12:46,448::task::579::TaskManager.Task::(_updateState) Task=`5bb3634a-31d0-4c0c-b73e-6d42e4e8da6e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:12:46,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:12:46,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:12:46,448::task::974::TaskManager.Task::(_decref) Task=`5bb3634a-31d0-4c0c-b73e-6d42e4e8da6e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:46,790::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:47,332::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:12:47,333::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:12:47,674::task::579::TaskManager.Task::(_updateState) Task=`8ab3be3c-a63c-412f-b19d-5dab4a442014`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:12:47,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:12:47,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:12:47,674::task::1168::TaskManager.Task::(prepare) Task=`8ab3be3c-a63c-412f-b19d-5dab4a442014`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:12:47,675::task::579::TaskManager.Task::(_updateState) Task=`8ab3be3c-a63c-412f-b19d-5dab4a442014`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:12:47,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:12:47,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:12:47,675::task::974::TaskManager.Task::(_decref) Task=`8ab3be3c-a63c-412f-b19d-5dab4a442014`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:12:47,675::task::579::TaskManager.Task::(_updateState) Task=`5250fd92-c1fb-412a-bad5-c80ce0ebacff`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:12:47,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:12:47,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:12:47,676::task::1168::TaskManager.Task::(prepare) Task=`5250fd92-c1fb-412a-bad5-c80ce0ebacff`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:12:47,676::task::579::TaskManager.Task::(_updateState) Task=`5250fd92-c1fb-412a-bad5-c80ce0ebacff`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:12:47,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:12:47,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:12:47,676::task::974::TaskManager.Task::(_decref) Task=`5250fd92-c1fb-412a-bad5-c80ce0ebacff`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:12:47,677::task::579::TaskManager.Task::(_updateState) Task=`2f72d41f-da4c-48a6-9dce-e3f81146b111`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:12:47,677::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:12:47,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:12:47,677::task::1168::TaskManager.Task::(prepare) Task=`2f72d41f-da4c-48a6-9dce-e3f81146b111`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:12:47,677::task::579::TaskManager.Task::(_updateState) Task=`2f72d41f-da4c-48a6-9dce-e3f81146b111`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:12:47,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:12:47,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:12:47,678::task::974::TaskManager.Task::(_decref) Task=`2f72d41f-da4c-48a6-9dce-e3f81146b111`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:47,791::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286280::DEBUG::2014-01-16 16:12:48,141::task::579::TaskManager.Task::(_updateState) Task=`22b8bf84-8aff-490e-931b-4d3cc6806b3f`::moving from state init -> state preparing >Thread-286280::INFO::2014-01-16 16:12:48,141::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286280::INFO::2014-01-16 16:12:48,142::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027252', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022218', 'lastCheck': '6.4', 'valid': True}} >Thread-286280::DEBUG::2014-01-16 16:12:48,142::task::1168::TaskManager.Task::(prepare) Task=`22b8bf84-8aff-490e-931b-4d3cc6806b3f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027252', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022218', 'lastCheck': '6.4', 'valid': True}} >Thread-286280::DEBUG::2014-01-16 16:12:48,142::task::579::TaskManager.Task::(_updateState) Task=`22b8bf84-8aff-490e-931b-4d3cc6806b3f`::moving from state preparing -> state finished >Thread-286280::DEBUG::2014-01-16 16:12:48,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286280::DEBUG::2014-01-16 16:12:48,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286280::DEBUG::2014-01-16 16:12:48,142::task::974::TaskManager.Task::(_decref) Task=`22b8bf84-8aff-490e-931b-4d3cc6806b3f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:48,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:49,335::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:49,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:50,336::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:51,337::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:12:51,790::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:12:51,809::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:12:51,812::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:12:51,813::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000239613 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:52,338::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:12:52,338::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:12:52,339::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:53,340::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:12:53,340::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:12:53,396::task::579::TaskManager.Task::(_updateState) Task=`48df3dcf-23a7-4c2c-b357-02b13783cd18`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:12:53,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:12:53,397::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:12:53,397::task::1168::TaskManager.Task::(prepare) Task=`48df3dcf-23a7-4c2c-b357-02b13783cd18`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:12:53,397::task::579::TaskManager.Task::(_updateState) Task=`48df3dcf-23a7-4c2c-b357-02b13783cd18`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:12:53,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:12:53,397::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:12:53,397::task::974::TaskManager.Task::(_decref) Task=`48df3dcf-23a7-4c2c-b357-02b13783cd18`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:12:53,814::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:54,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:12:54,342::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:12:54,342::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:12:54,911::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:12:54,927::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267231 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:12:55,343::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:12:55,343::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:55,816::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:56,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:12:56,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:56,819::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:12:56,819::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:12:56,821::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:12:57,203::task::579::TaskManager.Task::(_updateState) Task=`ca6c283c-b8e6-42dd-ba7e-3476ac88146a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:12:57,203::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:12:57,204::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:12:57,204::task::1168::TaskManager.Task::(prepare) Task=`ca6c283c-b8e6-42dd-ba7e-3476ac88146a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:12:57,204::task::579::TaskManager.Task::(_updateState) Task=`ca6c283c-b8e6-42dd-ba7e-3476ac88146a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:12:57,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:12:57,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:12:57,204::task::974::TaskManager.Task::(_decref) Task=`ca6c283c-b8e6-42dd-ba7e-3476ac88146a`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:12:57,204::task::579::TaskManager.Task::(_updateState) Task=`13e56dc5-cc5c-44d6-abf5-3fbb8631075b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:12:57,205::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:12:57,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:12:57,205::task::1168::TaskManager.Task::(prepare) Task=`13e56dc5-cc5c-44d6-abf5-3fbb8631075b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:12:57,205::task::579::TaskManager.Task::(_updateState) Task=`13e56dc5-cc5c-44d6-abf5-3fbb8631075b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:12:57,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:12:57,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:12:57,206::task::974::TaskManager.Task::(_decref) Task=`13e56dc5-cc5c-44d6-abf5-3fbb8631075b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:12:57,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:57,822::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:12:58,347::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:12:58,347::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:12:59,348::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:12:59,348::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:12:59,824::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:00,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:13:00,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:13:00,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:13:00,350::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:13:00,532::task::579::TaskManager.Task::(_updateState) Task=`e1a4808d-3ecd-44a9-b18e-ed56725edf81`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:13:00,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:13:00,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:13:00,532::task::1168::TaskManager.Task::(prepare) Task=`e1a4808d-3ecd-44a9-b18e-ed56725edf81`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:13:00,533::task::579::TaskManager.Task::(_updateState) Task=`e1a4808d-3ecd-44a9-b18e-ed56725edf81`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:13:00,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:13:00,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:13:00,533::task::974::TaskManager.Task::(_decref) Task=`e1a4808d-3ecd-44a9-b18e-ed56725edf81`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:01,351::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:13:01,352::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:13:01,352::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:13:01,818::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:13:01,835::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:01,839::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:13:01,841::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000216578 s, 18.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:02,353::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:13:02,353::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:13:03,320::task::579::TaskManager.Task::(_updateState) Task=`6d4aa4de-7808-41f4-a5fa-7cdc2c9e0256`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:13:03,321::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:13:03,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:13:03,321::task::1168::TaskManager.Task::(prepare) Task=`6d4aa4de-7808-41f4-a5fa-7cdc2c9e0256`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:13:03,321::task::579::TaskManager.Task::(_updateState) Task=`6d4aa4de-7808-41f4-a5fa-7cdc2c9e0256`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:13:03,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:13:03,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:13:03,322::task::974::TaskManager.Task::(_decref) Task=`6d4aa4de-7808-41f4-a5fa-7cdc2c9e0256`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:13:03,328::task::579::TaskManager.Task::(_updateState) Task=`2c7ad1c4-2842-46a3-8814-fa511f32e805`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:13:03,328::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:13:03,329::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:13:03,329::task::1168::TaskManager.Task::(prepare) Task=`2c7ad1c4-2842-46a3-8814-fa511f32e805`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:13:03,329::task::579::TaskManager.Task::(_updateState) Task=`2c7ad1c4-2842-46a3-8814-fa511f32e805`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:13:03,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:13:03,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:13:03,330::task::974::TaskManager.Task::(_decref) Task=`2c7ad1c4-2842-46a3-8814-fa511f32e805`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:03,354::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:13:03,354::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:13:03,354::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:13:03,354::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:13:03,477::task::579::TaskManager.Task::(_updateState) Task=`e8c59404-737f-439e-9ad6-efdbdc2fce5f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:13:03,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:13:03,477::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:13:03,478::task::1168::TaskManager.Task::(prepare) Task=`e8c59404-737f-439e-9ad6-efdbdc2fce5f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:13:03,478::task::579::TaskManager.Task::(_updateState) Task=`e8c59404-737f-439e-9ad6-efdbdc2fce5f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:13:03,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:13:03,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:13:03,478::task::974::TaskManager.Task::(_decref) Task=`e8c59404-737f-439e-9ad6-efdbdc2fce5f`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:13:03,478::task::579::TaskManager.Task::(_updateState) Task=`8a9a148a-2fbe-4a1b-bba0-9025fa2b2fb1`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:13:03,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:13:03,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:13:03,479::task::1168::TaskManager.Task::(prepare) Task=`8a9a148a-2fbe-4a1b-bba0-9025fa2b2fb1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:13:03,479::task::579::TaskManager.Task::(_updateState) Task=`8a9a148a-2fbe-4a1b-bba0-9025fa2b2fb1`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:13:03,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:13:03,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:13:03,479::task::974::TaskManager.Task::(_decref) Task=`8a9a148a-2fbe-4a1b-bba0-9025fa2b2fb1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:03,841::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286286::DEBUG::2014-01-16 16:13:03,952::task::579::TaskManager.Task::(_updateState) Task=`ce691ee1-2b6a-41b2-a0f0-c1b2bb8e6fa6`::moving from state init -> state preparing >Thread-286286::INFO::2014-01-16 16:13:03,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286286::INFO::2014-01-16 16:13:03,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267231', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216578', 'lastCheck': '2.1', 'valid': True}} >Thread-286286::DEBUG::2014-01-16 16:13:03,952::task::1168::TaskManager.Task::(prepare) Task=`ce691ee1-2b6a-41b2-a0f0-c1b2bb8e6fa6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267231', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216578', 'lastCheck': '2.1', 'valid': True}} >Thread-286286::DEBUG::2014-01-16 16:13:03,952::task::579::TaskManager.Task::(_updateState) Task=`ce691ee1-2b6a-41b2-a0f0-c1b2bb8e6fa6`::moving from state preparing -> state finished >Thread-286286::DEBUG::2014-01-16 16:13:03,952::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286286::DEBUG::2014-01-16 16:13:03,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286286::DEBUG::2014-01-16 16:13:03,953::task::974::TaskManager.Task::(_decref) Task=`ce691ee1-2b6a-41b2-a0f0-c1b2bb8e6fa6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:04,355::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:13:04,475::task::579::TaskManager.Task::(_updateState) Task=`c081c9ee-4ea4-4bef-bc00-0f8979ae926b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:13:04,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:13:04,477::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:13:04,477::task::1168::TaskManager.Task::(prepare) Task=`c081c9ee-4ea4-4bef-bc00-0f8979ae926b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:13:04,477::task::579::TaskManager.Task::(_updateState) Task=`c081c9ee-4ea4-4bef-bc00-0f8979ae926b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:13:04,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:13:04,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:13:04,478::task::974::TaskManager.Task::(_decref) Task=`c081c9ee-4ea4-4bef-bc00-0f8979ae926b`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:13:04,478::task::579::TaskManager.Task::(_updateState) Task=`a0a14074-b811-4fbb-90c1-b814855c4804`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:13:04,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:13:04,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:13:04,478::task::1168::TaskManager.Task::(prepare) Task=`a0a14074-b811-4fbb-90c1-b814855c4804`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:13:04,478::task::579::TaskManager.Task::(_updateState) Task=`a0a14074-b811-4fbb-90c1-b814855c4804`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:13:04,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:13:04,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:13:04,479::task::974::TaskManager.Task::(_decref) Task=`a0a14074-b811-4fbb-90c1-b814855c4804`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:13:04,844::task::579::TaskManager.Task::(_updateState) Task=`7a8e2a57-22f6-4484-baa9-a149fb7ce0fd`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:13:04,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:13:04,845::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:13:04,845::task::1168::TaskManager.Task::(prepare) Task=`7a8e2a57-22f6-4484-baa9-a149fb7ce0fd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:13:04,845::task::579::TaskManager.Task::(_updateState) Task=`7a8e2a57-22f6-4484-baa9-a149fb7ce0fd`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:13:04,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:13:04,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:13:04,846::task::974::TaskManager.Task::(_decref) Task=`7a8e2a57-22f6-4484-baa9-a149fb7ce0fd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:13:04,936::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:13:04,954::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271362 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:13:04,957::task::579::TaskManager.Task::(_updateState) Task=`9b12353c-56ee-4c03-8e21-a4d42367d872`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:13:04,960::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:13:04,962::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:13:04,962::task::1168::TaskManager.Task::(prepare) Task=`9b12353c-56ee-4c03-8e21-a4d42367d872`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:13:04,962::task::579::TaskManager.Task::(_updateState) Task=`9b12353c-56ee-4c03-8e21-a4d42367d872`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:13:04,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:13:04,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:13:04,963::task::974::TaskManager.Task::(_decref) Task=`9b12353c-56ee-4c03-8e21-a4d42367d872`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:05,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:13:05,357::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:13:05,357::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:13:05,357::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:05,357::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:13:05,358::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:13:05,843::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:13:05,941::task::579::TaskManager.Task::(_updateState) Task=`bb8e3767-f420-483e-8e4c-b2eb03fbcd6a`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:13:05,942::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:13:05,942::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:13:05,942::task::1168::TaskManager.Task::(prepare) Task=`bb8e3767-f420-483e-8e4c-b2eb03fbcd6a`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:13:05,943::task::579::TaskManager.Task::(_updateState) Task=`bb8e3767-f420-483e-8e4c-b2eb03fbcd6a`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:13:05,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:13:05,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:13:05,943::task::974::TaskManager.Task::(_decref) Task=`bb8e3767-f420-483e-8e4c-b2eb03fbcd6a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:06,358::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:06,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:13:06,848::task::579::TaskManager.Task::(_updateState) Task=`4678845c-e063-43c0-af1a-7c7d30e416d7`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:13:06,848::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:13:06,849::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:13:06,849::task::1168::TaskManager.Task::(prepare) Task=`4678845c-e063-43c0-af1a-7c7d30e416d7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:13:06,849::task::579::TaskManager.Task::(_updateState) Task=`4678845c-e063-43c0-af1a-7c7d30e416d7`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:13:06,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:13:06,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:13:06,850::task::974::TaskManager.Task::(_decref) Task=`4678845c-e063-43c0-af1a-7c7d30e416d7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:07,359::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:13:07,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:13:07,360::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:07,845::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:08,361::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:13:08,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:13:08,362::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:09,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:13:09,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:13:09,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:13:09,364::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:09,847::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:13:09,869::task::579::TaskManager.Task::(_updateState) Task=`334d957e-9546-431e-a0f7-579299b5662b`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:13:09,869::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:13:09,870::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:13:09,870::task::1168::TaskManager.Task::(prepare) Task=`334d957e-9546-431e-a0f7-579299b5662b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:13:09,870::task::579::TaskManager.Task::(_updateState) Task=`334d957e-9546-431e-a0f7-579299b5662b`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:13:09,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:13:09,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:13:09,871::task::974::TaskManager.Task::(_decref) Task=`334d957e-9546-431e-a0f7-579299b5662b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:10,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:11,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:13:11,366::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:13:11,848::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:13:11,862::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:11,866::task::579::TaskManager.Task::(_updateState) Task=`d59140de-2343-4c33-b3e2-5bc440ea7df4`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:13:11,868::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:13:11,871::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:13:11,872::task::1168::TaskManager.Task::(prepare) Task=`d59140de-2343-4c33-b3e2-5bc440ea7df4`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:13:11,873::task::579::TaskManager.Task::(_updateState) Task=`d59140de-2343-4c33-b3e2-5bc440ea7df4`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:13:11,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:13:11,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:13:11,878::task::974::TaskManager.Task::(_decref) Task=`d59140de-2343-4c33-b3e2-5bc440ea7df4`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:13:11,880::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000286693 s, 14.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:13:11,881::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:13:11,883::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:13:11,888::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:11,891::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:11,892::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:12,366::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:13,368::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:13:13,487::task::579::TaskManager.Task::(_updateState) Task=`0038c9e8-53bd-4351-9f40-b5b0a51fc8d5`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:13:13,488::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:13:13,488::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:13:13,488::task::1168::TaskManager.Task::(prepare) Task=`0038c9e8-53bd-4351-9f40-b5b0a51fc8d5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:13:13,488::task::579::TaskManager.Task::(_updateState) Task=`0038c9e8-53bd-4351-9f40-b5b0a51fc8d5`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:13:13,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:13:13,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:13:13,489::task::974::TaskManager.Task::(_decref) Task=`0038c9e8-53bd-4351-9f40-b5b0a51fc8d5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:13,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:14,369::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:13:14,584::task::579::TaskManager.Task::(_updateState) Task=`d870a916-dcc5-4988-8d95-23d16c6b9ab9`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:13:14,584::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:13:14,584::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:13:14,584::task::1168::TaskManager.Task::(prepare) Task=`d870a916-dcc5-4988-8d95-23d16c6b9ab9`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:13:14,585::task::579::TaskManager.Task::(_updateState) Task=`d870a916-dcc5-4988-8d95-23d16c6b9ab9`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:13:14,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:13:14,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:13:14,585::task::974::TaskManager.Task::(_decref) Task=`d870a916-dcc5-4988-8d95-23d16c6b9ab9`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:13:14,967::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:13:14,984::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267472 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:15,371::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:15,894::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:13:15,996::task::579::TaskManager.Task::(_updateState) Task=`7efde908-2df6-4f51-bd98-ce7431617c46`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:13:15,997::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:13:15,997::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:13:15,997::task::1168::TaskManager.Task::(prepare) Task=`7efde908-2df6-4f51-bd98-ce7431617c46`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:13:15,997::task::579::TaskManager.Task::(_updateState) Task=`7efde908-2df6-4f51-bd98-ce7431617c46`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:13:15,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:13:15,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:13:15,998::task::974::TaskManager.Task::(_decref) Task=`7efde908-2df6-4f51-bd98-ce7431617c46`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:13:15,998::task::579::TaskManager.Task::(_updateState) Task=`acfb4e64-7678-4576-bd7e-f951df2eb2d5`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:13:15,998::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:13:15,999::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:13:15,999::task::1168::TaskManager.Task::(prepare) Task=`acfb4e64-7678-4576-bd7e-f951df2eb2d5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:13:15,999::task::579::TaskManager.Task::(_updateState) Task=`acfb4e64-7678-4576-bd7e-f951df2eb2d5`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:13:15,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:13:15,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:13:15,999::task::974::TaskManager.Task::(_decref) Task=`acfb4e64-7678-4576-bd7e-f951df2eb2d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:16,372::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:16,896::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:17,373::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:13:17,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:17,897::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:18,374::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:19,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286292::DEBUG::2014-01-16 16:13:19,666::task::579::TaskManager.Task::(_updateState) Task=`c478604a-10da-4cc9-acae-9f85bbeb8ae1`::moving from state init -> state preparing >Thread-286292::INFO::2014-01-16 16:13:19,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286292::INFO::2014-01-16 16:13:19,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267472', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286693', 'lastCheck': '7.8', 'valid': True}} >Thread-286292::DEBUG::2014-01-16 16:13:19,667::task::1168::TaskManager.Task::(prepare) Task=`c478604a-10da-4cc9-acae-9f85bbeb8ae1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267472', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286693', 'lastCheck': '7.8', 'valid': True}} >Thread-286292::DEBUG::2014-01-16 16:13:19,667::task::579::TaskManager.Task::(_updateState) Task=`c478604a-10da-4cc9-acae-9f85bbeb8ae1`::moving from state preparing -> state finished >Thread-286292::DEBUG::2014-01-16 16:13:19,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286292::DEBUG::2014-01-16 16:13:19,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286292::DEBUG::2014-01-16 16:13:19,667::task::974::TaskManager.Task::(_decref) Task=`c478604a-10da-4cc9-acae-9f85bbeb8ae1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:19,898::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:20,376::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:21,377::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:13:21,575::task::579::TaskManager.Task::(_updateState) Task=`c48f1033-264f-4211-bf5c-b22287925e6f`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:13:21,576::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:13:21,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:13:21,577::task::1168::TaskManager.Task::(prepare) Task=`c48f1033-264f-4211-bf5c-b22287925e6f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:13:21,577::task::579::TaskManager.Task::(_updateState) Task=`c48f1033-264f-4211-bf5c-b22287925e6f`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:13:21,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:13:21,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:13:21,577::task::974::TaskManager.Task::(_decref) Task=`c48f1033-264f-4211-bf5c-b22287925e6f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:13:21,893::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:13:21,910::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:21,914::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:13:21,917::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000266773 s, 15.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:22,379::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:13:22,380::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:13:22,380::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:13:23,225::task::579::TaskManager.Task::(_updateState) Task=`c704dbab-ea70-4827-8d7c-52f7dc3dc01e`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:13:23,225::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:13:23,226::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:13:23,227::task::1168::TaskManager.Task::(prepare) Task=`c704dbab-ea70-4827-8d7c-52f7dc3dc01e`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:13:23,227::task::579::TaskManager.Task::(_updateState) Task=`c704dbab-ea70-4827-8d7c-52f7dc3dc01e`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:13:23,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:13:23,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:13:23,227::task::974::TaskManager.Task::(_decref) Task=`c704dbab-ea70-4827-8d7c-52f7dc3dc01e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:23,381::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:13:23,381::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:23,917::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:24,382::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:13:24,382::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:13:24,382::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:13:24,994::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:13:25,011::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000293708 s, 1.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:13:25,097::task::579::TaskManager.Task::(_updateState) Task=`7f3f444a-e405-43e5-90b0-fac24148f619`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:13:25,097::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:13:25,098::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:13:25,098::task::1168::TaskManager.Task::(prepare) Task=`7f3f444a-e405-43e5-90b0-fac24148f619`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:13:25,098::task::579::TaskManager.Task::(_updateState) Task=`7f3f444a-e405-43e5-90b0-fac24148f619`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:13:25,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:13:25,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:13:25,099::task::974::TaskManager.Task::(_decref) Task=`7f3f444a-e405-43e5-90b0-fac24148f619`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:13:25,189::task::579::TaskManager.Task::(_updateState) Task=`052520ec-20d9-43eb-b61e-8ee19071a0cb`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:13:25,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:13:25,189::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:13:25,189::task::1168::TaskManager.Task::(prepare) Task=`052520ec-20d9-43eb-b61e-8ee19071a0cb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:13:25,190::task::579::TaskManager.Task::(_updateState) Task=`052520ec-20d9-43eb-b61e-8ee19071a0cb`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:13:25,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:13:25,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:13:25,190::task::974::TaskManager.Task::(_decref) Task=`052520ec-20d9-43eb-b61e-8ee19071a0cb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:25,383::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:13:25,383::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:25,919::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:26,384::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:13:26,384::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:26,921::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:13:26,921::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:13:26,930::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:27,385::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:27,931::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:28,386::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:13:28,387::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:29,387::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:13:29,387::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:29,932::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:13:30,036::task::579::TaskManager.Task::(_updateState) Task=`d5c87bf0-2f51-4912-b1f8-a4a7d8aef648`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:13:30,037::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:13:30,037::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:13:30,037::task::1168::TaskManager.Task::(prepare) Task=`d5c87bf0-2f51-4912-b1f8-a4a7d8aef648`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:13:30,037::task::579::TaskManager.Task::(_updateState) Task=`d5c87bf0-2f51-4912-b1f8-a4a7d8aef648`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:13:30,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:13:30,038::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:13:30,038::task::974::TaskManager.Task::(_decref) Task=`d5c87bf0-2f51-4912-b1f8-a4a7d8aef648`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:30,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:13:30,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:13:30,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:13:30,389::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:31,391::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:13:31,391::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:13:31,391::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:13:31,924::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:13:31,941::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:31,945::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:13:31,948::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000216036 s, 19.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:32,393::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:13:32,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:13:32,897::task::579::TaskManager.Task::(_updateState) Task=`ab31d14e-fbcb-496c-9b72-48d8135cdc7b`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:13:32,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:13:32,898::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:13:32,898::task::1168::TaskManager.Task::(prepare) Task=`ab31d14e-fbcb-496c-9b72-48d8135cdc7b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:13:32,899::task::579::TaskManager.Task::(_updateState) Task=`ab31d14e-fbcb-496c-9b72-48d8135cdc7b`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:13:32,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:13:32,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:13:32,899::task::974::TaskManager.Task::(_decref) Task=`ab31d14e-fbcb-496c-9b72-48d8135cdc7b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:33,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:13:33,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:13:33,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:13:33,395::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:13:33,624::task::579::TaskManager.Task::(_updateState) Task=`a9e96a28-551d-409c-9d5c-af26f91e2c21`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:13:33,624::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:13:33,625::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:13:33,625::task::1168::TaskManager.Task::(prepare) Task=`a9e96a28-551d-409c-9d5c-af26f91e2c21`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:13:33,625::task::579::TaskManager.Task::(_updateState) Task=`a9e96a28-551d-409c-9d5c-af26f91e2c21`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:13:33,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:13:33,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:13:33,626::task::974::TaskManager.Task::(_decref) Task=`a9e96a28-551d-409c-9d5c-af26f91e2c21`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:13:33,628::task::579::TaskManager.Task::(_updateState) Task=`8b718a23-6c18-4424-9086-0acef015428e`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:13:33,629::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:13:33,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:13:33,629::task::1168::TaskManager.Task::(prepare) Task=`8b718a23-6c18-4424-9086-0acef015428e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:13:33,629::task::579::TaskManager.Task::(_updateState) Task=`8b718a23-6c18-4424-9086-0acef015428e`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:13:33,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:13:33,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:13:33,630::task::974::TaskManager.Task::(_decref) Task=`8b718a23-6c18-4424-9086-0acef015428e`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:13:33,637::task::579::TaskManager.Task::(_updateState) Task=`07c79c70-1594-43b3-99c0-10431fe85ff0`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:13:33,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:13:33,638::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:13:33,638::task::1168::TaskManager.Task::(prepare) Task=`07c79c70-1594-43b3-99c0-10431fe85ff0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:13:33,638::task::579::TaskManager.Task::(_updateState) Task=`07c79c70-1594-43b3-99c0-10431fe85ff0`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:13:33,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:13:33,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:13:33,638::task::974::TaskManager.Task::(_decref) Task=`07c79c70-1594-43b3-99c0-10431fe85ff0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:33,947::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:34,395::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:13:34,543::task::579::TaskManager.Task::(_updateState) Task=`76ac997c-05b1-49e9-abb4-fd5f40f42a77`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:13:34,544::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:13:34,544::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:13:34,544::task::1168::TaskManager.Task::(prepare) Task=`76ac997c-05b1-49e9-abb4-fd5f40f42a77`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:13:34,545::task::579::TaskManager.Task::(_updateState) Task=`76ac997c-05b1-49e9-abb4-fd5f40f42a77`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:13:34,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:13:34,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:13:34,545::task::974::TaskManager.Task::(_decref) Task=`76ac997c-05b1-49e9-abb4-fd5f40f42a77`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:13:34,926::task::579::TaskManager.Task::(_updateState) Task=`d0dd44a6-5dd7-4223-aa5b-eff9e02c00ce`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:13:34,927::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:13:34,927::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:13:34,927::task::1168::TaskManager.Task::(prepare) Task=`d0dd44a6-5dd7-4223-aa5b-eff9e02c00ce`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:13:34,927::task::579::TaskManager.Task::(_updateState) Task=`d0dd44a6-5dd7-4223-aa5b-eff9e02c00ce`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:13:34,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:13:34,927::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:13:34,927::task::974::TaskManager.Task::(_decref) Task=`d0dd44a6-5dd7-4223-aa5b-eff9e02c00ce`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:13:35,019::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:13:35,037::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000255297 s, 1.4 MB/s\n'; <rc> = 0 >Thread-84377::DEBUG::2014-01-16 16:13:35,063::task::579::TaskManager.Task::(_updateState) Task=`dd1a4aff-0f1c-47dd-a300-e80ddf6c31ab`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:13:35,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:13:35,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:13:35,064::task::1168::TaskManager.Task::(prepare) Task=`dd1a4aff-0f1c-47dd-a300-e80ddf6c31ab`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:13:35,064::task::579::TaskManager.Task::(_updateState) Task=`dd1a4aff-0f1c-47dd-a300-e80ddf6c31ab`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:13:35,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:13:35,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:13:35,065::task::974::TaskManager.Task::(_decref) Task=`dd1a4aff-0f1c-47dd-a300-e80ddf6c31ab`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:13:35,065::task::579::TaskManager.Task::(_updateState) Task=`34e603de-fca5-4881-8830-df3b2f3402a8`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:13:35,065::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:13:35,066::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:13:35,066::task::1168::TaskManager.Task::(prepare) Task=`34e603de-fca5-4881-8830-df3b2f3402a8`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:13:35,066::task::579::TaskManager.Task::(_updateState) Task=`34e603de-fca5-4881-8830-df3b2f3402a8`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:13:35,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:13:35,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:13:35,066::task::974::TaskManager.Task::(_decref) Task=`34e603de-fca5-4881-8830-df3b2f3402a8`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:13:35,067::task::579::TaskManager.Task::(_updateState) Task=`e9879813-0e4d-44de-9df8-a979f3e19f3c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:13:35,067::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:13:35,067::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:13:35,067::task::1168::TaskManager.Task::(prepare) Task=`e9879813-0e4d-44de-9df8-a979f3e19f3c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:13:35,067::task::579::TaskManager.Task::(_updateState) Task=`e9879813-0e4d-44de-9df8-a979f3e19f3c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:13:35,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:13:35,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:13:35,068::task::974::TaskManager.Task::(_decref) Task=`e9879813-0e4d-44de-9df8-a979f3e19f3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:35,396::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:13:35,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:13:35,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:13:35,397::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:35,397::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:13:35,398::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-286298::DEBUG::2014-01-16 16:13:35,440::task::579::TaskManager.Task::(_updateState) Task=`17a67fdf-d7a9-43c7-9b57-762a8fe060e4`::moving from state init -> state preparing >Thread-286298::INFO::2014-01-16 16:13:35,440::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286298::INFO::2014-01-16 16:13:35,440::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255297', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216036', 'lastCheck': '3.5', 'valid': True}} >Thread-286298::DEBUG::2014-01-16 16:13:35,440::task::1168::TaskManager.Task::(prepare) Task=`17a67fdf-d7a9-43c7-9b57-762a8fe060e4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255297', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216036', 'lastCheck': '3.5', 'valid': True}} >Thread-286298::DEBUG::2014-01-16 16:13:35,441::task::579::TaskManager.Task::(_updateState) Task=`17a67fdf-d7a9-43c7-9b57-762a8fe060e4`::moving from state preparing -> state finished >Thread-286298::DEBUG::2014-01-16 16:13:35,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286298::DEBUG::2014-01-16 16:13:35,441::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286298::DEBUG::2014-01-16 16:13:35,441::task::974::TaskManager.Task::(_decref) Task=`17a67fdf-d7a9-43c7-9b57-762a8fe060e4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:35,955::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:36,399::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:36,957::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:37,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:13:37,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:13:37,400::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:37,958::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:38,401::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:13:38,402::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:13:38,402::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:39,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:13:39,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:13:39,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:13:39,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:39,960::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:40,405::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:41,406::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:13:41,406::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:13:41,954::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:13:41,970::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:41,974::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:13:41,976::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-22::DEBUG::2014-01-16 16:13:41,980::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000257288 s, 15.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:13:41,982::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:42,407::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:13:42,534::task::579::TaskManager.Task::(_updateState) Task=`3978c556-23cf-497d-ba41-39c922b8b7e9`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:13:42,535::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:13:42,535::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:13:42,535::task::1168::TaskManager.Task::(prepare) Task=`3978c556-23cf-497d-ba41-39c922b8b7e9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:13:42,535::task::579::TaskManager.Task::(_updateState) Task=`3978c556-23cf-497d-ba41-39c922b8b7e9`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:13:42,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:13:42,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:13:42,536::task::974::TaskManager.Task::(_decref) Task=`3978c556-23cf-497d-ba41-39c922b8b7e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:43,408::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:43,985::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:44,409::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:13:45,044::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:13:45,060::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000317266 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:45,410::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:45,987::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:46,411::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:13:46,627::task::579::TaskManager.Task::(_updateState) Task=`c75b96c0-64a2-45c0-87a7-ebc421a2a308`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:13:46,627::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:13:46,628::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:13:46,628::task::1168::TaskManager.Task::(prepare) Task=`c75b96c0-64a2-45c0-87a7-ebc421a2a308`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:13:46,628::task::579::TaskManager.Task::(_updateState) Task=`c75b96c0-64a2-45c0-87a7-ebc421a2a308`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:13:46,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:13:46,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:13:46,628::task::974::TaskManager.Task::(_decref) Task=`c75b96c0-64a2-45c0-87a7-ebc421a2a308`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:46,989::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:47,411::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:13:47,412::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:47,990::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:13:48,249::task::579::TaskManager.Task::(_updateState) Task=`9ebf746f-45d6-4df7-9b94-002c09302da8`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:13:48,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:13:48,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:13:48,249::task::1168::TaskManager.Task::(prepare) Task=`9ebf746f-45d6-4df7-9b94-002c09302da8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:13:48,250::task::579::TaskManager.Task::(_updateState) Task=`9ebf746f-45d6-4df7-9b94-002c09302da8`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:13:48,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:13:48,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:13:48,250::task::974::TaskManager.Task::(_decref) Task=`9ebf746f-45d6-4df7-9b94-002c09302da8`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:13:48,250::task::579::TaskManager.Task::(_updateState) Task=`32d3bfe4-6738-413b-ba4d-feceb3ab5ca4`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:13:48,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:13:48,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:13:48,251::task::1168::TaskManager.Task::(prepare) Task=`32d3bfe4-6738-413b-ba4d-feceb3ab5ca4`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:13:48,251::task::579::TaskManager.Task::(_updateState) Task=`32d3bfe4-6738-413b-ba4d-feceb3ab5ca4`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:13:48,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:13:48,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:13:48,251::task::974::TaskManager.Task::(_decref) Task=`32d3bfe4-6738-413b-ba4d-feceb3ab5ca4`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:13:48,252::task::579::TaskManager.Task::(_updateState) Task=`191ed591-1a0b-4b42-876d-6031ce30658c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:13:48,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:13:48,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:13:48,252::task::1168::TaskManager.Task::(prepare) Task=`191ed591-1a0b-4b42-876d-6031ce30658c`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:13:48,252::task::579::TaskManager.Task::(_updateState) Task=`191ed591-1a0b-4b42-876d-6031ce30658c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:13:48,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:13:48,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:13:48,253::task::974::TaskManager.Task::(_decref) Task=`191ed591-1a0b-4b42-876d-6031ce30658c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:48,413::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:49,413::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:49,991::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:50,415::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286304::DEBUG::2014-01-16 16:13:51,280::task::579::TaskManager.Task::(_updateState) Task=`e4c0cdc8-5519-4527-b03b-ed9052df85db`::moving from state init -> state preparing >Thread-286304::INFO::2014-01-16 16:13:51,281::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286304::INFO::2014-01-16 16:13:51,281::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317266', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257288', 'lastCheck': '9.3', 'valid': True}} >Thread-286304::DEBUG::2014-01-16 16:13:51,281::task::1168::TaskManager.Task::(prepare) Task=`e4c0cdc8-5519-4527-b03b-ed9052df85db`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317266', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257288', 'lastCheck': '9.3', 'valid': True}} >Thread-286304::DEBUG::2014-01-16 16:13:51,281::task::579::TaskManager.Task::(_updateState) Task=`e4c0cdc8-5519-4527-b03b-ed9052df85db`::moving from state preparing -> state finished >Thread-286304::DEBUG::2014-01-16 16:13:51,281::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286304::DEBUG::2014-01-16 16:13:51,281::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286304::DEBUG::2014-01-16 16:13:51,282::task::974::TaskManager.Task::(_decref) Task=`e4c0cdc8-5519-4527-b03b-ed9052df85db`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:13:51,416::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:13:51,988::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:13:52,006::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:13:52,009::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:13:52,014::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000299606 s, 13.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:52,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:13:52,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:13:52,418::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:53,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:13:53,419::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:13:53,562::task::579::TaskManager.Task::(_updateState) Task=`e0c6a1c7-2228-4d3a-82fc-82acb91e76e8`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:13:53,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:13:53,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:13:53,563::task::1168::TaskManager.Task::(prepare) Task=`e0c6a1c7-2228-4d3a-82fc-82acb91e76e8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:13:53,564::task::579::TaskManager.Task::(_updateState) Task=`e0c6a1c7-2228-4d3a-82fc-82acb91e76e8`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:13:53,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:13:53,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:13:53,564::task::974::TaskManager.Task::(_decref) Task=`e0c6a1c7-2228-4d3a-82fc-82acb91e76e8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:54,013::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:54,420::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:13:54,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:13:54,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:13:55,069::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:13:55,085::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000322348 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:13:55,422::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:13:55,423::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:56,015::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:56,423::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:13:56,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:13:57,017::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:13:57,018::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:13:57,019::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:57,425::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:13:57,426::task::579::TaskManager.Task::(_updateState) Task=`904073ae-20cb-45d9-9cff-f11080c75ccc`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:13:57,426::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:13:57,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:13:57,427::task::1168::TaskManager.Task::(prepare) Task=`904073ae-20cb-45d9-9cff-f11080c75ccc`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:13:57,427::task::579::TaskManager.Task::(_updateState) Task=`904073ae-20cb-45d9-9cff-f11080c75ccc`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:13:57,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:13:57,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:13:57,427::task::974::TaskManager.Task::(_decref) Task=`904073ae-20cb-45d9-9cff-f11080c75ccc`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:13:57,428::task::579::TaskManager.Task::(_updateState) Task=`4726da84-0852-4dc6-a9df-9820c952107f`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:13:57,428::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:13:57,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:13:57,428::task::1168::TaskManager.Task::(prepare) Task=`4726da84-0852-4dc6-a9df-9820c952107f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:13:57,428::task::579::TaskManager.Task::(_updateState) Task=`4726da84-0852-4dc6-a9df-9820c952107f`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:13:57,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:13:57,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:13:57,429::task::974::TaskManager.Task::(_decref) Task=`4726da84-0852-4dc6-a9df-9820c952107f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:13:58,020::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:13:58,427::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:13:58,427::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:13:59,428::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:13:59,429::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:00,022::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:00,430::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:14:00,430::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:14:00,430::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:14:00,431::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:14:00,696::task::579::TaskManager.Task::(_updateState) Task=`82f5f92a-7ced-4837-8b47-af6f33d62db5`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:14:00,696::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:14:00,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:14:00,697::task::1168::TaskManager.Task::(prepare) Task=`82f5f92a-7ced-4837-8b47-af6f33d62db5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:14:00,697::task::579::TaskManager.Task::(_updateState) Task=`82f5f92a-7ced-4837-8b47-af6f33d62db5`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:14:00,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:14:00,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:14:00,697::task::974::TaskManager.Task::(_decref) Task=`82f5f92a-7ced-4837-8b47-af6f33d62db5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:01,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:14:01,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:14:01,432::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:14:02,019::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:14:02,037::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:02,041::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:14:02,044::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000240061 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:14:02,434::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:14:02,434::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:14:03,389::task::579::TaskManager.Task::(_updateState) Task=`4979333a-1256-48b1-93fd-048dafc93805`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:14:03,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:14:03,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:14:03,391::task::1168::TaskManager.Task::(prepare) Task=`4979333a-1256-48b1-93fd-048dafc93805`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:14:03,391::task::579::TaskManager.Task::(_updateState) Task=`4979333a-1256-48b1-93fd-048dafc93805`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:14:03,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:14:03,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:14:03,392::task::974::TaskManager.Task::(_decref) Task=`4979333a-1256-48b1-93fd-048dafc93805`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:14:03,396::task::579::TaskManager.Task::(_updateState) Task=`f6daa14c-fae5-4262-a8f1-d77d35379a4a`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:14:03,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:14:03,397::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:14:03,397::task::1168::TaskManager.Task::(prepare) Task=`f6daa14c-fae5-4262-a8f1-d77d35379a4a`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:14:03,397::task::579::TaskManager.Task::(_updateState) Task=`f6daa14c-fae5-4262-a8f1-d77d35379a4a`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:14:03,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:14:03,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:14:03,398::task::974::TaskManager.Task::(_decref) Task=`f6daa14c-fae5-4262-a8f1-d77d35379a4a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:03,435::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:14:03,435::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:14:03,435::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:14:03,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:14:03,693::task::579::TaskManager.Task::(_updateState) Task=`a5b62bb1-69d4-44b4-a8bd-b48d01095c78`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:14:03,693::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:14:03,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:14:03,694::task::1168::TaskManager.Task::(prepare) Task=`a5b62bb1-69d4-44b4-a8bd-b48d01095c78`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:14:03,694::task::579::TaskManager.Task::(_updateState) Task=`a5b62bb1-69d4-44b4-a8bd-b48d01095c78`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:14:03,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:14:03,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:14:03,694::task::974::TaskManager.Task::(_decref) Task=`a5b62bb1-69d4-44b4-a8bd-b48d01095c78`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:14:03,694::task::579::TaskManager.Task::(_updateState) Task=`08551aeb-dd56-4ec6-9580-3416b25efde5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:14:03,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:14:03,695::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:14:03,695::task::1168::TaskManager.Task::(prepare) Task=`08551aeb-dd56-4ec6-9580-3416b25efde5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:14:03,695::task::579::TaskManager.Task::(_updateState) Task=`08551aeb-dd56-4ec6-9580-3416b25efde5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:14:03,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:14:03,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:14:03,695::task::974::TaskManager.Task::(_decref) Task=`08551aeb-dd56-4ec6-9580-3416b25efde5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:14:04,043::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:04,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:14:04,568::task::579::TaskManager.Task::(_updateState) Task=`aa603c86-ff55-4e14-bd29-78e5fac17fb8`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:14:04,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:14:04,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:14:04,569::task::1168::TaskManager.Task::(prepare) Task=`aa603c86-ff55-4e14-bd29-78e5fac17fb8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:14:04,569::task::579::TaskManager.Task::(_updateState) Task=`aa603c86-ff55-4e14-bd29-78e5fac17fb8`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:14:04,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:14:04,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:14:04,569::task::974::TaskManager.Task::(_decref) Task=`aa603c86-ff55-4e14-bd29-78e5fac17fb8`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:14:04,569::task::579::TaskManager.Task::(_updateState) Task=`6d266011-93e9-45f5-b505-8cc4a46cb3bd`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:14:04,569::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:14:04,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:14:04,570::task::1168::TaskManager.Task::(prepare) Task=`6d266011-93e9-45f5-b505-8cc4a46cb3bd`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:14:04,570::task::579::TaskManager.Task::(_updateState) Task=`6d266011-93e9-45f5-b505-8cc4a46cb3bd`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:14:04,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:14:04,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:14:04,570::task::974::TaskManager.Task::(_decref) Task=`6d266011-93e9-45f5-b505-8cc4a46cb3bd`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:14:05,033::task::579::TaskManager.Task::(_updateState) Task=`3b62da0c-a9e6-4265-be9c-be7da706a043`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:14:05,033::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:14:05,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:14:05,034::task::1168::TaskManager.Task::(prepare) Task=`3b62da0c-a9e6-4265-be9c-be7da706a043`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:14:05,034::task::579::TaskManager.Task::(_updateState) Task=`3b62da0c-a9e6-4265-be9c-be7da706a043`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:14:05,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:14:05,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:14:05,034::task::974::TaskManager.Task::(_decref) Task=`3b62da0c-a9e6-4265-be9c-be7da706a043`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:14:05,093::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:14:05,111::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286686 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:14:05,114::task::579::TaskManager.Task::(_updateState) Task=`b519efeb-d71d-4986-81a1-06303c9d2426`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:14:05,117::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:14:05,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:14:05,117::task::1168::TaskManager.Task::(prepare) Task=`b519efeb-d71d-4986-81a1-06303c9d2426`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:14:05,118::task::579::TaskManager.Task::(_updateState) Task=`b519efeb-d71d-4986-81a1-06303c9d2426`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:14:05,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:14:05,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:14:05,118::task::974::TaskManager.Task::(_decref) Task=`b519efeb-d71d-4986-81a1-06303c9d2426`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:05,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:14:05,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:14:05,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:14:05,439::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:05,439::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:14:05,440::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:14:06,045::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:14:06,130::task::579::TaskManager.Task::(_updateState) Task=`637eb707-48de-4e85-8891-c14c4bf2ca1f`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:14:06,130::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:14:06,130::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:14:06,131::task::1168::TaskManager.Task::(prepare) Task=`637eb707-48de-4e85-8891-c14c4bf2ca1f`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:14:06,131::task::579::TaskManager.Task::(_updateState) Task=`637eb707-48de-4e85-8891-c14c4bf2ca1f`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:14:06,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:14:06,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:14:06,131::task::974::TaskManager.Task::(_decref) Task=`637eb707-48de-4e85-8891-c14c4bf2ca1f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:06,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:07,046::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:14:07,053::task::579::TaskManager.Task::(_updateState) Task=`ac760946-a9f9-4c06-9cf1-f98314c5dd4c`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:14:07,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:14:07,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:14:07,053::task::1168::TaskManager.Task::(prepare) Task=`ac760946-a9f9-4c06-9cf1-f98314c5dd4c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:14:07,053::task::579::TaskManager.Task::(_updateState) Task=`ac760946-a9f9-4c06-9cf1-f98314c5dd4c`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:14:07,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:14:07,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:14:07,054::task::974::TaskManager.Task::(_decref) Task=`ac760946-a9f9-4c06-9cf1-f98314c5dd4c`::ref 0 aborting False >Thread-286310::DEBUG::2014-01-16 16:14:07,169::task::579::TaskManager.Task::(_updateState) Task=`6a135a8b-c1b5-43d7-8522-b3ac04a7b7fc`::moving from state init -> state preparing >Thread-286310::INFO::2014-01-16 16:14:07,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286310::INFO::2014-01-16 16:14:07,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286686', 'lastCheck': '2.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240061', 'lastCheck': '5.1', 'valid': True}} >Thread-286310::DEBUG::2014-01-16 16:14:07,169::task::1168::TaskManager.Task::(prepare) Task=`6a135a8b-c1b5-43d7-8522-b3ac04a7b7fc`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286686', 'lastCheck': '2.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240061', 'lastCheck': '5.1', 'valid': True}} >Thread-286310::DEBUG::2014-01-16 16:14:07,169::task::579::TaskManager.Task::(_updateState) Task=`6a135a8b-c1b5-43d7-8522-b3ac04a7b7fc`::moving from state preparing -> state finished >Thread-286310::DEBUG::2014-01-16 16:14:07,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286310::DEBUG::2014-01-16 16:14:07,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286310::DEBUG::2014-01-16 16:14:07,170::task::974::TaskManager.Task::(_decref) Task=`6a135a8b-c1b5-43d7-8522-b3ac04a7b7fc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:07,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:14:07,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:14:07,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:08,048::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:08,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:14:08,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:14:08,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:09,445::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:14:09,446::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:14:09,446::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:14:09,446::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:10,049::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:14:10,057::task::579::TaskManager.Task::(_updateState) Task=`5b9c512c-57a5-4a4f-a5f3-84040cd2147b`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:14:10,057::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:14:10,058::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:14:10,058::task::1168::TaskManager.Task::(prepare) Task=`5b9c512c-57a5-4a4f-a5f3-84040cd2147b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:14:10,058::task::579::TaskManager.Task::(_updateState) Task=`5b9c512c-57a5-4a4f-a5f3-84040cd2147b`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:14:10,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:14:10,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:14:10,058::task::974::TaskManager.Task::(_decref) Task=`5b9c512c-57a5-4a4f-a5f3-84040cd2147b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:10,447::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:11,448::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:14:11,449::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:14:12,050::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:14:12,064::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:12,068::task::579::TaskManager.Task::(_updateState) Task=`927e2741-b2ef-44ab-9c07-505df5a80b7d`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:14:12,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:14:12,073::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:14:12,075::task::1168::TaskManager.Task::(prepare) Task=`927e2741-b2ef-44ab-9c07-505df5a80b7d`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:14:12,076::task::579::TaskManager.Task::(_updateState) Task=`927e2741-b2ef-44ab-9c07-505df5a80b7d`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:14:12,078::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:14:12,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:14:12,081::task::974::TaskManager.Task::(_decref) Task=`927e2741-b2ef-44ab-9c07-505df5a80b7d`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:14:12,083::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000219066 s, 18.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:14:12,084::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:14:12,086::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:14:12,091::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:12,095::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:12,097::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:12,450::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:13,451::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:14:13,640::task::579::TaskManager.Task::(_updateState) Task=`c011a5a4-5c76-488a-ace3-3a0a207e40b4`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:14:13,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:14:13,641::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:14:13,641::task::1168::TaskManager.Task::(prepare) Task=`c011a5a4-5c76-488a-ace3-3a0a207e40b4`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:14:13,642::task::579::TaskManager.Task::(_updateState) Task=`c011a5a4-5c76-488a-ace3-3a0a207e40b4`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:14:13,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:14:13,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:14:13,642::task::974::TaskManager.Task::(_decref) Task=`c011a5a4-5c76-488a-ace3-3a0a207e40b4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:14:14,099::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:14,452::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:14:14,661::task::579::TaskManager.Task::(_updateState) Task=`6395efa8-c2b7-4f19-bc5f-7a9923fc168b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:14:14,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:14:14,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:14:14,662::task::1168::TaskManager.Task::(prepare) Task=`6395efa8-c2b7-4f19-bc5f-7a9923fc168b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:14:14,662::task::579::TaskManager.Task::(_updateState) Task=`6395efa8-c2b7-4f19-bc5f-7a9923fc168b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:14:14,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:14:14,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:14:14,663::task::974::TaskManager.Task::(_decref) Task=`6395efa8-c2b7-4f19-bc5f-7a9923fc168b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:14:15,123::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:14:15,142::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290258 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:14:15,453::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:16,100::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:14:16,359::task::579::TaskManager.Task::(_updateState) Task=`301fe13f-e599-4c4b-b233-3a9728c2e453`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:14:16,360::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:14:16,360::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:14:16,360::task::1168::TaskManager.Task::(prepare) Task=`301fe13f-e599-4c4b-b233-3a9728c2e453`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:14:16,360::task::579::TaskManager.Task::(_updateState) Task=`301fe13f-e599-4c4b-b233-3a9728c2e453`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:14:16,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:14:16,360::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:14:16,361::task::974::TaskManager.Task::(_decref) Task=`301fe13f-e599-4c4b-b233-3a9728c2e453`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:14:16,361::task::579::TaskManager.Task::(_updateState) Task=`96c36a5b-e859-467f-a556-3e49950b012e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:14:16,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:14:16,361::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:14:16,361::task::1168::TaskManager.Task::(prepare) Task=`96c36a5b-e859-467f-a556-3e49950b012e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:14:16,361::task::579::TaskManager.Task::(_updateState) Task=`96c36a5b-e859-467f-a556-3e49950b012e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:14:16,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:14:16,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:14:16,362::task::974::TaskManager.Task::(_decref) Task=`96c36a5b-e859-467f-a556-3e49950b012e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:16,454::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:17,101::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:17,455::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:14:17,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:18,103::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:18,456::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:19,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:20,104::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:20,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:21,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:14:21,745::task::579::TaskManager.Task::(_updateState) Task=`0d7046da-8c84-4cde-a5c8-77c39a8f5c8b`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:14:21,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:14:21,746::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:14:21,746::task::1168::TaskManager.Task::(prepare) Task=`0d7046da-8c84-4cde-a5c8-77c39a8f5c8b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:14:21,746::task::579::TaskManager.Task::(_updateState) Task=`0d7046da-8c84-4cde-a5c8-77c39a8f5c8b`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:14:21,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:14:21,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:14:21,746::task::974::TaskManager.Task::(_decref) Task=`0d7046da-8c84-4cde-a5c8-77c39a8f5c8b`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:14:22,096::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:14:22,112::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:22,116::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:14:22,119::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237999 s, 17.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:14:22,461::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:14:22,461::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:14:22,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286316::DEBUG::2014-01-16 16:14:22,866::task::579::TaskManager.Task::(_updateState) Task=`41dbdc30-0d55-453d-a25c-940ecfb8b57c`::moving from state init -> state preparing >Thread-286316::INFO::2014-01-16 16:14:22,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286316::INFO::2014-01-16 16:14:22,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290258', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237999', 'lastCheck': '0.7', 'valid': True}} >Thread-286316::DEBUG::2014-01-16 16:14:22,867::task::1168::TaskManager.Task::(prepare) Task=`41dbdc30-0d55-453d-a25c-940ecfb8b57c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290258', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237999', 'lastCheck': '0.7', 'valid': True}} >Thread-286316::DEBUG::2014-01-16 16:14:22,867::task::579::TaskManager.Task::(_updateState) Task=`41dbdc30-0d55-453d-a25c-940ecfb8b57c`::moving from state preparing -> state finished >Thread-286316::DEBUG::2014-01-16 16:14:22,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286316::DEBUG::2014-01-16 16:14:22,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286316::DEBUG::2014-01-16 16:14:22,868::task::974::TaskManager.Task::(_decref) Task=`41dbdc30-0d55-453d-a25c-940ecfb8b57c`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:14:23,292::task::579::TaskManager.Task::(_updateState) Task=`178dca10-fb9a-4425-a0f1-1436c5ff37c0`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:14:23,293::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:14:23,293::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:14:23,293::task::1168::TaskManager.Task::(prepare) Task=`178dca10-fb9a-4425-a0f1-1436c5ff37c0`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:14:23,294::task::579::TaskManager.Task::(_updateState) Task=`178dca10-fb9a-4425-a0f1-1436c5ff37c0`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:14:23,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:14:23,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:14:23,298::task::974::TaskManager.Task::(_decref) Task=`178dca10-fb9a-4425-a0f1-1436c5ff37c0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:23,462::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:14:23,463::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:24,118::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:24,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:14:24,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:14:24,465::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:14:25,150::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:14:25,167::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00032069 s, 1.1 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:14:25,260::task::579::TaskManager.Task::(_updateState) Task=`cf28438c-426d-4ded-bb6e-767a0ffaac55`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:14:25,261::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:14:25,261::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:14:25,261::task::1168::TaskManager.Task::(prepare) Task=`cf28438c-426d-4ded-bb6e-767a0ffaac55`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:14:25,261::task::579::TaskManager.Task::(_updateState) Task=`cf28438c-426d-4ded-bb6e-767a0ffaac55`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:14:25,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:14:25,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:14:25,262::task::974::TaskManager.Task::(_decref) Task=`cf28438c-426d-4ded-bb6e-767a0ffaac55`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:14:25,351::task::579::TaskManager.Task::(_updateState) Task=`a54c3676-bcf0-4f38-8dab-d6adbfea75ac`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:14:25,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:14:25,351::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:14:25,352::task::1168::TaskManager.Task::(prepare) Task=`a54c3676-bcf0-4f38-8dab-d6adbfea75ac`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:14:25,352::task::579::TaskManager.Task::(_updateState) Task=`a54c3676-bcf0-4f38-8dab-d6adbfea75ac`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:14:25,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:14:25,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:14:25,352::task::974::TaskManager.Task::(_decref) Task=`a54c3676-bcf0-4f38-8dab-d6adbfea75ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:25,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:14:25,467::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:26,120::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:26,468::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:14:26,468::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:27,122::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:14:27,122::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:14:27,123::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:27,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:28,124::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:28,470::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:14:28,471::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:29,472::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:14:29,472::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:30,126::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:14:30,204::task::579::TaskManager.Task::(_updateState) Task=`36c3ccd2-0b55-4ad9-a12f-67e171bf8183`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:14:30,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:14:30,204::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:14:30,204::task::1168::TaskManager.Task::(prepare) Task=`36c3ccd2-0b55-4ad9-a12f-67e171bf8183`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:14:30,205::task::579::TaskManager.Task::(_updateState) Task=`36c3ccd2-0b55-4ad9-a12f-67e171bf8183`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:14:30,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:14:30,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:14:30,205::task::974::TaskManager.Task::(_decref) Task=`36c3ccd2-0b55-4ad9-a12f-67e171bf8183`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:30,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:14:30,474::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:14:30,474::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:14:30,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:31,475::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:14:31,476::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:14:31,476::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:14:32,125::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:14:32,143::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:32,148::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:14:32,150::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000276252 s, 14.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:14:32,478::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:14:32,480::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:14:33,063::task::579::TaskManager.Task::(_updateState) Task=`8acdfa97-aa0f-4af2-b356-3bf2d055ea2a`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:14:33,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:14:33,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:14:33,064::task::1168::TaskManager.Task::(prepare) Task=`8acdfa97-aa0f-4af2-b356-3bf2d055ea2a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:14:33,064::task::579::TaskManager.Task::(_updateState) Task=`8acdfa97-aa0f-4af2-b356-3bf2d055ea2a`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:14:33,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:14:33,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:14:33,065::task::974::TaskManager.Task::(_decref) Task=`8acdfa97-aa0f-4af2-b356-3bf2d055ea2a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:33,481::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:14:33,482::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:14:33,482::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:14:33,482::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:14:33,786::task::579::TaskManager.Task::(_updateState) Task=`cb3e5af7-7517-4124-a00a-e195a0873143`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:14:33,787::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:14:33,787::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:14:33,787::task::1168::TaskManager.Task::(prepare) Task=`cb3e5af7-7517-4124-a00a-e195a0873143`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:14:33,787::task::579::TaskManager.Task::(_updateState) Task=`cb3e5af7-7517-4124-a00a-e195a0873143`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:14:33,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:14:33,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:14:33,788::task::974::TaskManager.Task::(_decref) Task=`cb3e5af7-7517-4124-a00a-e195a0873143`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:14:33,790::task::579::TaskManager.Task::(_updateState) Task=`136fb0e6-0e12-497d-af18-adc5c400a083`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:14:33,791::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:14:33,791::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:14:33,791::task::1168::TaskManager.Task::(prepare) Task=`136fb0e6-0e12-497d-af18-adc5c400a083`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:14:33,791::task::579::TaskManager.Task::(_updateState) Task=`136fb0e6-0e12-497d-af18-adc5c400a083`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:14:33,792::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:14:33,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:14:33,792::task::974::TaskManager.Task::(_decref) Task=`136fb0e6-0e12-497d-af18-adc5c400a083`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:14:33,805::task::579::TaskManager.Task::(_updateState) Task=`d2cd3ae3-16d1-4eb7-9b78-df36fb4bfb6d`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:14:33,805::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:14:33,805::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:14:33,805::task::1168::TaskManager.Task::(prepare) Task=`d2cd3ae3-16d1-4eb7-9b78-df36fb4bfb6d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:14:33,805::task::579::TaskManager.Task::(_updateState) Task=`d2cd3ae3-16d1-4eb7-9b78-df36fb4bfb6d`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:14:33,806::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:14:33,806::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:14:33,806::task::974::TaskManager.Task::(_decref) Task=`d2cd3ae3-16d1-4eb7-9b78-df36fb4bfb6d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:14:34,150::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:34,483::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:14:34,704::task::579::TaskManager.Task::(_updateState) Task=`0284b546-8461-4fb9-bb4b-c124f27cd4b3`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:14:34,705::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:14:34,705::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:14:34,705::task::1168::TaskManager.Task::(prepare) Task=`0284b546-8461-4fb9-bb4b-c124f27cd4b3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:14:34,705::task::579::TaskManager.Task::(_updateState) Task=`0284b546-8461-4fb9-bb4b-c124f27cd4b3`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:14:34,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:14:34,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:14:34,706::task::974::TaskManager.Task::(_decref) Task=`0284b546-8461-4fb9-bb4b-c124f27cd4b3`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:14:35,091::task::579::TaskManager.Task::(_updateState) Task=`d2f84daf-d906-4df4-9c2f-5e20292b8bc4`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:14:35,091::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:14:35,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:14:35,092::task::1168::TaskManager.Task::(prepare) Task=`d2f84daf-d906-4df4-9c2f-5e20292b8bc4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:14:35,092::task::579::TaskManager.Task::(_updateState) Task=`d2f84daf-d906-4df4-9c2f-5e20292b8bc4`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:14:35,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:14:35,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:14:35,092::task::974::TaskManager.Task::(_decref) Task=`d2f84daf-d906-4df4-9c2f-5e20292b8bc4`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:14:35,175::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:14:35,192::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000250152 s, 1.5 MB/s\n'; <rc> = 0 >Thread-84377::DEBUG::2014-01-16 16:14:35,335::task::579::TaskManager.Task::(_updateState) Task=`09083aeb-11dd-4987-a49f-f08ae3b0ad42`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:14:35,335::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:14:35,336::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:14:35,336::task::1168::TaskManager.Task::(prepare) Task=`09083aeb-11dd-4987-a49f-f08ae3b0ad42`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:14:35,336::task::579::TaskManager.Task::(_updateState) Task=`09083aeb-11dd-4987-a49f-f08ae3b0ad42`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:14:35,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:14:35,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:14:35,337::task::974::TaskManager.Task::(_decref) Task=`09083aeb-11dd-4987-a49f-f08ae3b0ad42`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:14:35,337::task::579::TaskManager.Task::(_updateState) Task=`3ca9788c-4fbf-417c-b51f-0ad467ab043c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:14:35,337::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:14:35,337::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:14:35,337::task::1168::TaskManager.Task::(prepare) Task=`3ca9788c-4fbf-417c-b51f-0ad467ab043c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:14:35,338::task::579::TaskManager.Task::(_updateState) Task=`3ca9788c-4fbf-417c-b51f-0ad467ab043c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:14:35,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:14:35,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:14:35,338::task::974::TaskManager.Task::(_decref) Task=`3ca9788c-4fbf-417c-b51f-0ad467ab043c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:14:35,338::task::579::TaskManager.Task::(_updateState) Task=`a4bacfed-2160-4c0f-beeb-3402d0e68b1d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:14:35,339::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:14:35,339::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:14:35,339::task::1168::TaskManager.Task::(prepare) Task=`a4bacfed-2160-4c0f-beeb-3402d0e68b1d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:14:35,339::task::579::TaskManager.Task::(_updateState) Task=`a4bacfed-2160-4c0f-beeb-3402d0e68b1d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:14:35,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:14:35,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:14:35,340::task::974::TaskManager.Task::(_decref) Task=`a4bacfed-2160-4c0f-beeb-3402d0e68b1d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:35,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:14:35,485::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:14:35,485::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:14:35,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:35,485::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:14:35,486::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:14:36,152::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:36,487::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:37,154::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:37,488::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:14:37,488::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:14:37,488::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:38,155::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:38,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:14:38,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:14:38,490::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286322::DEBUG::2014-01-16 16:14:38,716::task::579::TaskManager.Task::(_updateState) Task=`b1ffcefd-daa8-49a3-9ef1-9efb35cbd471`::moving from state init -> state preparing >Thread-286322::INFO::2014-01-16 16:14:38,716::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286322::INFO::2014-01-16 16:14:38,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250152', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276252', 'lastCheck': '6.6', 'valid': True}} >Thread-286322::DEBUG::2014-01-16 16:14:38,717::task::1168::TaskManager.Task::(prepare) Task=`b1ffcefd-daa8-49a3-9ef1-9efb35cbd471`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000250152', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276252', 'lastCheck': '6.6', 'valid': True}} >Thread-286322::DEBUG::2014-01-16 16:14:38,717::task::579::TaskManager.Task::(_updateState) Task=`b1ffcefd-daa8-49a3-9ef1-9efb35cbd471`::moving from state preparing -> state finished >Thread-286322::DEBUG::2014-01-16 16:14:38,717::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286322::DEBUG::2014-01-16 16:14:38,717::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286322::DEBUG::2014-01-16 16:14:38,717::task::974::TaskManager.Task::(_decref) Task=`b1ffcefd-daa8-49a3-9ef1-9efb35cbd471`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:39,491::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:14:39,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:14:39,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:14:39,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:40,156::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:40,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:41,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:14:41,494::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:14:42,155::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:14:42,171::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:14:42,176::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-22::DEBUG::2014-01-16 16:14:42,179::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000275245 s, 14.9 MB/s\n'; <rc> = 0 >Thread-189817::ERROR::2014-01-16 16:14:42,178::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:14:42,186::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:42,494::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:14:42,691::task::579::TaskManager.Task::(_updateState) Task=`73d99724-b74b-476a-b732-4eef3b2dddeb`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:14:42,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:14:42,692::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:14:42,692::task::1168::TaskManager.Task::(prepare) Task=`73d99724-b74b-476a-b732-4eef3b2dddeb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:14:42,692::task::579::TaskManager.Task::(_updateState) Task=`73d99724-b74b-476a-b732-4eef3b2dddeb`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:14:42,692::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:14:42,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:14:42,693::task::974::TaskManager.Task::(_decref) Task=`73d99724-b74b-476a-b732-4eef3b2dddeb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:43,496::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:44,188::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:44,497::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:14:45,200::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:14:45,218::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000256657 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:14:45,498::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:46,189::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:46,499::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:14:46,799::task::579::TaskManager.Task::(_updateState) Task=`60a2e804-3c30-4c0b-99fa-48ea5533c59d`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:14:46,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:14:46,800::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:14:46,800::task::1168::TaskManager.Task::(prepare) Task=`60a2e804-3c30-4c0b-99fa-48ea5533c59d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:14:46,800::task::579::TaskManager.Task::(_updateState) Task=`60a2e804-3c30-4c0b-99fa-48ea5533c59d`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:14:46,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:14:46,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:14:46,801::task::974::TaskManager.Task::(_decref) Task=`60a2e804-3c30-4c0b-99fa-48ea5533c59d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:14:47,191::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:47,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:14:47,500::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:48,192::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:48,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:14:48,808::task::579::TaskManager.Task::(_updateState) Task=`4fd6bbd2-28f4-45f5-8084-fba3cd9e10e0`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:14:48,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:14:48,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:14:48,808::task::1168::TaskManager.Task::(prepare) Task=`4fd6bbd2-28f4-45f5-8084-fba3cd9e10e0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:14:48,809::task::579::TaskManager.Task::(_updateState) Task=`4fd6bbd2-28f4-45f5-8084-fba3cd9e10e0`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:14:48,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:14:48,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:14:48,809::task::974::TaskManager.Task::(_decref) Task=`4fd6bbd2-28f4-45f5-8084-fba3cd9e10e0`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:14:48,809::task::579::TaskManager.Task::(_updateState) Task=`bc4386f2-7c32-41f6-8db8-1e9e84f7f12c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:14:48,809::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:14:48,810::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:14:48,810::task::1168::TaskManager.Task::(prepare) Task=`bc4386f2-7c32-41f6-8db8-1e9e84f7f12c`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:14:48,810::task::579::TaskManager.Task::(_updateState) Task=`bc4386f2-7c32-41f6-8db8-1e9e84f7f12c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:14:48,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:14:48,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:14:48,810::task::974::TaskManager.Task::(_decref) Task=`bc4386f2-7c32-41f6-8db8-1e9e84f7f12c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:14:48,811::task::579::TaskManager.Task::(_updateState) Task=`86ccf8de-8d95-4499-af86-d403edb57151`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:14:48,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:14:48,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:14:48,811::task::1168::TaskManager.Task::(prepare) Task=`86ccf8de-8d95-4499-af86-d403edb57151`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:14:48,811::task::579::TaskManager.Task::(_updateState) Task=`86ccf8de-8d95-4499-af86-d403edb57151`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:14:48,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:14:48,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:14:48,812::task::974::TaskManager.Task::(_decref) Task=`86ccf8de-8d95-4499-af86-d403edb57151`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:14:49,503::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:50,193::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:50,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:51,505::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:14:52,190::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:14:52,210::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:14:52,213::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000328189 s, 12.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:14:52,215::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:52,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:14:52,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:14:52,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:53,508::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:14:53,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:14:53,723::task::579::TaskManager.Task::(_updateState) Task=`15e79364-7f37-42d2-8f04-225368b063ad`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:14:53,723::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:14:53,724::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:14:53,724::task::1168::TaskManager.Task::(prepare) Task=`15e79364-7f37-42d2-8f04-225368b063ad`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:14:53,724::task::579::TaskManager.Task::(_updateState) Task=`15e79364-7f37-42d2-8f04-225368b063ad`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:14:53,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:14:53,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:14:53,725::task::974::TaskManager.Task::(_decref) Task=`15e79364-7f37-42d2-8f04-225368b063ad`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:14:54,217::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:54,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:14:54,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:14:54,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286328::DEBUG::2014-01-16 16:14:54,555::task::579::TaskManager.Task::(_updateState) Task=`7c47db79-5462-488a-a4b1-872545fa77c6`::moving from state init -> state preparing >Thread-286328::INFO::2014-01-16 16:14:54,556::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286328::INFO::2014-01-16 16:14:54,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256657', 'lastCheck': '9.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328189', 'lastCheck': '2.3', 'valid': True}} >Thread-286328::DEBUG::2014-01-16 16:14:54,556::task::1168::TaskManager.Task::(prepare) Task=`7c47db79-5462-488a-a4b1-872545fa77c6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256657', 'lastCheck': '9.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328189', 'lastCheck': '2.3', 'valid': True}} >Thread-286328::DEBUG::2014-01-16 16:14:54,556::task::579::TaskManager.Task::(_updateState) Task=`7c47db79-5462-488a-a4b1-872545fa77c6`::moving from state preparing -> state finished >Thread-286328::DEBUG::2014-01-16 16:14:54,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286328::DEBUG::2014-01-16 16:14:54,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286328::DEBUG::2014-01-16 16:14:54,557::task::974::TaskManager.Task::(_decref) Task=`7c47db79-5462-488a-a4b1-872545fa77c6`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:14:55,226::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:14:55,242::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000248821 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:14:55,511::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:14:55,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:56,219::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:56,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:14:56,513::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:14:57,221::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:14:57,221::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:14:57,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:57,514::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:14:57,650::task::579::TaskManager.Task::(_updateState) Task=`04886835-9bef-4ad2-9f3c-932366a269c1`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:14:57,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:14:57,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:14:57,651::task::1168::TaskManager.Task::(prepare) Task=`04886835-9bef-4ad2-9f3c-932366a269c1`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:14:57,651::task::579::TaskManager.Task::(_updateState) Task=`04886835-9bef-4ad2-9f3c-932366a269c1`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:14:57,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:14:57,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:14:57,652::task::974::TaskManager.Task::(_decref) Task=`04886835-9bef-4ad2-9f3c-932366a269c1`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:14:57,652::task::579::TaskManager.Task::(_updateState) Task=`1b1c052c-77d6-407d-82b4-7852a91d281c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:14:57,652::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:14:57,652::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:14:57,653::task::1168::TaskManager.Task::(prepare) Task=`1b1c052c-77d6-407d-82b4-7852a91d281c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:14:57,653::task::579::TaskManager.Task::(_updateState) Task=`1b1c052c-77d6-407d-82b4-7852a91d281c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:14:57,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:14:57,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:14:57,653::task::974::TaskManager.Task::(_decref) Task=`1b1c052c-77d6-407d-82b4-7852a91d281c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:14:58,224::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:14:58,516::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:14:58,516::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:14:59,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:14:59,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:00,225::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:00,518::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:15:00,518::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:15:00,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:15:00,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:15:00,859::task::579::TaskManager.Task::(_updateState) Task=`77e9a6f0-c897-4576-9d8a-e833c64ec68b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:15:00,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:15:00,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:15:00,860::task::1168::TaskManager.Task::(prepare) Task=`77e9a6f0-c897-4576-9d8a-e833c64ec68b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:15:00,860::task::579::TaskManager.Task::(_updateState) Task=`77e9a6f0-c897-4576-9d8a-e833c64ec68b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:15:00,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:15:00,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:15:00,860::task::974::TaskManager.Task::(_decref) Task=`77e9a6f0-c897-4576-9d8a-e833c64ec68b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:01,520::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:15:01,520::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:15:01,521::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:02,219::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:15:02,219::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:15:02,220::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:15:02,220::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:15:02,222::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:15:02,239::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:02,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:15:02,245::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00025874 s, 7.9 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:15:02,245::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00025874 s, 7.9 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:15:02,245::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:15:02,245::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:15:02,246::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:15:02,246::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:15:02,246::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:15:02,246::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:15:02,247::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:15:02,247::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:15:02,248::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:02,472::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:15:02,475::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:15:02,475::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:15:02,476::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:15:02,477::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:15:02,477::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:15:02,477::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:15:02,522::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:15:02,523::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:02,650::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:15:02,655::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:02,675::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000208794 s, 19.6 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 16:15:03,457::task::579::TaskManager.Task::(_updateState) Task=`2640fb20-5d4f-45ec-80d3-8a0961f40f52`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:15:03,457::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:15:03,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:15:03,458::task::1168::TaskManager.Task::(prepare) Task=`2640fb20-5d4f-45ec-80d3-8a0961f40f52`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:15:03,458::task::579::TaskManager.Task::(_updateState) Task=`2640fb20-5d4f-45ec-80d3-8a0961f40f52`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:15:03,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:15:03,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:15:03,458::task::974::TaskManager.Task::(_decref) Task=`2640fb20-5d4f-45ec-80d3-8a0961f40f52`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:15:03,465::task::579::TaskManager.Task::(_updateState) Task=`be7dd17c-af97-4e79-907d-229ce18705ae`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:15:03,465::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:15:03,465::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:15:03,465::task::1168::TaskManager.Task::(prepare) Task=`be7dd17c-af97-4e79-907d-229ce18705ae`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:15:03,465::task::579::TaskManager.Task::(_updateState) Task=`be7dd17c-af97-4e79-907d-229ce18705ae`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:15:03,465::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:15:03,466::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:15:03,466::task::974::TaskManager.Task::(_decref) Task=`be7dd17c-af97-4e79-907d-229ce18705ae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:03,524::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:15:03,524::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:15:03,524::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:15:03,525::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:15:03,919::task::579::TaskManager.Task::(_updateState) Task=`cdd6e0b2-fefd-4f64-b67e-679eb5c2c4aa`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:15:03,919::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:15:03,920::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:15:03,920::task::1168::TaskManager.Task::(prepare) Task=`cdd6e0b2-fefd-4f64-b67e-679eb5c2c4aa`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:15:03,920::task::579::TaskManager.Task::(_updateState) Task=`cdd6e0b2-fefd-4f64-b67e-679eb5c2c4aa`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:15:03,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:15:03,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:15:03,920::task::974::TaskManager.Task::(_decref) Task=`cdd6e0b2-fefd-4f64-b67e-679eb5c2c4aa`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:15:03,921::task::579::TaskManager.Task::(_updateState) Task=`463b4a25-ab35-4095-b973-c7b3b88c294a`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:15:03,921::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:15:03,921::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:15:03,921::task::1168::TaskManager.Task::(prepare) Task=`463b4a25-ab35-4095-b973-c7b3b88c294a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:15:03,921::task::579::TaskManager.Task::(_updateState) Task=`463b4a25-ab35-4095-b973-c7b3b88c294a`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:15:03,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:15:03,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:15:03,922::task::974::TaskManager.Task::(_decref) Task=`463b4a25-ab35-4095-b973-c7b3b88c294a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:04,249::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:04,526::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:15:04,674::task::579::TaskManager.Task::(_updateState) Task=`3cf67882-0119-41ca-8add-1141230d34b8`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:15:04,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:15:04,675::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:15:04,675::task::1168::TaskManager.Task::(prepare) Task=`3cf67882-0119-41ca-8add-1141230d34b8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:15:04,675::task::579::TaskManager.Task::(_updateState) Task=`3cf67882-0119-41ca-8add-1141230d34b8`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:15:04,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:15:04,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:15:04,676::task::974::TaskManager.Task::(_decref) Task=`3cf67882-0119-41ca-8add-1141230d34b8`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:15:04,676::task::579::TaskManager.Task::(_updateState) Task=`3d187e85-4483-4e18-8303-93db577dade7`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:15:04,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:15:04,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:15:04,677::task::1168::TaskManager.Task::(prepare) Task=`3d187e85-4483-4e18-8303-93db577dade7`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:15:04,677::task::579::TaskManager.Task::(_updateState) Task=`3d187e85-4483-4e18-8303-93db577dade7`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:15:04,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:15:04,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:15:04,677::task::974::TaskManager.Task::(_decref) Task=`3d187e85-4483-4e18-8303-93db577dade7`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:15:05,196::task::579::TaskManager.Task::(_updateState) Task=`02084db1-0cf4-4195-8fc5-318a53139629`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:15:05,196::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:15:05,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:15:05,197::task::1168::TaskManager.Task::(prepare) Task=`02084db1-0cf4-4195-8fc5-318a53139629`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:15:05,197::task::579::TaskManager.Task::(_updateState) Task=`02084db1-0cf4-4195-8fc5-318a53139629`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:15:05,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:15:05,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:15:05,197::task::974::TaskManager.Task::(_decref) Task=`02084db1-0cf4-4195-8fc5-318a53139629`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:15:05,254::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:15:05,270::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276564 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:15:05,273::task::579::TaskManager.Task::(_updateState) Task=`6ba5c37c-5d87-49f8-b7b0-b83f909e46b7`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:15:05,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:15:05,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:15:05,277::task::1168::TaskManager.Task::(prepare) Task=`6ba5c37c-5d87-49f8-b7b0-b83f909e46b7`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:15:05,277::task::579::TaskManager.Task::(_updateState) Task=`6ba5c37c-5d87-49f8-b7b0-b83f909e46b7`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:15:05,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:15:05,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:15:05,278::task::974::TaskManager.Task::(_decref) Task=`6ba5c37c-5d87-49f8-b7b0-b83f909e46b7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:05,527::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:15:05,527::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:15:05,527::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:15:05,527::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:05,528::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:15:05,529::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:15:06,251::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:15:06,297::task::579::TaskManager.Task::(_updateState) Task=`d2e87e21-7cc2-40c8-983f-864446836253`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:15:06,297::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:15:06,298::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:15:06,298::task::1168::TaskManager.Task::(prepare) Task=`d2e87e21-7cc2-40c8-983f-864446836253`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:15:06,298::task::579::TaskManager.Task::(_updateState) Task=`d2e87e21-7cc2-40c8-983f-864446836253`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:15:06,298::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:15:06,298::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:15:06,298::task::974::TaskManager.Task::(_decref) Task=`d2e87e21-7cc2-40c8-983f-864446836253`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:06,530::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:07,253::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:15:07,253::task::579::TaskManager.Task::(_updateState) Task=`28baa204-8b50-42f4-8668-315fbddc5706`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:15:07,254::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:15:07,254::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:15:07,254::task::1168::TaskManager.Task::(prepare) Task=`28baa204-8b50-42f4-8668-315fbddc5706`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:15:07,254::task::579::TaskManager.Task::(_updateState) Task=`28baa204-8b50-42f4-8668-315fbddc5706`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:15:07,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:15:07,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:15:07,255::task::974::TaskManager.Task::(_decref) Task=`28baa204-8b50-42f4-8668-315fbddc5706`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:07,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:15:07,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:15:07,530::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:08,254::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:08,532::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:15:08,532::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:15:08,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:09,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:15:09,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:15:09,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:15:09,534::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:10,256::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:15:10,262::task::579::TaskManager.Task::(_updateState) Task=`d108a371-785f-4e82-a364-19266ef867ba`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:15:10,262::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:15:10,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:15:10,263::task::1168::TaskManager.Task::(prepare) Task=`d108a371-785f-4e82-a364-19266ef867ba`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:15:10,263::task::579::TaskManager.Task::(_updateState) Task=`d108a371-785f-4e82-a364-19266ef867ba`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:15:10,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:15:10,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:15:10,264::task::974::TaskManager.Task::(_decref) Task=`d108a371-785f-4e82-a364-19266ef867ba`::ref 0 aborting False >Thread-286334::DEBUG::2014-01-16 16:15:10,322::task::579::TaskManager.Task::(_updateState) Task=`89c0b31a-8243-4466-9544-606c0b1daaf1`::moving from state init -> state preparing >Thread-286334::INFO::2014-01-16 16:15:10,322::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286334::INFO::2014-01-16 16:15:10,323::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276564', 'lastCheck': '5.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000208794', 'lastCheck': '7.6', 'valid': True}} >Thread-286334::DEBUG::2014-01-16 16:15:10,323::task::1168::TaskManager.Task::(prepare) Task=`89c0b31a-8243-4466-9544-606c0b1daaf1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276564', 'lastCheck': '5.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000208794', 'lastCheck': '7.6', 'valid': True}} >Thread-286334::DEBUG::2014-01-16 16:15:10,323::task::579::TaskManager.Task::(_updateState) Task=`89c0b31a-8243-4466-9544-606c0b1daaf1`::moving from state preparing -> state finished >Thread-286334::DEBUG::2014-01-16 16:15:10,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286334::DEBUG::2014-01-16 16:15:10,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286334::DEBUG::2014-01-16 16:15:10,323::task::974::TaskManager.Task::(_decref) Task=`89c0b31a-8243-4466-9544-606c0b1daaf1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:10,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:11,540::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:15:11,540::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:12,257::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:12,257::task::579::TaskManager.Task::(_updateState) Task=`58d27a94-3eab-4dfb-9737-081c75db6488`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:15:12,258::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:15:12,258::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:15:12,258::task::1168::TaskManager.Task::(prepare) Task=`58d27a94-3eab-4dfb-9737-081c75db6488`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:15:12,258::task::579::TaskManager.Task::(_updateState) Task=`58d27a94-3eab-4dfb-9737-081c75db6488`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:15:12,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:15:12,259::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:15:12,259::task::974::TaskManager.Task::(_decref) Task=`58d27a94-3eab-4dfb-9737-081c75db6488`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:12,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:15:12,261::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:15:12,262::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:12,264::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:12,265::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:12,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:12,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:12,698::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000309525 s, 13.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:15:13,542::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:15:13,806::task::579::TaskManager.Task::(_updateState) Task=`52b59e58-d790-483f-9a15-d7e186ea9228`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:15:13,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:15:13,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:15:13,806::task::1168::TaskManager.Task::(prepare) Task=`52b59e58-d790-483f-9a15-d7e186ea9228`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:15:13,807::task::579::TaskManager.Task::(_updateState) Task=`52b59e58-d790-483f-9a15-d7e186ea9228`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:15:13,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:15:13,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:15:13,807::task::974::TaskManager.Task::(_decref) Task=`52b59e58-d790-483f-9a15-d7e186ea9228`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:14,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:14,543::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:15:14,744::task::579::TaskManager.Task::(_updateState) Task=`d9e8156d-ce3b-45ba-bcf2-f53ce802311b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:15:14,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:15:14,745::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:15:14,746::task::1168::TaskManager.Task::(prepare) Task=`d9e8156d-ce3b-45ba-bcf2-f53ce802311b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:15:14,746::task::579::TaskManager.Task::(_updateState) Task=`d9e8156d-ce3b-45ba-bcf2-f53ce802311b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:15:14,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:15:14,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:15:14,746::task::974::TaskManager.Task::(_decref) Task=`d9e8156d-ce3b-45ba-bcf2-f53ce802311b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:15:15,282::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:15:15,298::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000311368 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:15:15,545::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:16,268::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:16,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:15:16,752::task::579::TaskManager.Task::(_updateState) Task=`7ed32022-a534-4fbd-9b7d-f67c2703f591`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:15:16,752::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:15:16,752::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:15:16,753::task::1168::TaskManager.Task::(prepare) Task=`7ed32022-a534-4fbd-9b7d-f67c2703f591`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:15:16,753::task::579::TaskManager.Task::(_updateState) Task=`7ed32022-a534-4fbd-9b7d-f67c2703f591`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:15:16,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:15:16,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:15:16,753::task::974::TaskManager.Task::(_decref) Task=`7ed32022-a534-4fbd-9b7d-f67c2703f591`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:15:16,754::task::579::TaskManager.Task::(_updateState) Task=`40e79d6a-35a5-4c4e-9cbb-206200f53340`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:15:16,754::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:15:16,754::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:15:16,754::task::1168::TaskManager.Task::(prepare) Task=`40e79d6a-35a5-4c4e-9cbb-206200f53340`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:15:16,754::task::579::TaskManager.Task::(_updateState) Task=`40e79d6a-35a5-4c4e-9cbb-206200f53340`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:15:16,754::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:15:16,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:15:16,755::task::974::TaskManager.Task::(_decref) Task=`40e79d6a-35a5-4c4e-9cbb-206200f53340`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:17,269::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:17,547::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:15:17,547::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:18,271::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:18,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:19,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:20,272::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:20,550::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:21,551::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:15:21,919::task::579::TaskManager.Task::(_updateState) Task=`6e8fc036-0d41-4c4a-a18f-ccf91381edee`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:15:21,919::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:15:21,919::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:15:21,920::task::1168::TaskManager.Task::(prepare) Task=`6e8fc036-0d41-4c4a-a18f-ccf91381edee`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:15:21,920::task::579::TaskManager.Task::(_updateState) Task=`6e8fc036-0d41-4c4a-a18f-ccf91381edee`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:15:21,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:15:21,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:15:21,920::task::974::TaskManager.Task::(_decref) Task=`6e8fc036-0d41-4c4a-a18f-ccf91381edee`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:22,273::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:22,274::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:22,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:15:22,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:15:22,553::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:22,703::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:22,719::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000325027 s, 12.6 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 16:15:23,361::task::579::TaskManager.Task::(_updateState) Task=`80271b71-bc2d-4042-81e5-93fe994cdb78`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:15:23,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:15:23,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:15:23,363::task::1168::TaskManager.Task::(prepare) Task=`80271b71-bc2d-4042-81e5-93fe994cdb78`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:15:23,363::task::579::TaskManager.Task::(_updateState) Task=`80271b71-bc2d-4042-81e5-93fe994cdb78`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:15:23,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:15:23,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:15:23,364::task::974::TaskManager.Task::(_decref) Task=`80271b71-bc2d-4042-81e5-93fe994cdb78`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:23,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:15:23,554::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:24,275::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:24,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:15:24,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:15:24,556::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:15:25,305::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:15:25,321::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000336106 s, 1.1 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:15:25,419::task::579::TaskManager.Task::(_updateState) Task=`d2bc041c-96e9-4ece-b461-ed225b6e0288`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:15:25,419::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:15:25,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:15:25,420::task::1168::TaskManager.Task::(prepare) Task=`d2bc041c-96e9-4ece-b461-ed225b6e0288`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:15:25,420::task::579::TaskManager.Task::(_updateState) Task=`d2bc041c-96e9-4ece-b461-ed225b6e0288`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:15:25,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:15:25,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:15:25,420::task::974::TaskManager.Task::(_decref) Task=`d2bc041c-96e9-4ece-b461-ed225b6e0288`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:15:25,529::task::579::TaskManager.Task::(_updateState) Task=`ba63e5b2-46de-437c-97a9-5429bb027cd2`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:15:25,529::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:15:25,529::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:15:25,530::task::1168::TaskManager.Task::(prepare) Task=`ba63e5b2-46de-437c-97a9-5429bb027cd2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:15:25,530::task::579::TaskManager.Task::(_updateState) Task=`ba63e5b2-46de-437c-97a9-5429bb027cd2`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:15:25,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:15:25,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:15:25,530::task::974::TaskManager.Task::(_decref) Task=`ba63e5b2-46de-437c-97a9-5429bb027cd2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:25,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:15:25,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:26,277::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286340::DEBUG::2014-01-16 16:15:26,347::task::579::TaskManager.Task::(_updateState) Task=`336c26cb-921a-4a61-96dc-dcc96439db39`::moving from state init -> state preparing >Thread-286340::INFO::2014-01-16 16:15:26,348::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286340::INFO::2014-01-16 16:15:26,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000336106', 'lastCheck': '1.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325027', 'lastCheck': '3.6', 'valid': True}} >Thread-286340::DEBUG::2014-01-16 16:15:26,348::task::1168::TaskManager.Task::(prepare) Task=`336c26cb-921a-4a61-96dc-dcc96439db39`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000336106', 'lastCheck': '1.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325027', 'lastCheck': '3.6', 'valid': True}} >Thread-286340::DEBUG::2014-01-16 16:15:26,348::task::579::TaskManager.Task::(_updateState) Task=`336c26cb-921a-4a61-96dc-dcc96439db39`::moving from state preparing -> state finished >Thread-286340::DEBUG::2014-01-16 16:15:26,349::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286340::DEBUG::2014-01-16 16:15:26,349::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286340::DEBUG::2014-01-16 16:15:26,349::task::974::TaskManager.Task::(_decref) Task=`336c26cb-921a-4a61-96dc-dcc96439db39`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:26,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:15:26,558::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:27,279::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:15:27,279::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:15:27,281::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:27,560::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:28,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:28,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:15:28,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:29,562::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:15:29,563::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:30,284::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:15:30,387::task::579::TaskManager.Task::(_updateState) Task=`0313c6c7-9045-4cc9-94a3-a6776e2be990`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:15:30,387::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:15:30,388::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:15:30,388::task::1168::TaskManager.Task::(prepare) Task=`0313c6c7-9045-4cc9-94a3-a6776e2be990`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:15:30,388::task::579::TaskManager.Task::(_updateState) Task=`0313c6c7-9045-4cc9-94a3-a6776e2be990`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:15:30,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:15:30,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:15:30,389::task::974::TaskManager.Task::(_decref) Task=`0313c6c7-9045-4cc9-94a3-a6776e2be990`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:30,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:15:30,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:15:30,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:15:30,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:31,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:15:31,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:15:31,565::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:32,285::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:32,286::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:32,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:15:32,566::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:32,724::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:32,741::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000306581 s, 13.4 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:15:33,222::task::579::TaskManager.Task::(_updateState) Task=`7960e4c9-8d9a-4d24-ad30-4f28bc004137`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:15:33,223::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:15:33,223::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:15:33,223::task::1168::TaskManager.Task::(prepare) Task=`7960e4c9-8d9a-4d24-ad30-4f28bc004137`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:15:33,223::task::579::TaskManager.Task::(_updateState) Task=`7960e4c9-8d9a-4d24-ad30-4f28bc004137`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:15:33,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:15:33,224::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:15:33,224::task::974::TaskManager.Task::(_decref) Task=`7960e4c9-8d9a-4d24-ad30-4f28bc004137`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:33,566::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:15:33,567::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:15:33,567::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:15:33,567::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:15:33,950::task::579::TaskManager.Task::(_updateState) Task=`127abed0-58e2-4709-8c2e-c51e81b416d6`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:15:33,951::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:15:33,951::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:15:33,951::task::1168::TaskManager.Task::(prepare) Task=`127abed0-58e2-4709-8c2e-c51e81b416d6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:15:33,951::task::579::TaskManager.Task::(_updateState) Task=`127abed0-58e2-4709-8c2e-c51e81b416d6`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:15:33,952::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:15:33,952::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:15:33,952::task::974::TaskManager.Task::(_decref) Task=`127abed0-58e2-4709-8c2e-c51e81b416d6`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:15:33,961::task::579::TaskManager.Task::(_updateState) Task=`76580ccd-19de-4655-960e-daf2b151a77f`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:15:33,961::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:15:33,962::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:15:33,962::task::1168::TaskManager.Task::(prepare) Task=`76580ccd-19de-4655-960e-daf2b151a77f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:15:33,962::task::579::TaskManager.Task::(_updateState) Task=`76580ccd-19de-4655-960e-daf2b151a77f`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:15:33,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:15:33,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:15:33,963::task::974::TaskManager.Task::(_decref) Task=`76580ccd-19de-4655-960e-daf2b151a77f`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:15:33,981::task::579::TaskManager.Task::(_updateState) Task=`a25c1e77-bfb8-4540-970b-28121fc9a91c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:15:33,981::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:15:33,981::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:15:33,982::task::1168::TaskManager.Task::(prepare) Task=`a25c1e77-bfb8-4540-970b-28121fc9a91c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:15:33,982::task::579::TaskManager.Task::(_updateState) Task=`a25c1e77-bfb8-4540-970b-28121fc9a91c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:15:33,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:15:33,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:15:33,982::task::974::TaskManager.Task::(_decref) Task=`a25c1e77-bfb8-4540-970b-28121fc9a91c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:34,287::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:34,568::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:15:34,864::task::579::TaskManager.Task::(_updateState) Task=`aae0c3d4-668f-42ad-8c9e-9ac8fcfbfa01`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:15:34,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:15:34,864::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:15:34,864::task::1168::TaskManager.Task::(prepare) Task=`aae0c3d4-668f-42ad-8c9e-9ac8fcfbfa01`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:15:34,865::task::579::TaskManager.Task::(_updateState) Task=`aae0c3d4-668f-42ad-8c9e-9ac8fcfbfa01`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:15:34,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:15:34,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:15:34,865::task::974::TaskManager.Task::(_decref) Task=`aae0c3d4-668f-42ad-8c9e-9ac8fcfbfa01`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:15:35,260::task::579::TaskManager.Task::(_updateState) Task=`a5d6a7c5-b1f3-4e3b-b6f1-9404b5ae6c0d`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:15:35,260::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:15:35,261::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:15:35,261::task::1168::TaskManager.Task::(prepare) Task=`a5d6a7c5-b1f3-4e3b-b6f1-9404b5ae6c0d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:15:35,261::task::579::TaskManager.Task::(_updateState) Task=`a5d6a7c5-b1f3-4e3b-b6f1-9404b5ae6c0d`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:15:35,261::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:15:35,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:15:35,262::task::974::TaskManager.Task::(_decref) Task=`a5d6a7c5-b1f3-4e3b-b6f1-9404b5ae6c0d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:15:35,330::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:15:35,346::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308609 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:15:35,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:15:35,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:15:35,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:15:35,570::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:35,571::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:15:35,571::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-84377::DEBUG::2014-01-16 16:15:35,614::task::579::TaskManager.Task::(_updateState) Task=`a4da374e-f8ea-4eb8-b5be-86eb991aff6c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:15:35,615::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:15:35,615::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:15:35,615::task::1168::TaskManager.Task::(prepare) Task=`a4da374e-f8ea-4eb8-b5be-86eb991aff6c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:15:35,615::task::579::TaskManager.Task::(_updateState) Task=`a4da374e-f8ea-4eb8-b5be-86eb991aff6c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:15:35,615::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:15:35,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:15:35,616::task::974::TaskManager.Task::(_decref) Task=`a4da374e-f8ea-4eb8-b5be-86eb991aff6c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:15:35,616::task::579::TaskManager.Task::(_updateState) Task=`80c94ee7-ef3d-4f9e-9e41-5bacd2737873`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:15:35,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:15:35,616::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:15:35,617::task::1168::TaskManager.Task::(prepare) Task=`80c94ee7-ef3d-4f9e-9e41-5bacd2737873`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:15:35,617::task::579::TaskManager.Task::(_updateState) Task=`80c94ee7-ef3d-4f9e-9e41-5bacd2737873`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:15:35,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:15:35,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:15:35,617::task::974::TaskManager.Task::(_decref) Task=`80c94ee7-ef3d-4f9e-9e41-5bacd2737873`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:15:35,617::task::579::TaskManager.Task::(_updateState) Task=`f393bbca-6b03-4cc8-9796-5aea4902ba61`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:15:35,618::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:15:35,618::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:15:35,618::task::1168::TaskManager.Task::(prepare) Task=`f393bbca-6b03-4cc8-9796-5aea4902ba61`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:15:35,618::task::579::TaskManager.Task::(_updateState) Task=`f393bbca-6b03-4cc8-9796-5aea4902ba61`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:15:35,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:15:35,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:15:35,619::task::974::TaskManager.Task::(_decref) Task=`f393bbca-6b03-4cc8-9796-5aea4902ba61`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:36,289::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:36,573::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:37,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:37,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:15:37,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:15:37,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:38,291::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:38,575::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:15:38,576::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:15:38,576::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:39,577::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:15:39,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:15:39,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:15:39,578::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:40,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:40,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:41,580::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:15:41,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286346::DEBUG::2014-01-16 16:15:42,269::task::579::TaskManager.Task::(_updateState) Task=`72cd3781-595a-46fa-918a-2ae98e19ec59`::moving from state init -> state preparing >Thread-286346::INFO::2014-01-16 16:15:42,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286346::INFO::2014-01-16 16:15:42,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308609', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306581', 'lastCheck': '9.5', 'valid': True}} >Thread-286346::DEBUG::2014-01-16 16:15:42,270::task::1168::TaskManager.Task::(prepare) Task=`72cd3781-595a-46fa-918a-2ae98e19ec59`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308609', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306581', 'lastCheck': '9.5', 'valid': True}} >Thread-286346::DEBUG::2014-01-16 16:15:42,270::task::579::TaskManager.Task::(_updateState) Task=`72cd3781-595a-46fa-918a-2ae98e19ec59`::moving from state preparing -> state finished >Thread-286346::DEBUG::2014-01-16 16:15:42,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286346::DEBUG::2014-01-16 16:15:42,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286346::DEBUG::2014-01-16 16:15:42,271::task::974::TaskManager.Task::(_decref) Task=`72cd3781-595a-46fa-918a-2ae98e19ec59`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:42,294::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:42,295::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:15:42,296::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:15:42,297::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:42,582::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:42,747::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:42,764::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000206077 s, 19.9 MB/s\n'; <rc> = 0 >Thread-16244::DEBUG::2014-01-16 16:15:42,855::task::579::TaskManager.Task::(_updateState) Task=`76c11ea1-3a8d-47c1-a116-b485043ef700`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:15:42,856::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:15:42,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:15:42,856::task::1168::TaskManager.Task::(prepare) Task=`76c11ea1-3a8d-47c1-a116-b485043ef700`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:15:42,857::task::579::TaskManager.Task::(_updateState) Task=`76c11ea1-3a8d-47c1-a116-b485043ef700`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:15:42,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:15:42,857::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:15:42,857::task::974::TaskManager.Task::(_decref) Task=`76c11ea1-3a8d-47c1-a116-b485043ef700`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:43,583::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:44,298::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:44,585::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:15:45,355::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:15:45,373::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264004 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:15:45,586::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:46,300::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:46,587::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:15:46,980::task::579::TaskManager.Task::(_updateState) Task=`5f8e43d1-7eab-4620-8002-4493660fc915`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:15:46,981::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:15:46,981::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:15:46,981::task::1168::TaskManager.Task::(prepare) Task=`5f8e43d1-7eab-4620-8002-4493660fc915`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:15:46,981::task::579::TaskManager.Task::(_updateState) Task=`5f8e43d1-7eab-4620-8002-4493660fc915`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:15:46,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:15:46,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:15:46,982::task::974::TaskManager.Task::(_decref) Task=`5f8e43d1-7eab-4620-8002-4493660fc915`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:47,301::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:47,589::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:15:47,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:48,302::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:48,590::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:15:49,381::task::579::TaskManager.Task::(_updateState) Task=`0271fe7d-f8f8-45a5-a3bf-7479f3b519dc`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:15:49,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:15:49,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:15:49,381::task::1168::TaskManager.Task::(prepare) Task=`0271fe7d-f8f8-45a5-a3bf-7479f3b519dc`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:15:49,382::task::579::TaskManager.Task::(_updateState) Task=`0271fe7d-f8f8-45a5-a3bf-7479f3b519dc`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:15:49,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:15:49,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:15:49,382::task::974::TaskManager.Task::(_decref) Task=`0271fe7d-f8f8-45a5-a3bf-7479f3b519dc`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:15:49,382::task::579::TaskManager.Task::(_updateState) Task=`faf85c57-76b6-4ffe-bf73-9005ef171761`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:15:49,382::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:15:49,383::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:15:49,383::task::1168::TaskManager.Task::(prepare) Task=`faf85c57-76b6-4ffe-bf73-9005ef171761`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:15:49,383::task::579::TaskManager.Task::(_updateState) Task=`faf85c57-76b6-4ffe-bf73-9005ef171761`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:15:49,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:15:49,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:15:49,383::task::974::TaskManager.Task::(_decref) Task=`faf85c57-76b6-4ffe-bf73-9005ef171761`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:15:49,384::task::579::TaskManager.Task::(_updateState) Task=`cc3debd4-4d05-455d-9d98-9434e693395c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:15:49,384::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:15:49,384::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:15:49,384::task::1168::TaskManager.Task::(prepare) Task=`cc3debd4-4d05-455d-9d98-9434e693395c`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:15:49,384::task::579::TaskManager.Task::(_updateState) Task=`cc3debd4-4d05-455d-9d98-9434e693395c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:15:49,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:15:49,385::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:15:49,385::task::974::TaskManager.Task::(_decref) Task=`cc3debd4-4d05-455d-9d98-9434e693395c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:15:49,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:50,304::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:50,593::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:51,594::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:52,305::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:15:52,306::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:52,595::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:15:52,595::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:15:52,595::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:15:52,769::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:15:52,787::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000356687 s, 11.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:15:53,596::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:15:53,596::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:15:53,883::task::579::TaskManager.Task::(_updateState) Task=`6cc3a255-23c1-45e1-86df-4289c3f88127`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:15:53,884::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:15:53,884::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:15:53,884::task::1168::TaskManager.Task::(prepare) Task=`6cc3a255-23c1-45e1-86df-4289c3f88127`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:15:53,884::task::579::TaskManager.Task::(_updateState) Task=`6cc3a255-23c1-45e1-86df-4289c3f88127`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:15:53,884::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:15:53,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:15:53,885::task::974::TaskManager.Task::(_decref) Task=`6cc3a255-23c1-45e1-86df-4289c3f88127`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:54,307::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:54,597::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:15:54,598::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:15:54,598::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:15:55,380::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:15:55,398::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266996 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:15:55,599::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:15:55,600::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:56,309::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:56,601::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:15:56,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:15:57,312::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:15:57,312::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:15:57,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:57,603::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:15:57,871::task::579::TaskManager.Task::(_updateState) Task=`28af198b-84c1-4e0f-80a5-e0348f56a886`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:15:57,871::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:15:57,871::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:15:57,871::task::1168::TaskManager.Task::(prepare) Task=`28af198b-84c1-4e0f-80a5-e0348f56a886`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:15:57,872::task::579::TaskManager.Task::(_updateState) Task=`28af198b-84c1-4e0f-80a5-e0348f56a886`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:15:57,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:15:57,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:15:57,872::task::974::TaskManager.Task::(_decref) Task=`28af198b-84c1-4e0f-80a5-e0348f56a886`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:15:57,872::task::579::TaskManager.Task::(_updateState) Task=`682d9fdf-1438-480a-b3ce-e1172cc9c67b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:15:57,872::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:15:57,873::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:15:57,873::task::1168::TaskManager.Task::(prepare) Task=`682d9fdf-1438-480a-b3ce-e1172cc9c67b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:15:57,873::task::579::TaskManager.Task::(_updateState) Task=`682d9fdf-1438-480a-b3ce-e1172cc9c67b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:15:57,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:15:57,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:15:57,873::task::974::TaskManager.Task::(_decref) Task=`682d9fdf-1438-480a-b3ce-e1172cc9c67b`::ref 0 aborting False >Thread-286352::DEBUG::2014-01-16 16:15:57,972::task::579::TaskManager.Task::(_updateState) Task=`2867ea5c-7c6b-4db2-b972-a71781bc1f80`::moving from state init -> state preparing >Thread-286352::INFO::2014-01-16 16:15:57,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286352::INFO::2014-01-16 16:15:57,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266996', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356687', 'lastCheck': '5.2', 'valid': True}} >Thread-286352::DEBUG::2014-01-16 16:15:57,972::task::1168::TaskManager.Task::(prepare) Task=`2867ea5c-7c6b-4db2-b972-a71781bc1f80`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266996', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356687', 'lastCheck': '5.2', 'valid': True}} >Thread-286352::DEBUG::2014-01-16 16:15:57,973::task::579::TaskManager.Task::(_updateState) Task=`2867ea5c-7c6b-4db2-b972-a71781bc1f80`::moving from state preparing -> state finished >Thread-286352::DEBUG::2014-01-16 16:15:57,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286352::DEBUG::2014-01-16 16:15:57,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286352::DEBUG::2014-01-16 16:15:57,973::task::974::TaskManager.Task::(_decref) Task=`2867ea5c-7c6b-4db2-b972-a71781bc1f80`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:15:58,314::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:15:58,603::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:15:58,604::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:15:59,605::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:15:59,605::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:00,315::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:00,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:16:00,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:16:00,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:16:00,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:16:01,019::task::579::TaskManager.Task::(_updateState) Task=`731af86d-3367-497c-8683-b29d631199b3`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:16:01,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:16:01,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:16:01,020::task::1168::TaskManager.Task::(prepare) Task=`731af86d-3367-497c-8683-b29d631199b3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:16:01,020::task::579::TaskManager.Task::(_updateState) Task=`731af86d-3367-497c-8683-b29d631199b3`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:16:01,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:16:01,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:16:01,021::task::974::TaskManager.Task::(_decref) Task=`731af86d-3367-497c-8683-b29d631199b3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:01,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:16:01,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:16:01,608::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:02,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:02,318::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:02,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:16:02,610::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:16:02,793::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:16:02,810::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000350363 s, 11.7 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 16:16:03,530::task::579::TaskManager.Task::(_updateState) Task=`3453887a-4b5a-49e5-9f7c-3493dea92ac8`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:16:03,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:16:03,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:16:03,532::task::1168::TaskManager.Task::(prepare) Task=`3453887a-4b5a-49e5-9f7c-3493dea92ac8`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:16:03,532::task::579::TaskManager.Task::(_updateState) Task=`3453887a-4b5a-49e5-9f7c-3493dea92ac8`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:16:03,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:16:03,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:16:03,533::task::974::TaskManager.Task::(_decref) Task=`3453887a-4b5a-49e5-9f7c-3493dea92ac8`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:16:03,541::task::579::TaskManager.Task::(_updateState) Task=`3fc4c57b-24d5-48b1-bb8b-1c2f9a376df6`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:16:03,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:16:03,542::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:16:03,542::task::1168::TaskManager.Task::(prepare) Task=`3fc4c57b-24d5-48b1-bb8b-1c2f9a376df6`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:16:03,542::task::579::TaskManager.Task::(_updateState) Task=`3fc4c57b-24d5-48b1-bb8b-1c2f9a376df6`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:16:03,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:16:03,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:16:03,543::task::974::TaskManager.Task::(_decref) Task=`3fc4c57b-24d5-48b1-bb8b-1c2f9a376df6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:03,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:16:03,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:16:03,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:16:03,612::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:16:04,119::task::579::TaskManager.Task::(_updateState) Task=`7aecae3a-4297-405e-a87d-c6707a518159`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:16:04,119::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:16:04,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:16:04,120::task::1168::TaskManager.Task::(prepare) Task=`7aecae3a-4297-405e-a87d-c6707a518159`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:16:04,120::task::579::TaskManager.Task::(_updateState) Task=`7aecae3a-4297-405e-a87d-c6707a518159`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:16:04,120::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:16:04,120::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:16:04,120::task::974::TaskManager.Task::(_decref) Task=`7aecae3a-4297-405e-a87d-c6707a518159`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:16:04,121::task::579::TaskManager.Task::(_updateState) Task=`46ec7a61-7016-4c31-beaf-30518fe0c997`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:16:04,121::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:16:04,121::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:16:04,121::task::1168::TaskManager.Task::(prepare) Task=`46ec7a61-7016-4c31-beaf-30518fe0c997`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:16:04,121::task::579::TaskManager.Task::(_updateState) Task=`46ec7a61-7016-4c31-beaf-30518fe0c997`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:16:04,122::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:16:04,122::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:16:04,122::task::974::TaskManager.Task::(_decref) Task=`46ec7a61-7016-4c31-beaf-30518fe0c997`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:04,319::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:04,612::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:16:04,775::task::579::TaskManager.Task::(_updateState) Task=`7085123a-21d4-46a6-8d6f-d87ccd61ceae`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:16:04,775::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:16:04,776::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:16:04,776::task::1168::TaskManager.Task::(prepare) Task=`7085123a-21d4-46a6-8d6f-d87ccd61ceae`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:16:04,776::task::579::TaskManager.Task::(_updateState) Task=`7085123a-21d4-46a6-8d6f-d87ccd61ceae`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:16:04,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:16:04,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:16:04,776::task::974::TaskManager.Task::(_decref) Task=`7085123a-21d4-46a6-8d6f-d87ccd61ceae`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:16:04,777::task::579::TaskManager.Task::(_updateState) Task=`b33c5c79-87fb-4872-ad0d-5864949131a6`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:16:04,777::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:16:04,777::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:16:04,777::task::1168::TaskManager.Task::(prepare) Task=`b33c5c79-87fb-4872-ad0d-5864949131a6`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:16:04,777::task::579::TaskManager.Task::(_updateState) Task=`b33c5c79-87fb-4872-ad0d-5864949131a6`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:16:04,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:16:04,778::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:16:04,778::task::974::TaskManager.Task::(_decref) Task=`b33c5c79-87fb-4872-ad0d-5864949131a6`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:16:05,361::task::579::TaskManager.Task::(_updateState) Task=`4e146ddb-38bb-42d0-bea2-f2fcb0179f69`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:16:05,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:16:05,362::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:16:05,362::task::1168::TaskManager.Task::(prepare) Task=`4e146ddb-38bb-42d0-bea2-f2fcb0179f69`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:16:05,362::task::579::TaskManager.Task::(_updateState) Task=`4e146ddb-38bb-42d0-bea2-f2fcb0179f69`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:16:05,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:16:05,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:16:05,362::task::974::TaskManager.Task::(_decref) Task=`4e146ddb-38bb-42d0-bea2-f2fcb0179f69`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:16:05,400::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:16:05,405::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:16:05,405::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:16:05,411::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:16:05,412::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:16:05,413::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:16:05,413::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-17177::DEBUG::2014-01-16 16:16:05,417::task::579::TaskManager.Task::(_updateState) Task=`98dbed2e-df70-4f83-8495-cdd284c8e12d`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:16:05,418::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-20::DEBUG::2014-01-16 16:16:05,419::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-17177::INFO::2014-01-16 16:16:05,420::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:16:05,439::task::1168::TaskManager.Task::(prepare) Task=`98dbed2e-df70-4f83-8495-cdd284c8e12d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:16:05,441::task::579::TaskManager.Task::(_updateState) Task=`98dbed2e-df70-4f83-8495-cdd284c8e12d`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:16:05,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:16:05,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:16:05,446::task::974::TaskManager.Task::(_decref) Task=`98dbed2e-df70-4f83-8495-cdd284c8e12d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:16:05,448::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000269658 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:05,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:16:05,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:16:05,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:16:05,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:05,615::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:16:05,615::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:16:06,321::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:16:06,469::task::579::TaskManager.Task::(_updateState) Task=`e29a7d88-28b5-44f3-ade9-1d9b15f18f86`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:16:06,469::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:16:06,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:16:06,470::task::1168::TaskManager.Task::(prepare) Task=`e29a7d88-28b5-44f3-ade9-1d9b15f18f86`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:16:06,470::task::579::TaskManager.Task::(_updateState) Task=`e29a7d88-28b5-44f3-ade9-1d9b15f18f86`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:16:06,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:16:06,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:16:06,470::task::974::TaskManager.Task::(_decref) Task=`e29a7d88-28b5-44f3-ade9-1d9b15f18f86`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:06,615::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:07,322::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:16:07,446::task::579::TaskManager.Task::(_updateState) Task=`802e2ed5-bd52-4555-8101-0435f6e2037c`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:16:07,446::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:16:07,446::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:16:07,447::task::1168::TaskManager.Task::(prepare) Task=`802e2ed5-bd52-4555-8101-0435f6e2037c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:16:07,447::task::579::TaskManager.Task::(_updateState) Task=`802e2ed5-bd52-4555-8101-0435f6e2037c`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:16:07,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:16:07,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:16:07,447::task::974::TaskManager.Task::(_decref) Task=`802e2ed5-bd52-4555-8101-0435f6e2037c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:07,617::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:16:07,617::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:16:07,617::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:08,323::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:08,618::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:16:08,618::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:16:08,619::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:09,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:16:09,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:16:09,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:16:09,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:10,324::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:16:10,447::task::579::TaskManager.Task::(_updateState) Task=`3fbfbf1c-fef7-4f06-9994-e231513b1747`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:16:10,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:16:10,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:16:10,448::task::1168::TaskManager.Task::(prepare) Task=`3fbfbf1c-fef7-4f06-9994-e231513b1747`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:16:10,448::task::579::TaskManager.Task::(_updateState) Task=`3fbfbf1c-fef7-4f06-9994-e231513b1747`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:16:10,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:16:10,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:16:10,449::task::974::TaskManager.Task::(_decref) Task=`3fbfbf1c-fef7-4f06-9994-e231513b1747`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:10,621::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:11,623::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:16:11,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:12,326::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:12,326::task::579::TaskManager.Task::(_updateState) Task=`c5675368-7dea-4853-84ab-42098181d13f`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:16:12,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:16:12,327::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:16:12,327::task::1168::TaskManager.Task::(prepare) Task=`c5675368-7dea-4853-84ab-42098181d13f`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:16:12,327::task::579::TaskManager.Task::(_updateState) Task=`c5675368-7dea-4853-84ab-42098181d13f`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:16:12,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:16:12,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:16:12,328::task::974::TaskManager.Task::(_decref) Task=`c5675368-7dea-4853-84ab-42098181d13f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:12,330::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:16:12,330::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:16:12,331::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:12,333::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:12,334::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:12,624::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:16:12,815::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:16:12,832::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000243883 s, 16.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:13,625::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286359::DEBUG::2014-01-16 16:16:13,737::task::579::TaskManager.Task::(_updateState) Task=`c14e8bb5-7f25-49c0-8dfd-43d07e4d471a`::moving from state init -> state preparing >Thread-286359::INFO::2014-01-16 16:16:13,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286359::INFO::2014-01-16 16:16:13,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269658', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243883', 'lastCheck': '0.9', 'valid': True}} >Thread-286359::DEBUG::2014-01-16 16:16:13,738::task::1168::TaskManager.Task::(prepare) Task=`c14e8bb5-7f25-49c0-8dfd-43d07e4d471a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269658', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243883', 'lastCheck': '0.9', 'valid': True}} >Thread-286359::DEBUG::2014-01-16 16:16:13,738::task::579::TaskManager.Task::(_updateState) Task=`c14e8bb5-7f25-49c0-8dfd-43d07e4d471a`::moving from state preparing -> state finished >Thread-286359::DEBUG::2014-01-16 16:16:13,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286359::DEBUG::2014-01-16 16:16:13,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286359::DEBUG::2014-01-16 16:16:13,738::task::974::TaskManager.Task::(_decref) Task=`c14e8bb5-7f25-49c0-8dfd-43d07e4d471a`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:16:13,964::task::579::TaskManager.Task::(_updateState) Task=`8c735de8-47c3-4a06-9933-1a6411a07181`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:16:13,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:16:13,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:16:13,964::task::1168::TaskManager.Task::(prepare) Task=`8c735de8-47c3-4a06-9933-1a6411a07181`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:16:13,964::task::579::TaskManager.Task::(_updateState) Task=`8c735de8-47c3-4a06-9933-1a6411a07181`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:16:13,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:16:13,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:16:13,965::task::974::TaskManager.Task::(_decref) Task=`8c735de8-47c3-4a06-9933-1a6411a07181`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:14,335::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:14,627::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:16:14,830::task::579::TaskManager.Task::(_updateState) Task=`e8077224-ff13-4603-ad0a-751bd5fa5c91`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:16:14,830::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:16:14,831::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:16:14,831::task::1168::TaskManager.Task::(prepare) Task=`e8077224-ff13-4603-ad0a-751bd5fa5c91`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:16:14,831::task::579::TaskManager.Task::(_updateState) Task=`e8077224-ff13-4603-ad0a-751bd5fa5c91`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:16:14,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:16:14,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:16:14,832::task::974::TaskManager.Task::(_decref) Task=`e8077224-ff13-4603-ad0a-751bd5fa5c91`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:16:15,456::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:16:15,476::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292801 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:15,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:16,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:16,630::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:16:17,116::task::579::TaskManager.Task::(_updateState) Task=`87bd5674-73a1-4bd7-b24d-3422d3bb4c88`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:16:17,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:16:17,116::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:16:17,116::task::1168::TaskManager.Task::(prepare) Task=`87bd5674-73a1-4bd7-b24d-3422d3bb4c88`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:16:17,117::task::579::TaskManager.Task::(_updateState) Task=`87bd5674-73a1-4bd7-b24d-3422d3bb4c88`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:16:17,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:16:17,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:16:17,117::task::974::TaskManager.Task::(_decref) Task=`87bd5674-73a1-4bd7-b24d-3422d3bb4c88`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:16:17,117::task::579::TaskManager.Task::(_updateState) Task=`15827685-4bbe-4a81-83f2-786da0321562`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:16:17,118::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:16:17,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:16:17,118::task::1168::TaskManager.Task::(prepare) Task=`15827685-4bbe-4a81-83f2-786da0321562`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:16:17,118::task::579::TaskManager.Task::(_updateState) Task=`15827685-4bbe-4a81-83f2-786da0321562`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:16:17,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:16:17,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:16:17,119::task::974::TaskManager.Task::(_decref) Task=`15827685-4bbe-4a81-83f2-786da0321562`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:17,338::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:17,630::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:16:17,631::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:18,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:18,632::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:19,633::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:20,340::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:20,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:21,635::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:16:22,089::task::579::TaskManager.Task::(_updateState) Task=`c84dfd82-1507-4530-88e7-94cbdbe24bf8`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:16:22,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:16:22,090::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:16:22,090::task::1168::TaskManager.Task::(prepare) Task=`c84dfd82-1507-4530-88e7-94cbdbe24bf8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:16:22,091::task::579::TaskManager.Task::(_updateState) Task=`c84dfd82-1507-4530-88e7-94cbdbe24bf8`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:16:22,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:16:22,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:16:22,091::task::974::TaskManager.Task::(_decref) Task=`c84dfd82-1507-4530-88e7-94cbdbe24bf8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:22,342::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:22,343::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:22,636::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:16:22,636::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:16:22,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:16:22,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:16:22,858::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000233625 s, 17.5 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 16:16:23,448::task::579::TaskManager.Task::(_updateState) Task=`dcea00b6-8f73-4973-b986-c5ec3e198c8a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:16:23,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:16:23,449::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:16:23,449::task::1168::TaskManager.Task::(prepare) Task=`dcea00b6-8f73-4973-b986-c5ec3e198c8a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:16:23,449::task::579::TaskManager.Task::(_updateState) Task=`dcea00b6-8f73-4973-b986-c5ec3e198c8a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:16:23,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:16:23,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:16:23,450::task::974::TaskManager.Task::(_decref) Task=`dcea00b6-8f73-4973-b986-c5ec3e198c8a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:23,638::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:16:23,638::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:24,344::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:24,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:16:24,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:16:24,639::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:16:25,487::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:16:25,509::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000256975 s, 1.4 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:16:25,580::task::579::TaskManager.Task::(_updateState) Task=`108da83b-127e-4f64-b7a9-d04c52b580b5`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:16:25,581::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:16:25,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:16:25,582::task::1168::TaskManager.Task::(prepare) Task=`108da83b-127e-4f64-b7a9-d04c52b580b5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:16:25,582::task::579::TaskManager.Task::(_updateState) Task=`108da83b-127e-4f64-b7a9-d04c52b580b5`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:16:25,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:16:25,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:16:25,582::task::974::TaskManager.Task::(_decref) Task=`108da83b-127e-4f64-b7a9-d04c52b580b5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:25,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:16:25,641::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-59295::DEBUG::2014-01-16 16:16:25,687::task::579::TaskManager.Task::(_updateState) Task=`8aa0ec2a-0879-4b2f-a225-a71cee68837e`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:16:25,687::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:16:25,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:16:25,688::task::1168::TaskManager.Task::(prepare) Task=`8aa0ec2a-0879-4b2f-a225-a71cee68837e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:16:25,688::task::579::TaskManager.Task::(_updateState) Task=`8aa0ec2a-0879-4b2f-a225-a71cee68837e`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:16:25,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:16:25,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:16:25,688::task::974::TaskManager.Task::(_decref) Task=`8aa0ec2a-0879-4b2f-a225-a71cee68837e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:26,346::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:26,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:16:26,642::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:27,348::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:16:27,349::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:16:27,351::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:27,643::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:28,353::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:28,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:16:28,644::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286365::DEBUG::2014-01-16 16:16:29,471::task::579::TaskManager.Task::(_updateState) Task=`2a508692-58ad-45da-9cb1-20528d094a00`::moving from state init -> state preparing >Thread-286365::INFO::2014-01-16 16:16:29,471::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286365::INFO::2014-01-16 16:16:29,471::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256975', 'lastCheck': '4.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233625', 'lastCheck': '6.6', 'valid': True}} >Thread-286365::DEBUG::2014-01-16 16:16:29,471::task::1168::TaskManager.Task::(prepare) Task=`2a508692-58ad-45da-9cb1-20528d094a00`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256975', 'lastCheck': '4.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233625', 'lastCheck': '6.6', 'valid': True}} >Thread-286365::DEBUG::2014-01-16 16:16:29,472::task::579::TaskManager.Task::(_updateState) Task=`2a508692-58ad-45da-9cb1-20528d094a00`::moving from state preparing -> state finished >Thread-286365::DEBUG::2014-01-16 16:16:29,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286365::DEBUG::2014-01-16 16:16:29,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286365::DEBUG::2014-01-16 16:16:29,472::task::974::TaskManager.Task::(_decref) Task=`2a508692-58ad-45da-9cb1-20528d094a00`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:29,646::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:16:29,646::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:30,354::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:16:30,556::task::579::TaskManager.Task::(_updateState) Task=`094ce17f-6046-41f6-98ec-53e1801ea9d0`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:16:30,556::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:16:30,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:16:30,556::task::1168::TaskManager.Task::(prepare) Task=`094ce17f-6046-41f6-98ec-53e1801ea9d0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:16:30,556::task::579::TaskManager.Task::(_updateState) Task=`094ce17f-6046-41f6-98ec-53e1801ea9d0`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:16:30,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:16:30,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:16:30,557::task::974::TaskManager.Task::(_decref) Task=`094ce17f-6046-41f6-98ec-53e1801ea9d0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:30,647::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:16:30,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:16:30,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:16:30,648::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:31,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:16:31,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:16:31,649::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:32,355::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:32,356::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:32,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:16:32,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:16:32,864::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:16:32,881::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237806 s, 17.2 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:16:33,394::task::579::TaskManager.Task::(_updateState) Task=`4b81677c-f3fe-44b0-ba82-f0745ec617c3`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:16:33,394::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:16:33,395::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:16:33,395::task::1168::TaskManager.Task::(prepare) Task=`4b81677c-f3fe-44b0-ba82-f0745ec617c3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:16:33,395::task::579::TaskManager.Task::(_updateState) Task=`4b81677c-f3fe-44b0-ba82-f0745ec617c3`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:16:33,395::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:16:33,395::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:16:33,396::task::974::TaskManager.Task::(_decref) Task=`4b81677c-f3fe-44b0-ba82-f0745ec617c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:33,652::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:16:33,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:16:33,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:16:33,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:16:34,118::task::579::TaskManager.Task::(_updateState) Task=`4dec7808-db92-4af6-b412-2a452f425b7a`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:16:34,118::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:16:34,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:16:34,119::task::1168::TaskManager.Task::(prepare) Task=`4dec7808-db92-4af6-b412-2a452f425b7a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:16:34,119::task::579::TaskManager.Task::(_updateState) Task=`4dec7808-db92-4af6-b412-2a452f425b7a`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:16:34,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:16:34,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:16:34,119::task::974::TaskManager.Task::(_decref) Task=`4dec7808-db92-4af6-b412-2a452f425b7a`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:16:34,139::task::579::TaskManager.Task::(_updateState) Task=`57af4586-73e3-471a-ad25-548ae9454457`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:16:34,139::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:16:34,140::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:16:34,140::task::1168::TaskManager.Task::(prepare) Task=`57af4586-73e3-471a-ad25-548ae9454457`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:16:34,140::task::579::TaskManager.Task::(_updateState) Task=`57af4586-73e3-471a-ad25-548ae9454457`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:16:34,140::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:16:34,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:16:34,141::task::974::TaskManager.Task::(_decref) Task=`57af4586-73e3-471a-ad25-548ae9454457`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:16:34,157::task::579::TaskManager.Task::(_updateState) Task=`5905eb89-55e5-42d5-b2fe-70cf54b7307c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:16:34,158::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:16:34,158::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:16:34,158::task::1168::TaskManager.Task::(prepare) Task=`5905eb89-55e5-42d5-b2fe-70cf54b7307c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:16:34,158::task::579::TaskManager.Task::(_updateState) Task=`5905eb89-55e5-42d5-b2fe-70cf54b7307c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:16:34,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:16:34,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:16:34,159::task::974::TaskManager.Task::(_decref) Task=`5905eb89-55e5-42d5-b2fe-70cf54b7307c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:34,357::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:34,654::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:16:35,028::task::579::TaskManager.Task::(_updateState) Task=`e7b35505-744e-4f41-91b2-23f7ad1a6d01`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:16:35,029::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:16:35,029::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:16:35,029::task::1168::TaskManager.Task::(prepare) Task=`e7b35505-744e-4f41-91b2-23f7ad1a6d01`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:16:35,029::task::579::TaskManager.Task::(_updateState) Task=`e7b35505-744e-4f41-91b2-23f7ad1a6d01`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:16:35,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:16:35,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:16:35,030::task::974::TaskManager.Task::(_decref) Task=`e7b35505-744e-4f41-91b2-23f7ad1a6d01`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:16:35,420::task::579::TaskManager.Task::(_updateState) Task=`57e55940-d36a-4e40-b2be-7c09d85f9714`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:16:35,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:16:35,421::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:16:35,421::task::1168::TaskManager.Task::(prepare) Task=`57e55940-d36a-4e40-b2be-7c09d85f9714`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:16:35,421::task::579::TaskManager.Task::(_updateState) Task=`57e55940-d36a-4e40-b2be-7c09d85f9714`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:16:35,421::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:16:35,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:16:35,422::task::974::TaskManager.Task::(_decref) Task=`57e55940-d36a-4e40-b2be-7c09d85f9714`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:16:35,520::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:16:35,543::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251301 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:35,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:16:35,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:16:35,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:16:35,655::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:35,656::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:16:35,657::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-84377::DEBUG::2014-01-16 16:16:35,897::task::579::TaskManager.Task::(_updateState) Task=`5b755d37-b8fa-48ec-a088-d1a79d0fb9ad`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:16:35,897::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:16:35,898::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:16:35,898::task::1168::TaskManager.Task::(prepare) Task=`5b755d37-b8fa-48ec-a088-d1a79d0fb9ad`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:16:35,898::task::579::TaskManager.Task::(_updateState) Task=`5b755d37-b8fa-48ec-a088-d1a79d0fb9ad`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:16:35,898::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:16:35,898::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:16:35,899::task::974::TaskManager.Task::(_decref) Task=`5b755d37-b8fa-48ec-a088-d1a79d0fb9ad`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:16:35,899::task::579::TaskManager.Task::(_updateState) Task=`2044a55a-d45e-4b54-9a1e-689b4e637413`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:16:35,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:16:35,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:16:35,900::task::1168::TaskManager.Task::(prepare) Task=`2044a55a-d45e-4b54-9a1e-689b4e637413`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:16:35,900::task::579::TaskManager.Task::(_updateState) Task=`2044a55a-d45e-4b54-9a1e-689b4e637413`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:16:35,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:16:35,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:16:35,900::task::974::TaskManager.Task::(_decref) Task=`2044a55a-d45e-4b54-9a1e-689b4e637413`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:16:35,900::task::579::TaskManager.Task::(_updateState) Task=`bc9a201a-d945-4a49-8779-bc8ca5a04523`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:16:35,901::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:16:35,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:16:35,901::task::1168::TaskManager.Task::(prepare) Task=`bc9a201a-d945-4a49-8779-bc8ca5a04523`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:16:35,901::task::579::TaskManager.Task::(_updateState) Task=`bc9a201a-d945-4a49-8779-bc8ca5a04523`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:16:35,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:16:35,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:16:35,902::task::974::TaskManager.Task::(_decref) Task=`bc9a201a-d945-4a49-8779-bc8ca5a04523`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:36,359::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:36,659::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:37,361::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:37,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:16:37,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:16:37,660::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:38,362::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:38,661::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:16:38,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:16:38,662::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:39,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:16:39,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:16:39,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:16:39,663::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:40,364::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:40,664::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:41,665::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:16:41,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:42,365::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:42,367::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:16:42,367::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:16:42,368::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:42,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:16:42,889::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:16:42,905::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000240749 s, 17.0 MB/s\n'; <rc> = 0 >Thread-16244::DEBUG::2014-01-16 16:16:43,030::task::579::TaskManager.Task::(_updateState) Task=`9a12e558-5489-4508-bf8d-e2f4bc03999b`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:16:43,030::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:16:43,031::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:16:43,031::task::1168::TaskManager.Task::(prepare) Task=`9a12e558-5489-4508-bf8d-e2f4bc03999b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:16:43,031::task::579::TaskManager.Task::(_updateState) Task=`9a12e558-5489-4508-bf8d-e2f4bc03999b`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:16:43,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:16:43,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:16:43,032::task::974::TaskManager.Task::(_decref) Task=`9a12e558-5489-4508-bf8d-e2f4bc03999b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:16:43,667::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:44,370::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:44,667::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286371::DEBUG::2014-01-16 16:16:45,419::task::579::TaskManager.Task::(_updateState) Task=`b7f28bf6-4d09-4cb8-9460-b24dbe40147f`::moving from state init -> state preparing >Thread-286371::INFO::2014-01-16 16:16:45,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286371::INFO::2014-01-16 16:16:45,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251301', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240749', 'lastCheck': '2.5', 'valid': True}} >Thread-286371::DEBUG::2014-01-16 16:16:45,420::task::1168::TaskManager.Task::(prepare) Task=`b7f28bf6-4d09-4cb8-9460-b24dbe40147f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251301', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240749', 'lastCheck': '2.5', 'valid': True}} >Thread-286371::DEBUG::2014-01-16 16:16:45,420::task::579::TaskManager.Task::(_updateState) Task=`b7f28bf6-4d09-4cb8-9460-b24dbe40147f`::moving from state preparing -> state finished >Thread-286371::DEBUG::2014-01-16 16:16:45,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286371::DEBUG::2014-01-16 16:16:45,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286371::DEBUG::2014-01-16 16:16:45,420::task::974::TaskManager.Task::(_decref) Task=`b7f28bf6-4d09-4cb8-9460-b24dbe40147f`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:16:45,556::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:16:45,585::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266763 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:45,669::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:46,371::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:46,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:16:47,171::task::579::TaskManager.Task::(_updateState) Task=`85de95ed-ff91-4469-a8bd-41f34b93f7af`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:16:47,172::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:16:47,172::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:16:47,172::task::1168::TaskManager.Task::(prepare) Task=`85de95ed-ff91-4469-a8bd-41f34b93f7af`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:16:47,172::task::579::TaskManager.Task::(_updateState) Task=`85de95ed-ff91-4469-a8bd-41f34b93f7af`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:16:47,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:16:47,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:16:47,173::task::974::TaskManager.Task::(_decref) Task=`85de95ed-ff91-4469-a8bd-41f34b93f7af`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:47,373::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:47,671::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:16:47,672::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:48,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:48,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:49,674::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:16:49,946::task::579::TaskManager.Task::(_updateState) Task=`97d64885-00fd-45e3-ad34-8d7e04bdf2d4`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:16:49,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:16:49,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:16:49,947::task::1168::TaskManager.Task::(prepare) Task=`97d64885-00fd-45e3-ad34-8d7e04bdf2d4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:16:49,947::task::579::TaskManager.Task::(_updateState) Task=`97d64885-00fd-45e3-ad34-8d7e04bdf2d4`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:16:49,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:16:49,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:16:49,947::task::974::TaskManager.Task::(_decref) Task=`97d64885-00fd-45e3-ad34-8d7e04bdf2d4`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:16:49,948::task::579::TaskManager.Task::(_updateState) Task=`fe62a895-d21d-47f9-ac31-882e0209d5ad`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:16:49,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:16:49,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:16:49,948::task::1168::TaskManager.Task::(prepare) Task=`fe62a895-d21d-47f9-ac31-882e0209d5ad`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:16:49,948::task::579::TaskManager.Task::(_updateState) Task=`fe62a895-d21d-47f9-ac31-882e0209d5ad`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:16:49,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:16:49,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:16:49,949::task::974::TaskManager.Task::(_decref) Task=`fe62a895-d21d-47f9-ac31-882e0209d5ad`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:16:49,949::task::579::TaskManager.Task::(_updateState) Task=`307b2f10-b8be-4b49-b1b2-e1a72d9ec940`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:16:49,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:16:49,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:16:49,949::task::1168::TaskManager.Task::(prepare) Task=`307b2f10-b8be-4b49-b1b2-e1a72d9ec940`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:16:49,949::task::579::TaskManager.Task::(_updateState) Task=`307b2f10-b8be-4b49-b1b2-e1a72d9ec940`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:16:49,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:16:49,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:16:49,950::task::974::TaskManager.Task::(_decref) Task=`307b2f10-b8be-4b49-b1b2-e1a72d9ec940`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:50,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:50,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:51,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:52,377::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:16:52,378::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:52,677::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:16:52,677::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:16:52,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:16:52,911::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:16:52,927::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000263411 s, 15.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:53,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:16:53,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:16:54,062::task::579::TaskManager.Task::(_updateState) Task=`00aab18f-6021-46e8-b6e7-a84df143320a`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:16:54,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:16:54,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:16:54,063::task::1168::TaskManager.Task::(prepare) Task=`00aab18f-6021-46e8-b6e7-a84df143320a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:16:54,063::task::579::TaskManager.Task::(_updateState) Task=`00aab18f-6021-46e8-b6e7-a84df143320a`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:16:54,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:16:54,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:16:54,064::task::974::TaskManager.Task::(_decref) Task=`00aab18f-6021-46e8-b6e7-a84df143320a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:54,379::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:54,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:16:54,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:16:54,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:16:55,594::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:16:55,624::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300809 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:16:55,681::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:16:55,681::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:56,381::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:56,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:16:56,683::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:16:57,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:16:57,383::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:16:57,384::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:57,684::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:16:58,106::task::579::TaskManager.Task::(_updateState) Task=`a310d7e9-6a09-480d-ad93-9ae4fb869381`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:16:58,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:16:58,107::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:16:58,107::task::1168::TaskManager.Task::(prepare) Task=`a310d7e9-6a09-480d-ad93-9ae4fb869381`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:16:58,107::task::579::TaskManager.Task::(_updateState) Task=`a310d7e9-6a09-480d-ad93-9ae4fb869381`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:16:58,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:16:58,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:16:58,108::task::974::TaskManager.Task::(_decref) Task=`a310d7e9-6a09-480d-ad93-9ae4fb869381`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:16:58,108::task::579::TaskManager.Task::(_updateState) Task=`eb6accd3-e8cc-4771-84ca-334d80e189c2`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:16:58,108::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:16:58,108::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:16:58,109::task::1168::TaskManager.Task::(prepare) Task=`eb6accd3-e8cc-4771-84ca-334d80e189c2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:16:58,109::task::579::TaskManager.Task::(_updateState) Task=`eb6accd3-e8cc-4771-84ca-334d80e189c2`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:16:58,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:16:58,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:16:58,109::task::974::TaskManager.Task::(_decref) Task=`eb6accd3-e8cc-4771-84ca-334d80e189c2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:16:58,392::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:16:58,685::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:16:58,685::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:16:59,687::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:16:59,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:00,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:00,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:17:00,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:17:00,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:17:00,688::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286377::DEBUG::2014-01-16 16:17:01,130::task::579::TaskManager.Task::(_updateState) Task=`66852071-0b29-45df-8294-6021fa278a6d`::moving from state init -> state preparing >Thread-286377::INFO::2014-01-16 16:17:01,131::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286377::INFO::2014-01-16 16:17:01,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300809', 'lastCheck': '5.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263411', 'lastCheck': '8.2', 'valid': True}} >Thread-286377::DEBUG::2014-01-16 16:17:01,131::task::1168::TaskManager.Task::(prepare) Task=`66852071-0b29-45df-8294-6021fa278a6d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300809', 'lastCheck': '5.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263411', 'lastCheck': '8.2', 'valid': True}} >Thread-286377::DEBUG::2014-01-16 16:17:01,131::task::579::TaskManager.Task::(_updateState) Task=`66852071-0b29-45df-8294-6021fa278a6d`::moving from state preparing -> state finished >Thread-286377::DEBUG::2014-01-16 16:17:01,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286377::DEBUG::2014-01-16 16:17:01,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286377::DEBUG::2014-01-16 16:17:01,132::task::974::TaskManager.Task::(_decref) Task=`66852071-0b29-45df-8294-6021fa278a6d`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:17:01,194::task::579::TaskManager.Task::(_updateState) Task=`26533605-704e-4037-9c47-6dca5940470d`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:17:01,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:17:01,194::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:17:01,196::task::1168::TaskManager.Task::(prepare) Task=`26533605-704e-4037-9c47-6dca5940470d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:17:01,196::task::579::TaskManager.Task::(_updateState) Task=`26533605-704e-4037-9c47-6dca5940470d`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:17:01,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:17:01,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:17:01,197::task::974::TaskManager.Task::(_decref) Task=`26533605-704e-4037-9c47-6dca5940470d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:01,689::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:17:01,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:17:01,690::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:02,395::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:02,396::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:02,691::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:17:02,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:17:02,933::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:17:02,950::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000219472 s, 18.7 MB/s\n'; <rc> = 0 >Thread-251782::DEBUG::2014-01-16 16:17:03,613::task::579::TaskManager.Task::(_updateState) Task=`b5a04e47-54f1-444b-9319-c0d03ccbfd72`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:17:03,614::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:17:03,615::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:17:03,615::task::1168::TaskManager.Task::(prepare) Task=`b5a04e47-54f1-444b-9319-c0d03ccbfd72`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:17:03,615::task::579::TaskManager.Task::(_updateState) Task=`b5a04e47-54f1-444b-9319-c0d03ccbfd72`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:17:03,616::task::579::TaskManager.Task::(_updateState) Task=`34f73ad8-de46-4035-a822-857b76599f8f`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:17:03,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::INFO::2014-01-16 16:17:03,617::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:17:03,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:17:03,618::task::974::TaskManager.Task::(_decref) Task=`b5a04e47-54f1-444b-9319-c0d03ccbfd72`::ref 0 aborting False >Thread-53040::INFO::2014-01-16 16:17:03,618::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:17:03,619::task::1168::TaskManager.Task::(prepare) Task=`34f73ad8-de46-4035-a822-857b76599f8f`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:17:03,619::task::579::TaskManager.Task::(_updateState) Task=`34f73ad8-de46-4035-a822-857b76599f8f`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:17:03,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:17:03,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:17:03,619::task::974::TaskManager.Task::(_decref) Task=`34f73ad8-de46-4035-a822-857b76599f8f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:03,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:17:03,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:17:03,693::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:17:03,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:17:04,335::task::579::TaskManager.Task::(_updateState) Task=`d3f354fe-897d-42e1-84c8-efc3e6050136`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:17:04,335::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:17:04,336::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:17:04,336::task::1168::TaskManager.Task::(prepare) Task=`d3f354fe-897d-42e1-84c8-efc3e6050136`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:17:04,336::task::579::TaskManager.Task::(_updateState) Task=`d3f354fe-897d-42e1-84c8-efc3e6050136`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:17:04,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:17:04,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:17:04,337::task::974::TaskManager.Task::(_decref) Task=`d3f354fe-897d-42e1-84c8-efc3e6050136`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:17:04,337::task::579::TaskManager.Task::(_updateState) Task=`fc12530f-0113-4233-acbc-fb7d2dc77fef`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:17:04,337::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:17:04,337::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:17:04,337::task::1168::TaskManager.Task::(prepare) Task=`fc12530f-0113-4233-acbc-fb7d2dc77fef`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:17:04,338::task::579::TaskManager.Task::(_updateState) Task=`fc12530f-0113-4233-acbc-fb7d2dc77fef`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:17:04,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:17:04,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:17:04,338::task::974::TaskManager.Task::(_decref) Task=`fc12530f-0113-4233-acbc-fb7d2dc77fef`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:04,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:04,694::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:17:04,876::task::579::TaskManager.Task::(_updateState) Task=`7e64f72d-722c-4635-870f-789974a34f3e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:17:04,877::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:17:04,878::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:17:04,878::task::1168::TaskManager.Task::(prepare) Task=`7e64f72d-722c-4635-870f-789974a34f3e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:17:04,878::task::579::TaskManager.Task::(_updateState) Task=`7e64f72d-722c-4635-870f-789974a34f3e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:17:04,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:17:04,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:17:04,879::task::974::TaskManager.Task::(_decref) Task=`7e64f72d-722c-4635-870f-789974a34f3e`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:17:04,879::task::579::TaskManager.Task::(_updateState) Task=`1815be19-a623-48b7-9bcf-64b344555982`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:17:04,879::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:17:04,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:17:04,880::task::1168::TaskManager.Task::(prepare) Task=`1815be19-a623-48b7-9bcf-64b344555982`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:17:04,880::task::579::TaskManager.Task::(_updateState) Task=`1815be19-a623-48b7-9bcf-64b344555982`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:17:04,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:17:04,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:17:04,880::task::974::TaskManager.Task::(_decref) Task=`1815be19-a623-48b7-9bcf-64b344555982`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:17:05,532::task::579::TaskManager.Task::(_updateState) Task=`f6e706de-d804-42aa-aa6d-bce0a355a033`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:17:05,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:17:05,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:17:05,533::task::1168::TaskManager.Task::(prepare) Task=`f6e706de-d804-42aa-aa6d-bce0a355a033`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:17:05,533::task::579::TaskManager.Task::(_updateState) Task=`f6e706de-d804-42aa-aa6d-bce0a355a033`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:17:05,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:17:05,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:17:05,533::task::974::TaskManager.Task::(_decref) Task=`f6e706de-d804-42aa-aa6d-bce0a355a033`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:17:05,633::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-17177::DEBUG::2014-01-16 16:17:05,657::task::579::TaskManager.Task::(_updateState) Task=`cee44524-4659-4419-aa40-d20846acccef`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:17:05,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:17:05,668::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:17:05,670::task::1168::TaskManager.Task::(prepare) Task=`cee44524-4659-4419-aa40-d20846acccef`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:17:05,672::task::579::TaskManager.Task::(_updateState) Task=`cee44524-4659-4419-aa40-d20846acccef`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:17:05,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:17:05,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2014-01-16 16:17:05,676::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273549 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:17:05,677::task::974::TaskManager.Task::(_decref) Task=`cee44524-4659-4419-aa40-d20846acccef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:05,695::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:17:05,695::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:17:05,696::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:17:05,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:05,696::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:17:05,697::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:17:06,399::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:17:06,650::task::579::TaskManager.Task::(_updateState) Task=`719507e3-4f3e-469d-b934-bf92fe0d0f05`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:17:06,650::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:17:06,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:17:06,651::task::1168::TaskManager.Task::(prepare) Task=`719507e3-4f3e-469d-b934-bf92fe0d0f05`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:17:06,651::task::579::TaskManager.Task::(_updateState) Task=`719507e3-4f3e-469d-b934-bf92fe0d0f05`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:17:06,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:17:06,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:17:06,651::task::974::TaskManager.Task::(_decref) Task=`719507e3-4f3e-469d-b934-bf92fe0d0f05`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:06,698::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:07,401::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:17:07,659::task::579::TaskManager.Task::(_updateState) Task=`f3896cb8-2a39-4e52-8d58-c07d0271b17b`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:17:07,659::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:17:07,660::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:17:07,660::task::1168::TaskManager.Task::(prepare) Task=`f3896cb8-2a39-4e52-8d58-c07d0271b17b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:17:07,660::task::579::TaskManager.Task::(_updateState) Task=`f3896cb8-2a39-4e52-8d58-c07d0271b17b`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:17:07,660::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:17:07,660::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:17:07,660::task::974::TaskManager.Task::(_decref) Task=`f3896cb8-2a39-4e52-8d58-c07d0271b17b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:07,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:17:07,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:17:07,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:08,402::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:08,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:17:08,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:17:08,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:09,702::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:17:09,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:17:09,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:17:09,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:10,403::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:17:10,662::task::579::TaskManager.Task::(_updateState) Task=`e8aa47f0-01dc-48df-9ecd-f2329767bc89`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:17:10,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:17:10,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:17:10,663::task::1168::TaskManager.Task::(prepare) Task=`e8aa47f0-01dc-48df-9ecd-f2329767bc89`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:17:10,663::task::579::TaskManager.Task::(_updateState) Task=`e8aa47f0-01dc-48df-9ecd-f2329767bc89`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:17:10,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:17:10,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:17:10,663::task::974::TaskManager.Task::(_decref) Task=`e8aa47f0-01dc-48df-9ecd-f2329767bc89`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:10,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:11,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:17:11,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:12,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:12,405::task::579::TaskManager.Task::(_updateState) Task=`3241287d-790a-4cf9-8e96-0098bf5a6d9b`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:17:12,405::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:17:12,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:17:12,406::task::1168::TaskManager.Task::(prepare) Task=`3241287d-790a-4cf9-8e96-0098bf5a6d9b`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:17:12,406::task::579::TaskManager.Task::(_updateState) Task=`3241287d-790a-4cf9-8e96-0098bf5a6d9b`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:17:12,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:17:12,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:17:12,406::task::974::TaskManager.Task::(_decref) Task=`3241287d-790a-4cf9-8e96-0098bf5a6d9b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:12,408::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:17:12,408::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:17:12,410::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:12,413::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:12,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:12,707::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:17:12,956::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:17:12,972::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237829 s, 17.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:17:13,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:17:14,135::task::579::TaskManager.Task::(_updateState) Task=`2ecf5ceb-c664-4fae-a0de-a475983aea5e`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:17:14,135::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:17:14,135::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:17:14,135::task::1168::TaskManager.Task::(prepare) Task=`2ecf5ceb-c664-4fae-a0de-a475983aea5e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:17:14,136::task::579::TaskManager.Task::(_updateState) Task=`2ecf5ceb-c664-4fae-a0de-a475983aea5e`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:17:14,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:17:14,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:17:14,136::task::974::TaskManager.Task::(_decref) Task=`2ecf5ceb-c664-4fae-a0de-a475983aea5e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:14,416::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:14,710::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:17:14,954::task::579::TaskManager.Task::(_updateState) Task=`d610113d-d85b-46ab-acd7-c135c34ea556`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:17:14,954::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:17:14,955::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:17:14,956::task::1168::TaskManager.Task::(prepare) Task=`d610113d-d85b-46ab-acd7-c135c34ea556`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:17:14,956::task::579::TaskManager.Task::(_updateState) Task=`d610113d-d85b-46ab-acd7-c135c34ea556`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:17:14,956::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:17:14,956::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:17:14,956::task::974::TaskManager.Task::(_decref) Task=`d610113d-d85b-46ab-acd7-c135c34ea556`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:17:15,686::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:17:15,702::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290358 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:17:15,711::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:16,417::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:16,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286383::DEBUG::2014-01-16 16:17:16,902::task::579::TaskManager.Task::(_updateState) Task=`fc440ada-d3b8-4257-b8c5-b3990f03dfde`::moving from state init -> state preparing >Thread-286383::INFO::2014-01-16 16:17:16,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286383::INFO::2014-01-16 16:17:16,902::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290358', 'lastCheck': '1.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237829', 'lastCheck': '3.9', 'valid': True}} >Thread-286383::DEBUG::2014-01-16 16:17:16,903::task::1168::TaskManager.Task::(prepare) Task=`fc440ada-d3b8-4257-b8c5-b3990f03dfde`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290358', 'lastCheck': '1.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237829', 'lastCheck': '3.9', 'valid': True}} >Thread-286383::DEBUG::2014-01-16 16:17:16,903::task::579::TaskManager.Task::(_updateState) Task=`fc440ada-d3b8-4257-b8c5-b3990f03dfde`::moving from state preparing -> state finished >Thread-286383::DEBUG::2014-01-16 16:17:16,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286383::DEBUG::2014-01-16 16:17:16,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286383::DEBUG::2014-01-16 16:17:16,903::task::974::TaskManager.Task::(_decref) Task=`fc440ada-d3b8-4257-b8c5-b3990f03dfde`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:17,419::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:17:17,479::task::579::TaskManager.Task::(_updateState) Task=`4cec4620-3602-4616-990b-8e8aed3275c8`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:17:17,480::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:17:17,480::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:17:17,480::task::1168::TaskManager.Task::(prepare) Task=`4cec4620-3602-4616-990b-8e8aed3275c8`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:17:17,480::task::579::TaskManager.Task::(_updateState) Task=`4cec4620-3602-4616-990b-8e8aed3275c8`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:17:17,480::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:17:17,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:17:17,481::task::974::TaskManager.Task::(_decref) Task=`4cec4620-3602-4616-990b-8e8aed3275c8`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:17:17,481::task::579::TaskManager.Task::(_updateState) Task=`b002f789-ee10-43b7-9c90-876e92ad9120`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:17:17,481::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:17:17,482::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:17:17,482::task::1168::TaskManager.Task::(prepare) Task=`b002f789-ee10-43b7-9c90-876e92ad9120`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:17:17,482::task::579::TaskManager.Task::(_updateState) Task=`b002f789-ee10-43b7-9c90-876e92ad9120`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:17:17,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:17:17,482::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:17:17,482::task::974::TaskManager.Task::(_decref) Task=`b002f789-ee10-43b7-9c90-876e92ad9120`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:17,714::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:17:17,714::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:18,420::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:18,715::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:19,716::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:20,421::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:20,717::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:21,719::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:17:22,281::task::579::TaskManager.Task::(_updateState) Task=`71cff649-7b84-4402-80db-d3f03b33b04f`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:17:22,282::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:17:22,282::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:17:22,282::task::1168::TaskManager.Task::(prepare) Task=`71cff649-7b84-4402-80db-d3f03b33b04f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:17:22,282::task::579::TaskManager.Task::(_updateState) Task=`71cff649-7b84-4402-80db-d3f03b33b04f`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:17:22,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:17:22,283::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:17:22,283::task::974::TaskManager.Task::(_decref) Task=`71cff649-7b84-4402-80db-d3f03b33b04f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:22,423::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:22,424::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:22,720::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:17:22,720::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:17:22,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:17:22,978::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:17:22,995::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024731 s, 16.6 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 16:17:23,516::task::579::TaskManager.Task::(_updateState) Task=`419e7692-4550-4279-bf05-2e8122ab35a8`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:17:23,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:17:23,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:17:23,518::task::1168::TaskManager.Task::(prepare) Task=`419e7692-4550-4279-bf05-2e8122ab35a8`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:17:23,518::task::579::TaskManager.Task::(_updateState) Task=`419e7692-4550-4279-bf05-2e8122ab35a8`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:17:23,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:17:23,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:17:23,518::task::974::TaskManager.Task::(_decref) Task=`419e7692-4550-4279-bf05-2e8122ab35a8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:23,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:17:23,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:24,425::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:24,724::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:17:24,724::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:17:24,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:17:25,711::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:17:25,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:17:25,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:17:25,734::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000337693 s, 1.1 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:17:25,740::task::579::TaskManager.Task::(_updateState) Task=`6c51d1c7-3349-4e25-8e77-42970b7033de`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:17:25,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:17:25,741::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:17:25,741::task::1168::TaskManager.Task::(prepare) Task=`6c51d1c7-3349-4e25-8e77-42970b7033de`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:17:25,741::task::579::TaskManager.Task::(_updateState) Task=`6c51d1c7-3349-4e25-8e77-42970b7033de`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:17:25,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:17:25,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:17:25,742::task::974::TaskManager.Task::(_decref) Task=`6c51d1c7-3349-4e25-8e77-42970b7033de`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:17:25,851::task::579::TaskManager.Task::(_updateState) Task=`ce777124-5000-4615-898b-a68ef5e4fb83`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:17:25,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:17:25,852::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:17:25,852::task::1168::TaskManager.Task::(prepare) Task=`ce777124-5000-4615-898b-a68ef5e4fb83`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:17:25,852::task::579::TaskManager.Task::(_updateState) Task=`ce777124-5000-4615-898b-a68ef5e4fb83`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:17:25,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:17:25,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:17:25,853::task::974::TaskManager.Task::(_decref) Task=`ce777124-5000-4615-898b-a68ef5e4fb83`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:26,427::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:26,733::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:17:26,734::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:27,429::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:17:27,429::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:17:27,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:27,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:28,431::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:28,736::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:17:28,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:29,738::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:17:29,738::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:30,433::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:30,739::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:17:30,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:17:30,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:17:30,740::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:17:30,743::task::579::TaskManager.Task::(_updateState) Task=`ea77791d-a5ec-40df-8ec3-5e8a04fd683f`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:17:30,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:17:30,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:17:30,744::task::1168::TaskManager.Task::(prepare) Task=`ea77791d-a5ec-40df-8ec3-5e8a04fd683f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:17:30,744::task::579::TaskManager.Task::(_updateState) Task=`ea77791d-a5ec-40df-8ec3-5e8a04fd683f`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:17:30,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:17:30,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:17:30,745::task::974::TaskManager.Task::(_decref) Task=`ea77791d-a5ec-40df-8ec3-5e8a04fd683f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:31,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:17:31,742::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:17:31,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:32,434::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:32,435::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286389::DEBUG::2014-01-16 16:17:32,630::task::579::TaskManager.Task::(_updateState) Task=`f5d0474d-1dda-4fc6-bb15-2cb06895304c`::moving from state init -> state preparing >Thread-286389::INFO::2014-01-16 16:17:32,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286389::INFO::2014-01-16 16:17:32,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000337693', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024731', 'lastCheck': '9.6', 'valid': True}} >Thread-286389::DEBUG::2014-01-16 16:17:32,630::task::1168::TaskManager.Task::(prepare) Task=`f5d0474d-1dda-4fc6-bb15-2cb06895304c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000337693', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024731', 'lastCheck': '9.6', 'valid': True}} >Thread-286389::DEBUG::2014-01-16 16:17:32,630::task::579::TaskManager.Task::(_updateState) Task=`f5d0474d-1dda-4fc6-bb15-2cb06895304c`::moving from state preparing -> state finished >Thread-286389::DEBUG::2014-01-16 16:17:32,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286389::DEBUG::2014-01-16 16:17:32,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286389::DEBUG::2014-01-16 16:17:32,631::task::974::TaskManager.Task::(_decref) Task=`f5d0474d-1dda-4fc6-bb15-2cb06895304c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:32,743::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:17:32,743::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:17:33,000::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:17:33,017::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000243343 s, 16.8 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:17:33,554::task::579::TaskManager.Task::(_updateState) Task=`d3cd801d-96c2-48ff-a689-c13b657e0e2e`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:17:33,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:17:33,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:17:33,555::task::1168::TaskManager.Task::(prepare) Task=`d3cd801d-96c2-48ff-a689-c13b657e0e2e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:17:33,555::task::579::TaskManager.Task::(_updateState) Task=`d3cd801d-96c2-48ff-a689-c13b657e0e2e`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:17:33,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:17:33,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:17:33,556::task::974::TaskManager.Task::(_decref) Task=`d3cd801d-96c2-48ff-a689-c13b657e0e2e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:33,744::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:17:33,745::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:17:33,745::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:17:33,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:17:34,282::task::579::TaskManager.Task::(_updateState) Task=`0606b78e-8321-4879-90e2-fcdc74042754`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:17:34,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:17:34,283::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:17:34,283::task::1168::TaskManager.Task::(prepare) Task=`0606b78e-8321-4879-90e2-fcdc74042754`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:17:34,283::task::579::TaskManager.Task::(_updateState) Task=`0606b78e-8321-4879-90e2-fcdc74042754`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:17:34,283::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:17:34,283::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:17:34,284::task::974::TaskManager.Task::(_decref) Task=`0606b78e-8321-4879-90e2-fcdc74042754`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:17:34,325::task::579::TaskManager.Task::(_updateState) Task=`6ec2bcb1-7339-4276-a6fc-456ce37f6205`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:17:34,325::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:17:34,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:17:34,325::task::1168::TaskManager.Task::(prepare) Task=`6ec2bcb1-7339-4276-a6fc-456ce37f6205`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:17:34,326::task::579::TaskManager.Task::(_updateState) Task=`6ec2bcb1-7339-4276-a6fc-456ce37f6205`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:17:34,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:17:34,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:17:34,326::task::974::TaskManager.Task::(_decref) Task=`6ec2bcb1-7339-4276-a6fc-456ce37f6205`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:17:34,331::task::579::TaskManager.Task::(_updateState) Task=`ab5adf42-a020-4cd9-8a49-0898149ffc5c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:17:34,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:17:34,332::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:17:34,332::task::1168::TaskManager.Task::(prepare) Task=`ab5adf42-a020-4cd9-8a49-0898149ffc5c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:17:34,332::task::579::TaskManager.Task::(_updateState) Task=`ab5adf42-a020-4cd9-8a49-0898149ffc5c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:17:34,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:17:34,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:17:34,332::task::974::TaskManager.Task::(_decref) Task=`ab5adf42-a020-4cd9-8a49-0898149ffc5c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:34,436::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:34,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:17:35,191::task::579::TaskManager.Task::(_updateState) Task=`e6ac0123-e5fe-4233-8e09-303d89b50714`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:17:35,192::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:17:35,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:17:35,192::task::1168::TaskManager.Task::(prepare) Task=`e6ac0123-e5fe-4233-8e09-303d89b50714`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:17:35,192::task::579::TaskManager.Task::(_updateState) Task=`e6ac0123-e5fe-4233-8e09-303d89b50714`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:17:35,192::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:17:35,192::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:17:35,192::task::974::TaskManager.Task::(_decref) Task=`e6ac0123-e5fe-4233-8e09-303d89b50714`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:17:35,589::task::579::TaskManager.Task::(_updateState) Task=`a6dd2a5a-84f0-4490-8ec9-0142c6ea6d48`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:17:35,589::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:17:35,589::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:17:35,589::task::1168::TaskManager.Task::(prepare) Task=`a6dd2a5a-84f0-4490-8ec9-0142c6ea6d48`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:17:35,590::task::579::TaskManager.Task::(_updateState) Task=`a6dd2a5a-84f0-4490-8ec9-0142c6ea6d48`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:17:35,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:17:35,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:17:35,590::task::974::TaskManager.Task::(_decref) Task=`a6dd2a5a-84f0-4490-8ec9-0142c6ea6d48`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:17:35,744::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:17:35,763::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:17:35,767::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:17:35,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:17:35,770::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:35,771::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:17:35,773::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20::DEBUG::2014-01-16 16:17:35,775::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000287483 s, 1.3 MB/s\n'; <rc> = 0 >Thread-84377::DEBUG::2014-01-16 16:17:36,168::task::579::TaskManager.Task::(_updateState) Task=`d6f4a394-d665-44ea-b72c-b2f6a24bc34f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:17:36,168::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:17:36,169::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:17:36,169::task::1168::TaskManager.Task::(prepare) Task=`d6f4a394-d665-44ea-b72c-b2f6a24bc34f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:17:36,169::task::579::TaskManager.Task::(_updateState) Task=`d6f4a394-d665-44ea-b72c-b2f6a24bc34f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:17:36,169::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:17:36,169::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:17:36,170::task::974::TaskManager.Task::(_decref) Task=`d6f4a394-d665-44ea-b72c-b2f6a24bc34f`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:17:36,170::task::579::TaskManager.Task::(_updateState) Task=`4cf288bd-1312-48b0-aa32-b4e8a4a95141`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:17:36,170::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:17:36,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:17:36,170::task::1168::TaskManager.Task::(prepare) Task=`4cf288bd-1312-48b0-aa32-b4e8a4a95141`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:17:36,171::task::579::TaskManager.Task::(_updateState) Task=`4cf288bd-1312-48b0-aa32-b4e8a4a95141`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:17:36,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:17:36,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:17:36,171::task::974::TaskManager.Task::(_decref) Task=`4cf288bd-1312-48b0-aa32-b4e8a4a95141`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:17:36,171::task::579::TaskManager.Task::(_updateState) Task=`95254dde-9a23-4825-a278-0c9b7c8e1bbc`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:17:36,172::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:17:36,172::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:17:36,172::task::1168::TaskManager.Task::(prepare) Task=`95254dde-9a23-4825-a278-0c9b7c8e1bbc`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:17:36,172::task::579::TaskManager.Task::(_updateState) Task=`95254dde-9a23-4825-a278-0c9b7c8e1bbc`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:17:36,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:17:36,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:17:36,173::task::974::TaskManager.Task::(_decref) Task=`95254dde-9a23-4825-a278-0c9b7c8e1bbc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:36,437::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:36,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:37,440::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:37,776::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:17:37,777::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:17:37,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:38,441::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:38,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:17:38,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:17:38,778::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:39,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:17:39,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:17:39,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:17:39,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:40,443::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:40,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:41,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:17:41,783::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:42,444::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:42,446::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:17:42,446::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:17:42,447::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:42,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:17:43,022::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:17:43,040::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000297878 s, 13.8 MB/s\n'; <rc> = 0 >Thread-16244::DEBUG::2014-01-16 16:17:43,206::task::579::TaskManager.Task::(_updateState) Task=`0ca58017-dd7d-4d24-acc7-4c20d4046ec0`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:17:43,206::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:17:43,207::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:17:43,207::task::1168::TaskManager.Task::(prepare) Task=`0ca58017-dd7d-4d24-acc7-4c20d4046ec0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:17:43,207::task::579::TaskManager.Task::(_updateState) Task=`0ca58017-dd7d-4d24-acc7-4c20d4046ec0`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:17:43,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:17:43,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:17:43,208::task::974::TaskManager.Task::(_decref) Task=`0ca58017-dd7d-4d24-acc7-4c20d4046ec0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:43,785::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:44,449::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:44,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:17:45,782::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:17:45,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:17:45,805::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000305007 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:17:46,450::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:46,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:17:47,354::task::579::TaskManager.Task::(_updateState) Task=`1f893b3d-b985-42f2-bdd8-2e48e37cc370`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:17:47,355::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:17:47,355::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:17:47,355::task::1168::TaskManager.Task::(prepare) Task=`1f893b3d-b985-42f2-bdd8-2e48e37cc370`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:17:47,355::task::579::TaskManager.Task::(_updateState) Task=`1f893b3d-b985-42f2-bdd8-2e48e37cc370`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:17:47,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:17:47,356::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:17:47,356::task::974::TaskManager.Task::(_decref) Task=`1f893b3d-b985-42f2-bdd8-2e48e37cc370`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:47,451::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:47,805::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:17:47,806::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286395::DEBUG::2014-01-16 16:17:48,402::task::579::TaskManager.Task::(_updateState) Task=`f5f9cb06-87c9-4030-a1f3-5a9daf590c76`::moving from state init -> state preparing >Thread-286395::INFO::2014-01-16 16:17:48,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286395::INFO::2014-01-16 16:17:48,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305007', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297878', 'lastCheck': '5.4', 'valid': True}} >Thread-286395::DEBUG::2014-01-16 16:17:48,403::task::1168::TaskManager.Task::(prepare) Task=`f5f9cb06-87c9-4030-a1f3-5a9daf590c76`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305007', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297878', 'lastCheck': '5.4', 'valid': True}} >Thread-286395::DEBUG::2014-01-16 16:17:48,403::task::579::TaskManager.Task::(_updateState) Task=`f5f9cb06-87c9-4030-a1f3-5a9daf590c76`::moving from state preparing -> state finished >Thread-286395::DEBUG::2014-01-16 16:17:48,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286395::DEBUG::2014-01-16 16:17:48,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286395::DEBUG::2014-01-16 16:17:48,403::task::974::TaskManager.Task::(_decref) Task=`f5f9cb06-87c9-4030-a1f3-5a9daf590c76`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:48,453::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:48,807::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:49,808::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:50,454::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:17:50,525::task::579::TaskManager.Task::(_updateState) Task=`9682fcc6-df87-4378-a279-60b78e72f84f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:17:50,525::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:17:50,526::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:17:50,526::task::1168::TaskManager.Task::(prepare) Task=`9682fcc6-df87-4378-a279-60b78e72f84f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:17:50,526::task::579::TaskManager.Task::(_updateState) Task=`9682fcc6-df87-4378-a279-60b78e72f84f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:17:50,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:17:50,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:17:50,526::task::974::TaskManager.Task::(_decref) Task=`9682fcc6-df87-4378-a279-60b78e72f84f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:17:50,527::task::579::TaskManager.Task::(_updateState) Task=`b0d26c11-7f26-4334-9eaf-03af19c85d77`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:17:50,527::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:17:50,527::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:17:50,527::task::1168::TaskManager.Task::(prepare) Task=`b0d26c11-7f26-4334-9eaf-03af19c85d77`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:17:50,527::task::579::TaskManager.Task::(_updateState) Task=`b0d26c11-7f26-4334-9eaf-03af19c85d77`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:17:50,527::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:17:50,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:17:50,528::task::974::TaskManager.Task::(_decref) Task=`b0d26c11-7f26-4334-9eaf-03af19c85d77`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:17:50,528::task::579::TaskManager.Task::(_updateState) Task=`a06e0871-d7bd-4a95-9743-6eaae8f5c05d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:17:50,528::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:17:50,528::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:17:50,528::task::1168::TaskManager.Task::(prepare) Task=`a06e0871-d7bd-4a95-9743-6eaae8f5c05d`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:17:50,528::task::579::TaskManager.Task::(_updateState) Task=`a06e0871-d7bd-4a95-9743-6eaae8f5c05d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:17:50,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:17:50,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:17:50,529::task::974::TaskManager.Task::(_decref) Task=`a06e0871-d7bd-4a95-9743-6eaae8f5c05d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:17:50,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:51,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:52,455::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:17:52,456::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:52,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:17:52,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:17:52,811::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:17:53,045::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:17:53,063::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026109 s, 15.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:17:53,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:17:53,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:17:54,230::task::579::TaskManager.Task::(_updateState) Task=`04943ac3-d25c-4894-b326-544f5eaf8fa0`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:17:54,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:17:54,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:17:54,230::task::1168::TaskManager.Task::(prepare) Task=`04943ac3-d25c-4894-b326-544f5eaf8fa0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:17:54,231::task::579::TaskManager.Task::(_updateState) Task=`04943ac3-d25c-4894-b326-544f5eaf8fa0`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:17:54,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:17:54,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:17:54,231::task::974::TaskManager.Task::(_decref) Task=`04943ac3-d25c-4894-b326-544f5eaf8fa0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:54,457::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:54,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:17:54,813::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:17:54,813::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:55,814::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:17:55,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:17:55,816::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:17:55,836::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000254569 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:17:56,458::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:56,816::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:17:56,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:17:57,461::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:17:57,461::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:17:57,462::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:57,817::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:17:58,327::task::579::TaskManager.Task::(_updateState) Task=`aad1ab54-6b4f-48a6-9f7a-441827f5b505`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:17:58,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:17:58,328::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:17:58,328::task::1168::TaskManager.Task::(prepare) Task=`aad1ab54-6b4f-48a6-9f7a-441827f5b505`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:17:58,328::task::579::TaskManager.Task::(_updateState) Task=`aad1ab54-6b4f-48a6-9f7a-441827f5b505`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:17:58,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:17:58,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:17:58,329::task::974::TaskManager.Task::(_decref) Task=`aad1ab54-6b4f-48a6-9f7a-441827f5b505`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:17:58,329::task::579::TaskManager.Task::(_updateState) Task=`d2bccdce-c952-4ba0-8123-df2f41d58e58`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:17:58,329::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:17:58,329::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:17:58,329::task::1168::TaskManager.Task::(prepare) Task=`d2bccdce-c952-4ba0-8123-df2f41d58e58`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:17:58,329::task::579::TaskManager.Task::(_updateState) Task=`d2bccdce-c952-4ba0-8123-df2f41d58e58`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:17:58,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:17:58,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:17:58,330::task::974::TaskManager.Task::(_decref) Task=`d2bccdce-c952-4ba0-8123-df2f41d58e58`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:17:58,463::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:17:58,818::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:17:58,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:17:59,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:17:59,821::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:00,465::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:00,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:18:00,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:18:00,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:18:00,823::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:18:01,370::task::579::TaskManager.Task::(_updateState) Task=`d4b9c9f5-05c3-4150-b951-e0a97868ded7`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:18:01,371::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:18:01,371::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:18:01,371::task::1168::TaskManager.Task::(prepare) Task=`d4b9c9f5-05c3-4150-b951-e0a97868ded7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:18:01,371::task::579::TaskManager.Task::(_updateState) Task=`d4b9c9f5-05c3-4150-b951-e0a97868ded7`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:18:01,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:18:01,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:18:01,372::task::974::TaskManager.Task::(_decref) Task=`d4b9c9f5-05c3-4150-b951-e0a97868ded7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:01,824::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:18:01,824::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:18:01,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:02,466::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:02,467::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:02,826::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:18:02,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:18:03,068::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:18:03,085::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000303888 s, 13.5 MB/s\n'; <rc> = 0 >Thread-251782::DEBUG::2014-01-16 16:18:03,710::task::579::TaskManager.Task::(_updateState) Task=`df14acda-14f9-46de-9564-6f8e3bc9000b`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:18:03,711::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 16:18:03,711::task::579::TaskManager.Task::(_updateState) Task=`7672b6ee-9338-4549-8770-04eae8a41150`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:18:03,712::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 16:18:03,712::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:18:03,712::task::1168::TaskManager.Task::(prepare) Task=`df14acda-14f9-46de-9564-6f8e3bc9000b`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:18:03,713::task::579::TaskManager.Task::(_updateState) Task=`df14acda-14f9-46de-9564-6f8e3bc9000b`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:18:03,713::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::INFO::2014-01-16 16:18:03,713::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:18:03,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:18:03,714::task::1168::TaskManager.Task::(prepare) Task=`7672b6ee-9338-4549-8770-04eae8a41150`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:18:03,714::task::974::TaskManager.Task::(_decref) Task=`df14acda-14f9-46de-9564-6f8e3bc9000b`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:18:03,714::task::579::TaskManager.Task::(_updateState) Task=`7672b6ee-9338-4549-8770-04eae8a41150`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:18:03,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:18:03,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:18:03,715::task::974::TaskManager.Task::(_decref) Task=`7672b6ee-9338-4549-8770-04eae8a41150`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:03,827::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:18:03,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:18:03,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:18:03,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286401::DEBUG::2014-01-16 16:18:04,103::task::579::TaskManager.Task::(_updateState) Task=`f6756e06-3e12-45a1-8a01-43967754381b`::moving from state init -> state preparing >Thread-286401::INFO::2014-01-16 16:18:04,104::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286401::INFO::2014-01-16 16:18:04,104::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254569', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303888', 'lastCheck': '1.0', 'valid': True}} >Thread-286401::DEBUG::2014-01-16 16:18:04,104::task::1168::TaskManager.Task::(prepare) Task=`f6756e06-3e12-45a1-8a01-43967754381b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254569', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303888', 'lastCheck': '1.0', 'valid': True}} >Thread-286401::DEBUG::2014-01-16 16:18:04,104::task::579::TaskManager.Task::(_updateState) Task=`f6756e06-3e12-45a1-8a01-43967754381b`::moving from state preparing -> state finished >Thread-286401::DEBUG::2014-01-16 16:18:04,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286401::DEBUG::2014-01-16 16:18:04,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286401::DEBUG::2014-01-16 16:18:04,105::task::974::TaskManager.Task::(_decref) Task=`f6756e06-3e12-45a1-8a01-43967754381b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:04,468::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:18:04,549::task::579::TaskManager.Task::(_updateState) Task=`466f7839-9dd1-4846-ae3b-3fc0ccbf161e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:18:04,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:18:04,550::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:18:04,550::task::1168::TaskManager.Task::(prepare) Task=`466f7839-9dd1-4846-ae3b-3fc0ccbf161e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:18:04,550::task::579::TaskManager.Task::(_updateState) Task=`466f7839-9dd1-4846-ae3b-3fc0ccbf161e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:18:04,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:18:04,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:18:04,550::task::974::TaskManager.Task::(_decref) Task=`466f7839-9dd1-4846-ae3b-3fc0ccbf161e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:18:04,551::task::579::TaskManager.Task::(_updateState) Task=`2a0850da-287f-4b45-83c1-d89032412413`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:18:04,551::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:18:04,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:18:04,551::task::1168::TaskManager.Task::(prepare) Task=`2a0850da-287f-4b45-83c1-d89032412413`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:18:04,551::task::579::TaskManager.Task::(_updateState) Task=`2a0850da-287f-4b45-83c1-d89032412413`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:18:04,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:18:04,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:18:04,552::task::974::TaskManager.Task::(_decref) Task=`2a0850da-287f-4b45-83c1-d89032412413`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:04,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:18:04,969::task::579::TaskManager.Task::(_updateState) Task=`9bf2c114-283a-4e91-879b-441e8263b265`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:18:04,970::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:18:04,970::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:18:04,970::task::1168::TaskManager.Task::(prepare) Task=`9bf2c114-283a-4e91-879b-441e8263b265`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:18:04,970::task::579::TaskManager.Task::(_updateState) Task=`9bf2c114-283a-4e91-879b-441e8263b265`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:18:04,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:18:04,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:18:04,970::task::974::TaskManager.Task::(_decref) Task=`9bf2c114-283a-4e91-879b-441e8263b265`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:18:04,971::task::579::TaskManager.Task::(_updateState) Task=`4195d4f8-75e0-4c2a-8df0-489418ceea78`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:18:04,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:18:04,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:18:04,971::task::1168::TaskManager.Task::(prepare) Task=`4195d4f8-75e0-4c2a-8df0-489418ceea78`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:18:04,971::task::579::TaskManager.Task::(_updateState) Task=`4195d4f8-75e0-4c2a-8df0-489418ceea78`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:18:04,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:18:04,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:18:04,972::task::974::TaskManager.Task::(_decref) Task=`4195d4f8-75e0-4c2a-8df0-489418ceea78`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:18:05,692::task::579::TaskManager.Task::(_updateState) Task=`f9308e85-c5f1-4171-a4e7-aacb758ecad1`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:18:05,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:18:05,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:18:05,693::task::1168::TaskManager.Task::(prepare) Task=`f9308e85-c5f1-4171-a4e7-aacb758ecad1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:18:05,693::task::579::TaskManager.Task::(_updateState) Task=`f9308e85-c5f1-4171-a4e7-aacb758ecad1`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:18:05,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:18:05,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:18:05,693::task::974::TaskManager.Task::(_decref) Task=`f9308e85-c5f1-4171-a4e7-aacb758ecad1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:05,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:18:05,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:18:05,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:18:05,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:05,831::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:18:05,831::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20::DEBUG::2014-01-16 16:18:05,846::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:18:05,867::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000256224 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:18:05,869::task::579::TaskManager.Task::(_updateState) Task=`2ec31d41-b509-4431-aece-b4baf23d1006`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:18:05,873::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:18:05,875::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:18:05,876::task::1168::TaskManager.Task::(prepare) Task=`2ec31d41-b509-4431-aece-b4baf23d1006`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:18:05,878::task::579::TaskManager.Task::(_updateState) Task=`2ec31d41-b509-4431-aece-b4baf23d1006`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:18:05,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:18:05,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:18:05,880::task::974::TaskManager.Task::(_decref) Task=`2ec31d41-b509-4431-aece-b4baf23d1006`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:06,469::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:18:06,818::task::579::TaskManager.Task::(_updateState) Task=`3ae94af4-aebe-4b05-a94d-0e41be58fb0a`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:18:06,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:18:06,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:18:06,819::task::1168::TaskManager.Task::(prepare) Task=`3ae94af4-aebe-4b05-a94d-0e41be58fb0a`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:18:06,819::task::579::TaskManager.Task::(_updateState) Task=`3ae94af4-aebe-4b05-a94d-0e41be58fb0a`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:18:06,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:18:06,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:18:06,819::task::974::TaskManager.Task::(_decref) Task=`3ae94af4-aebe-4b05-a94d-0e41be58fb0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:06,832::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:07,470::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:07,833::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:18:07,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:18:07,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:18:07,872::task::579::TaskManager.Task::(_updateState) Task=`d2d84c37-a089-424b-8ebd-57c799aeda23`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:18:07,872::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:18:07,872::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:18:07,873::task::1168::TaskManager.Task::(prepare) Task=`d2d84c37-a089-424b-8ebd-57c799aeda23`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:18:07,873::task::579::TaskManager.Task::(_updateState) Task=`d2d84c37-a089-424b-8ebd-57c799aeda23`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:18:07,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:18:07,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:18:07,873::task::974::TaskManager.Task::(_decref) Task=`d2d84c37-a089-424b-8ebd-57c799aeda23`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:08,471::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:08,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:18:08,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:18:08,835::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:09,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:18:09,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:18:09,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:18:09,837::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:10,473::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:10,839::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:18:10,876::task::579::TaskManager.Task::(_updateState) Task=`ee4ef5c9-9bb1-4e03-ac57-ba7f5c1d1633`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:18:10,876::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:18:10,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:18:10,877::task::1168::TaskManager.Task::(prepare) Task=`ee4ef5c9-9bb1-4e03-ac57-ba7f5c1d1633`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:18:10,877::task::579::TaskManager.Task::(_updateState) Task=`ee4ef5c9-9bb1-4e03-ac57-ba7f5c1d1633`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:18:10,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:18:10,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:18:10,877::task::974::TaskManager.Task::(_decref) Task=`ee4ef5c9-9bb1-4e03-ac57-ba7f5c1d1633`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:11,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:18:11,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:12,474::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:12,475::task::579::TaskManager.Task::(_updateState) Task=`6d9c782b-cebc-42e2-9041-bfc0c2f0e415`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:18:12,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:18:12,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:18:12,475::task::1168::TaskManager.Task::(prepare) Task=`6d9c782b-cebc-42e2-9041-bfc0c2f0e415`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:18:12,475::task::579::TaskManager.Task::(_updateState) Task=`6d9c782b-cebc-42e2-9041-bfc0c2f0e415`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:18:12,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:18:12,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:18:12,476::task::974::TaskManager.Task::(_decref) Task=`6d9c782b-cebc-42e2-9041-bfc0c2f0e415`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:12,478::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:18:12,478::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:18:12,479::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:12,481::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:12,482::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:12,841::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:18:13,090::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:18:13,106::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260882 s, 15.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:18:13,842::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:18:14,290::task::579::TaskManager.Task::(_updateState) Task=`b798b0e8-dc57-451a-bc0d-773927069c3a`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:18:14,290::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:18:14,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:18:14,291::task::1168::TaskManager.Task::(prepare) Task=`b798b0e8-dc57-451a-bc0d-773927069c3a`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:18:14,291::task::579::TaskManager.Task::(_updateState) Task=`b798b0e8-dc57-451a-bc0d-773927069c3a`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:18:14,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:18:14,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:18:14,291::task::974::TaskManager.Task::(_decref) Task=`b798b0e8-dc57-451a-bc0d-773927069c3a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:14,483::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:14,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:18:15,043::task::579::TaskManager.Task::(_updateState) Task=`35cc7a0d-1053-4fa2-9dee-71a9019c66ac`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:18:15,043::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:18:15,043::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:18:15,044::task::1168::TaskManager.Task::(prepare) Task=`35cc7a0d-1053-4fa2-9dee-71a9019c66ac`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:18:15,044::task::579::TaskManager.Task::(_updateState) Task=`35cc7a0d-1053-4fa2-9dee-71a9019c66ac`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:18:15,044::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:18:15,044::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:18:15,044::task::974::TaskManager.Task::(_decref) Task=`35cc7a0d-1053-4fa2-9dee-71a9019c66ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:15,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:18:15,885::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:18:15,902::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029128 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:18:16,484::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:16,845::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:17,486::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:17,846::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:18:17,846::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:18:17,848::task::579::TaskManager.Task::(_updateState) Task=`498c4f44-0952-425c-9610-c2ad3725e091`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:18:17,848::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:18:17,849::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:18:17,849::task::1168::TaskManager.Task::(prepare) Task=`498c4f44-0952-425c-9610-c2ad3725e091`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:18:17,849::task::579::TaskManager.Task::(_updateState) Task=`498c4f44-0952-425c-9610-c2ad3725e091`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:18:17,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:18:17,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:18:17,850::task::974::TaskManager.Task::(_decref) Task=`498c4f44-0952-425c-9610-c2ad3725e091`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:18:17,850::task::579::TaskManager.Task::(_updateState) Task=`58fcf9c0-28a3-4b3b-93cd-68c65349ba72`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:18:17,850::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:18:17,850::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:18:17,850::task::1168::TaskManager.Task::(prepare) Task=`58fcf9c0-28a3-4b3b-93cd-68c65349ba72`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:18:17,851::task::579::TaskManager.Task::(_updateState) Task=`58fcf9c0-28a3-4b3b-93cd-68c65349ba72`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:18:17,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:18:17,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:18:17,851::task::974::TaskManager.Task::(_decref) Task=`58fcf9c0-28a3-4b3b-93cd-68c65349ba72`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:18,487::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:18,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286407::DEBUG::2014-01-16 16:18:19,847::task::579::TaskManager.Task::(_updateState) Task=`07131029-18dc-4a90-902c-c3b57473c363`::moving from state init -> state preparing >Thread-286407::INFO::2014-01-16 16:18:19,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286407::INFO::2014-01-16 16:18:19,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029128', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260882', 'lastCheck': '6.7', 'valid': True}} >Thread-286407::DEBUG::2014-01-16 16:18:19,848::task::1168::TaskManager.Task::(prepare) Task=`07131029-18dc-4a90-902c-c3b57473c363`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029128', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260882', 'lastCheck': '6.7', 'valid': True}} >Thread-286407::DEBUG::2014-01-16 16:18:19,848::task::579::TaskManager.Task::(_updateState) Task=`07131029-18dc-4a90-902c-c3b57473c363`::moving from state preparing -> state finished >Thread-286407::DEBUG::2014-01-16 16:18:19,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286407::DEBUG::2014-01-16 16:18:19,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286407::DEBUG::2014-01-16 16:18:19,848::task::974::TaskManager.Task::(_decref) Task=`07131029-18dc-4a90-902c-c3b57473c363`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:19,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:20,488::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:20,851::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:21,852::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:18:22,451::task::579::TaskManager.Task::(_updateState) Task=`d9c06570-5ee7-4daf-86f5-c490e32a671d`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:18:22,451::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:18:22,451::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:18:22,451::task::1168::TaskManager.Task::(prepare) Task=`d9c06570-5ee7-4daf-86f5-c490e32a671d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:18:22,452::task::579::TaskManager.Task::(_updateState) Task=`d9c06570-5ee7-4daf-86f5-c490e32a671d`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:18:22,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:18:22,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:18:22,452::task::974::TaskManager.Task::(_decref) Task=`d9c06570-5ee7-4daf-86f5-c490e32a671d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:22,490::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:22,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:22,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:18:22,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:18:22,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:18:23,112::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:18:23,129::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000279425 s, 14.7 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 16:18:23,578::task::579::TaskManager.Task::(_updateState) Task=`7d8e58e4-e24a-4a0d-9e58-d6a5f080510d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:18:23,579::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:18:23,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:18:23,579::task::1168::TaskManager.Task::(prepare) Task=`7d8e58e4-e24a-4a0d-9e58-d6a5f080510d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:18:23,579::task::579::TaskManager.Task::(_updateState) Task=`7d8e58e4-e24a-4a0d-9e58-d6a5f080510d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:18:23,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:18:23,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:18:23,580::task::974::TaskManager.Task::(_decref) Task=`7d8e58e4-e24a-4a0d-9e58-d6a5f080510d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:23,854::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:18:23,855::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:24,492::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:24,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:18:24,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:18:24,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:25,857::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:18:25,857::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:18:25,912::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:18:25,936::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00156396 s, 233 kB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:18:25,941::task::579::TaskManager.Task::(_updateState) Task=`ee20fa4a-4c2e-4101-9e71-cad0d51bf40c`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:18:25,941::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:18:25,942::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:18:25,942::task::1168::TaskManager.Task::(prepare) Task=`ee20fa4a-4c2e-4101-9e71-cad0d51bf40c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:18:25,943::task::579::TaskManager.Task::(_updateState) Task=`ee20fa4a-4c2e-4101-9e71-cad0d51bf40c`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:18:25,944::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:18:25,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:18:25,945::task::974::TaskManager.Task::(_decref) Task=`ee20fa4a-4c2e-4101-9e71-cad0d51bf40c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:18:26,011::task::579::TaskManager.Task::(_updateState) Task=`5b937661-9ec9-48e2-87fa-6c95d363a1eb`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:18:26,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:18:26,012::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:18:26,012::task::1168::TaskManager.Task::(prepare) Task=`5b937661-9ec9-48e2-87fa-6c95d363a1eb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:18:26,013::task::579::TaskManager.Task::(_updateState) Task=`5b937661-9ec9-48e2-87fa-6c95d363a1eb`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:18:26,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:18:26,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:18:26,013::task::974::TaskManager.Task::(_decref) Task=`5b937661-9ec9-48e2-87fa-6c95d363a1eb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:26,494::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:26,858::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:18:26,859::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:27,496::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:18:27,496::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:18:27,497::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:27,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:28,498::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:28,861::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:18:28,861::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:29,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:18:29,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:30,500::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:30,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:18:30,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:18:30,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:18:30,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:18:30,945::task::579::TaskManager.Task::(_updateState) Task=`200d3df6-23df-41c5-9b2f-7cb63113c209`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:18:30,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:18:30,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:18:30,946::task::1168::TaskManager.Task::(prepare) Task=`200d3df6-23df-41c5-9b2f-7cb63113c209`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:18:30,946::task::579::TaskManager.Task::(_updateState) Task=`200d3df6-23df-41c5-9b2f-7cb63113c209`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:18:30,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:18:30,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:18:30,947::task::974::TaskManager.Task::(_decref) Task=`200d3df6-23df-41c5-9b2f-7cb63113c209`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:31,865::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:18:31,865::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:18:31,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:32,501::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:32,502::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:32,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:18:32,867::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:18:33,134::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:18:33,151::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000441108 s, 9.3 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:18:33,725::task::579::TaskManager.Task::(_updateState) Task=`55fdc77a-8d51-4584-ab18-bb9701dfc882`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:18:33,725::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:18:33,726::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:18:33,726::task::1168::TaskManager.Task::(prepare) Task=`55fdc77a-8d51-4584-ab18-bb9701dfc882`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:18:33,726::task::579::TaskManager.Task::(_updateState) Task=`55fdc77a-8d51-4584-ab18-bb9701dfc882`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:18:33,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:18:33,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:18:33,726::task::974::TaskManager.Task::(_decref) Task=`55fdc77a-8d51-4584-ab18-bb9701dfc882`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:33,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:18:33,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:18:33,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:18:33,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:18:34,450::task::579::TaskManager.Task::(_updateState) Task=`7554350d-2a4a-4937-ad5c-0971823abc7e`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:18:34,450::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:18:34,451::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:18:34,451::task::1168::TaskManager.Task::(prepare) Task=`7554350d-2a4a-4937-ad5c-0971823abc7e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:18:34,451::task::579::TaskManager.Task::(_updateState) Task=`7554350d-2a4a-4937-ad5c-0971823abc7e`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:18:34,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:18:34,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:18:34,451::task::974::TaskManager.Task::(_decref) Task=`7554350d-2a4a-4937-ad5c-0971823abc7e`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:18:34,494::task::579::TaskManager.Task::(_updateState) Task=`4d761f87-ccd4-4c76-9e51-6a530bb2a204`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:18:34,494::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:18:34,495::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:18:34,495::task::1168::TaskManager.Task::(prepare) Task=`4d761f87-ccd4-4c76-9e51-6a530bb2a204`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:18:34,495::task::579::TaskManager.Task::(_updateState) Task=`4d761f87-ccd4-4c76-9e51-6a530bb2a204`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:18:34,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:18:34,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:18:34,495::task::974::TaskManager.Task::(_decref) Task=`4d761f87-ccd4-4c76-9e51-6a530bb2a204`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:34,504::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-69607::DEBUG::2014-01-16 16:18:34,505::task::579::TaskManager.Task::(_updateState) Task=`a33d5d73-2781-4441-90d3-d08fc0842809`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:18:34,505::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:18:34,505::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:18:34,505::task::1168::TaskManager.Task::(prepare) Task=`a33d5d73-2781-4441-90d3-d08fc0842809`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:18:34,506::task::579::TaskManager.Task::(_updateState) Task=`a33d5d73-2781-4441-90d3-d08fc0842809`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:18:34,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:18:34,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:18:34,506::task::974::TaskManager.Task::(_decref) Task=`a33d5d73-2781-4441-90d3-d08fc0842809`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:34,870::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:18:35,365::task::579::TaskManager.Task::(_updateState) Task=`c40c13e4-0c56-4c4e-bbc5-47bbb57a9aea`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:18:35,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:18:35,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:18:35,366::task::1168::TaskManager.Task::(prepare) Task=`c40c13e4-0c56-4c4e-bbc5-47bbb57a9aea`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:18:35,366::task::579::TaskManager.Task::(_updateState) Task=`c40c13e4-0c56-4c4e-bbc5-47bbb57a9aea`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:18:35,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:18:35,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:18:35,366::task::974::TaskManager.Task::(_decref) Task=`c40c13e4-0c56-4c4e-bbc5-47bbb57a9aea`::ref 0 aborting False >Thread-286413::DEBUG::2014-01-16 16:18:35,562::task::579::TaskManager.Task::(_updateState) Task=`72ded3a6-3d42-4225-93b4-bec6b3350791`::moving from state init -> state preparing >Thread-286413::INFO::2014-01-16 16:18:35,563::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286413::INFO::2014-01-16 16:18:35,563::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00156396', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441108', 'lastCheck': '2.4', 'valid': True}} >Thread-286413::DEBUG::2014-01-16 16:18:35,563::task::1168::TaskManager.Task::(prepare) Task=`72ded3a6-3d42-4225-93b4-bec6b3350791`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00156396', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441108', 'lastCheck': '2.4', 'valid': True}} >Thread-286413::DEBUG::2014-01-16 16:18:35,563::task::579::TaskManager.Task::(_updateState) Task=`72ded3a6-3d42-4225-93b4-bec6b3350791`::moving from state preparing -> state finished >Thread-286413::DEBUG::2014-01-16 16:18:35,563::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286413::DEBUG::2014-01-16 16:18:35,563::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286413::DEBUG::2014-01-16 16:18:35,564::task::974::TaskManager.Task::(_decref) Task=`72ded3a6-3d42-4225-93b4-bec6b3350791`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:18:35,744::task::579::TaskManager.Task::(_updateState) Task=`f7e4e2cd-ec9d-4801-ba0e-41510b3c4189`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:18:35,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:18:35,745::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:18:35,745::task::1168::TaskManager.Task::(prepare) Task=`f7e4e2cd-ec9d-4801-ba0e-41510b3c4189`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:18:35,745::task::579::TaskManager.Task::(_updateState) Task=`f7e4e2cd-ec9d-4801-ba0e-41510b3c4189`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:18:35,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:18:35,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:18:35,746::task::974::TaskManager.Task::(_decref) Task=`f7e4e2cd-ec9d-4801-ba0e-41510b3c4189`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:35,871::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:18:35,871::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:18:35,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:18:35,872::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:35,872::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:18:35,873::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20::DEBUG::2014-01-16 16:18:35,944::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:18:35,960::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029888 s, 1.2 MB/s\n'; <rc> = 0 >Thread-84377::DEBUG::2014-01-16 16:18:36,443::task::579::TaskManager.Task::(_updateState) Task=`577d9fbc-17f4-4396-9d02-d973ceaffd1e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:18:36,444::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:18:36,444::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:18:36,444::task::1168::TaskManager.Task::(prepare) Task=`577d9fbc-17f4-4396-9d02-d973ceaffd1e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:18:36,444::task::579::TaskManager.Task::(_updateState) Task=`577d9fbc-17f4-4396-9d02-d973ceaffd1e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:18:36,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:18:36,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:18:36,445::task::974::TaskManager.Task::(_decref) Task=`577d9fbc-17f4-4396-9d02-d973ceaffd1e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:18:36,445::task::579::TaskManager.Task::(_updateState) Task=`4e7aeca6-dc38-424b-8633-f6064f92138a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:18:36,445::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:18:36,446::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:18:36,446::task::1168::TaskManager.Task::(prepare) Task=`4e7aeca6-dc38-424b-8633-f6064f92138a`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:18:36,446::task::579::TaskManager.Task::(_updateState) Task=`4e7aeca6-dc38-424b-8633-f6064f92138a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:18:36,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:18:36,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:18:36,446::task::974::TaskManager.Task::(_decref) Task=`4e7aeca6-dc38-424b-8633-f6064f92138a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:18:36,447::task::579::TaskManager.Task::(_updateState) Task=`27d51b14-5786-48ad-b4bb-e19c61947751`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:18:36,447::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:18:36,447::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:18:36,447::task::1168::TaskManager.Task::(prepare) Task=`27d51b14-5786-48ad-b4bb-e19c61947751`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:18:36,447::task::579::TaskManager.Task::(_updateState) Task=`27d51b14-5786-48ad-b4bb-e19c61947751`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:18:36,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:18:36,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:18:36,448::task::974::TaskManager.Task::(_decref) Task=`27d51b14-5786-48ad-b4bb-e19c61947751`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:36,506::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:36,874::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:37,507::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:37,876::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:18:37,876::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:18:37,876::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:38,509::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:38,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:18:38,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:18:38,878::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:39,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:18:39,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:18:39,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:18:39,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:40,511::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:40,880::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:41,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:18:41,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:42,512::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:42,514::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:18:42,514::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:18:42,516::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:42,883::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:18:43,157::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:18:43,173::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258601 s, 15.8 MB/s\n'; <rc> = 0 >Thread-16244::DEBUG::2014-01-16 16:18:43,386::task::579::TaskManager.Task::(_updateState) Task=`b5b5ba75-6a30-4995-85bd-fcf13e24da0a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:18:43,387::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:18:43,387::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:18:43,387::task::1168::TaskManager.Task::(prepare) Task=`b5b5ba75-6a30-4995-85bd-fcf13e24da0a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:18:43,387::task::579::TaskManager.Task::(_updateState) Task=`b5b5ba75-6a30-4995-85bd-fcf13e24da0a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:18:43,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:18:43,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:18:43,388::task::974::TaskManager.Task::(_decref) Task=`b5b5ba75-6a30-4995-85bd-fcf13e24da0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:43,884::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:44,518::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:44,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:45,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:18:45,968::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:18:45,986::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000278971 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:18:46,520::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:46,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:47,521::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:18:47,534::task::579::TaskManager.Task::(_updateState) Task=`414c7af4-9515-4040-b554-5fff5146834e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:18:47,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:18:47,535::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:18:47,535::task::1168::TaskManager.Task::(prepare) Task=`414c7af4-9515-4040-b554-5fff5146834e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:18:47,535::task::579::TaskManager.Task::(_updateState) Task=`414c7af4-9515-4040-b554-5fff5146834e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:18:47,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:18:47,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:18:47,536::task::974::TaskManager.Task::(_decref) Task=`414c7af4-9515-4040-b554-5fff5146834e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:47,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:18:47,890::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:48,523::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:48,890::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:49,892::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:50,524::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:50,893::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:18:51,095::task::579::TaskManager.Task::(_updateState) Task=`48ed037c-0b7a-4fed-9de7-6be53ec9eb23`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:18:51,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:18:51,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:18:51,096::task::1168::TaskManager.Task::(prepare) Task=`48ed037c-0b7a-4fed-9de7-6be53ec9eb23`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:18:51,096::task::579::TaskManager.Task::(_updateState) Task=`48ed037c-0b7a-4fed-9de7-6be53ec9eb23`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:18:51,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:18:51,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:18:51,096::task::974::TaskManager.Task::(_decref) Task=`48ed037c-0b7a-4fed-9de7-6be53ec9eb23`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:18:51,097::task::579::TaskManager.Task::(_updateState) Task=`1df9e1ca-e34b-4588-a4ab-270adf004ae9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:18:51,097::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:18:51,097::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:18:51,097::task::1168::TaskManager.Task::(prepare) Task=`1df9e1ca-e34b-4588-a4ab-270adf004ae9`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:18:51,097::task::579::TaskManager.Task::(_updateState) Task=`1df9e1ca-e34b-4588-a4ab-270adf004ae9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:18:51,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:18:51,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:18:51,098::task::974::TaskManager.Task::(_decref) Task=`1df9e1ca-e34b-4588-a4ab-270adf004ae9`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:18:51,098::task::579::TaskManager.Task::(_updateState) Task=`134ed829-1254-45c0-a096-20a2f74c1be5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:18:51,098::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:18:51,098::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:18:51,099::task::1168::TaskManager.Task::(prepare) Task=`134ed829-1254-45c0-a096-20a2f74c1be5`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:18:51,099::task::579::TaskManager.Task::(_updateState) Task=`134ed829-1254-45c0-a096-20a2f74c1be5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:18:51,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:18:51,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:18:51,099::task::974::TaskManager.Task::(_decref) Task=`134ed829-1254-45c0-a096-20a2f74c1be5`::ref 0 aborting False >Thread-286419::DEBUG::2014-01-16 16:18:51,377::task::579::TaskManager.Task::(_updateState) Task=`3827c01b-94c3-49e9-9038-6e51ce6113c0`::moving from state init -> state preparing >Thread-286419::INFO::2014-01-16 16:18:51,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286419::INFO::2014-01-16 16:18:51,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000278971', 'lastCheck': '5.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258601', 'lastCheck': '8.2', 'valid': True}} >Thread-286419::DEBUG::2014-01-16 16:18:51,378::task::1168::TaskManager.Task::(prepare) Task=`3827c01b-94c3-49e9-9038-6e51ce6113c0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000278971', 'lastCheck': '5.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258601', 'lastCheck': '8.2', 'valid': True}} >Thread-286419::DEBUG::2014-01-16 16:18:51,378::task::579::TaskManager.Task::(_updateState) Task=`3827c01b-94c3-49e9-9038-6e51ce6113c0`::moving from state preparing -> state finished >Thread-286419::DEBUG::2014-01-16 16:18:51,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286419::DEBUG::2014-01-16 16:18:51,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286419::DEBUG::2014-01-16 16:18:51,378::task::974::TaskManager.Task::(_decref) Task=`3827c01b-94c3-49e9-9038-6e51ce6113c0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:51,894::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:52,526::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:18:52,527::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:52,895::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:18:52,895::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:18:52,895::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:18:53,179::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:18:53,195::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000225361 s, 18.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:18:53,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:18:53,896::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:18:54,401::task::579::TaskManager.Task::(_updateState) Task=`5d870a21-bfa2-4422-bbd6-023aa258e5d2`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:18:54,401::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:18:54,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:18:54,402::task::1168::TaskManager.Task::(prepare) Task=`5d870a21-bfa2-4422-bbd6-023aa258e5d2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:18:54,402::task::579::TaskManager.Task::(_updateState) Task=`5d870a21-bfa2-4422-bbd6-023aa258e5d2`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:18:54,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:18:54,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:18:54,402::task::974::TaskManager.Task::(_decref) Task=`5d870a21-bfa2-4422-bbd6-023aa258e5d2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:18:54,528::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:54,897::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:18:54,898::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:18:54,898::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:55,899::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:18:55,900::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:18:55,993::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:18:56,009::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257938 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:18:56,531::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:56,901::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:18:56,901::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:57,533::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:18:57,533::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:18:57,534::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:18:57,902::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:18:58,536::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:18:58,563::task::579::TaskManager.Task::(_updateState) Task=`d70a8c61-d723-4fd8-b999-9091c4657d95`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:18:58,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:18:58,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:18:58,564::task::1168::TaskManager.Task::(prepare) Task=`d70a8c61-d723-4fd8-b999-9091c4657d95`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:18:58,564::task::579::TaskManager.Task::(_updateState) Task=`d70a8c61-d723-4fd8-b999-9091c4657d95`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:18:58,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:18:58,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:18:58,564::task::974::TaskManager.Task::(_decref) Task=`d70a8c61-d723-4fd8-b999-9091c4657d95`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:18:58,565::task::579::TaskManager.Task::(_updateState) Task=`695f79ae-5256-4588-b166-332421064443`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:18:58,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:18:58,565::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:18:58,566::task::1168::TaskManager.Task::(prepare) Task=`695f79ae-5256-4588-b166-332421064443`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:18:58,566::task::579::TaskManager.Task::(_updateState) Task=`695f79ae-5256-4588-b166-332421064443`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:18:58,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:18:58,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:18:58,566::task::974::TaskManager.Task::(_decref) Task=`695f79ae-5256-4588-b166-332421064443`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:18:58,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:18:58,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:18:59,904::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:18:59,905::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:00,537::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:00,906::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:19:00,906::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:19:00,906::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:19:00,907::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:19:01,536::task::579::TaskManager.Task::(_updateState) Task=`8cc344f3-f03a-44f5-ac30-83841ed39079`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:19:01,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:19:01,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:19:01,537::task::1168::TaskManager.Task::(prepare) Task=`8cc344f3-f03a-44f5-ac30-83841ed39079`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:19:01,537::task::579::TaskManager.Task::(_updateState) Task=`8cc344f3-f03a-44f5-ac30-83841ed39079`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:19:01,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:19:01,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:19:01,537::task::974::TaskManager.Task::(_decref) Task=`8cc344f3-f03a-44f5-ac30-83841ed39079`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:01,908::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:19:01,908::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:19:01,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:02,539::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:02,540::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:02,909::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:19:02,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:19:03,201::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:19:03,217::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000265332 s, 15.4 MB/s\n'; <rc> = 0 >Thread-251782::DEBUG::2014-01-16 16:19:03,802::task::579::TaskManager.Task::(_updateState) Task=`b6e19c70-1bb8-46f9-80fe-2ac6bafafa32`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 16:19:03,803::task::579::TaskManager.Task::(_updateState) Task=`6be02372-efb3-4059-8e2c-d6339547cc3b`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:19:03,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:19:03,804::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:19:03,805::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 16:19:03,805::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:19:03,805::task::1168::TaskManager.Task::(prepare) Task=`b6e19c70-1bb8-46f9-80fe-2ac6bafafa32`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:19:03,806::task::1168::TaskManager.Task::(prepare) Task=`6be02372-efb3-4059-8e2c-d6339547cc3b`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:19:03,806::task::579::TaskManager.Task::(_updateState) Task=`b6e19c70-1bb8-46f9-80fe-2ac6bafafa32`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:19:03,806::task::579::TaskManager.Task::(_updateState) Task=`6be02372-efb3-4059-8e2c-d6339547cc3b`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:19:03,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:19:03,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:19:03,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:19:03,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:19:03,808::task::974::TaskManager.Task::(_decref) Task=`b6e19c70-1bb8-46f9-80fe-2ac6bafafa32`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:19:03,808::task::974::TaskManager.Task::(_decref) Task=`6be02372-efb3-4059-8e2c-d6339547cc3b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:03,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:19:03,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:19:03,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:19:03,911::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:04,542::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:19:04,765::task::579::TaskManager.Task::(_updateState) Task=`0400f42c-a185-4ad3-984a-c946bec20cca`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:19:04,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:19:04,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:19:04,767::task::1168::TaskManager.Task::(prepare) Task=`0400f42c-a185-4ad3-984a-c946bec20cca`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:19:04,767::task::579::TaskManager.Task::(_updateState) Task=`0400f42c-a185-4ad3-984a-c946bec20cca`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:19:04,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:19:04,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:19:04,768::task::974::TaskManager.Task::(_decref) Task=`0400f42c-a185-4ad3-984a-c946bec20cca`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:19:04,768::task::579::TaskManager.Task::(_updateState) Task=`9169c12d-72f7-400f-9b14-40e0ef9eaa16`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:19:04,768::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:19:04,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:19:04,769::task::1168::TaskManager.Task::(prepare) Task=`9169c12d-72f7-400f-9b14-40e0ef9eaa16`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:19:04,769::task::579::TaskManager.Task::(_updateState) Task=`9169c12d-72f7-400f-9b14-40e0ef9eaa16`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:19:04,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:19:04,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:19:04,770::task::974::TaskManager.Task::(_decref) Task=`9169c12d-72f7-400f-9b14-40e0ef9eaa16`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:04,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:19:05,058::task::579::TaskManager.Task::(_updateState) Task=`9c24b113-c383-4479-8f13-740504304fab`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:19:05,059::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:19:05,059::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:19:05,059::task::1168::TaskManager.Task::(prepare) Task=`9c24b113-c383-4479-8f13-740504304fab`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:19:05,059::task::579::TaskManager.Task::(_updateState) Task=`9c24b113-c383-4479-8f13-740504304fab`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:19:05,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:19:05,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:19:05,059::task::974::TaskManager.Task::(_decref) Task=`9c24b113-c383-4479-8f13-740504304fab`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:19:05,060::task::579::TaskManager.Task::(_updateState) Task=`ba0cde82-c829-4cb3-8524-afd9897ff1ba`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:19:05,060::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:19:05,060::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:19:05,060::task::1168::TaskManager.Task::(prepare) Task=`ba0cde82-c829-4cb3-8524-afd9897ff1ba`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:19:05,060::task::579::TaskManager.Task::(_updateState) Task=`ba0cde82-c829-4cb3-8524-afd9897ff1ba`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:19:05,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:19:05,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:19:05,061::task::974::TaskManager.Task::(_decref) Task=`ba0cde82-c829-4cb3-8524-afd9897ff1ba`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:19:05,856::task::579::TaskManager.Task::(_updateState) Task=`3bb071ca-9724-495b-9d52-c43df3aae5ac`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:19:05,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:19:05,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:19:05,857::task::1168::TaskManager.Task::(prepare) Task=`3bb071ca-9724-495b-9d52-c43df3aae5ac`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:19:05,857::task::579::TaskManager.Task::(_updateState) Task=`3bb071ca-9724-495b-9d52-c43df3aae5ac`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:19:05,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:19:05,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:19:05,858::task::974::TaskManager.Task::(_decref) Task=`3bb071ca-9724-495b-9d52-c43df3aae5ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:05,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:19:05,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:19:05,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:19:05,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:05,914::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:19:05,914::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20::DEBUG::2014-01-16 16:19:06,018::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:19:06,035::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000252824 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:19:06,038::task::579::TaskManager.Task::(_updateState) Task=`c9864191-fdde-4dbe-8854-5b07bcf9dd7c`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:19:06,043::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:19:06,045::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:19:06,046::task::1168::TaskManager.Task::(prepare) Task=`c9864191-fdde-4dbe-8854-5b07bcf9dd7c`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:19:06,046::task::579::TaskManager.Task::(_updateState) Task=`c9864191-fdde-4dbe-8854-5b07bcf9dd7c`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:19:06,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:19:06,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:19:06,046::task::974::TaskManager.Task::(_decref) Task=`c9864191-fdde-4dbe-8854-5b07bcf9dd7c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:06,543::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:06,915::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:19:06,988::task::579::TaskManager.Task::(_updateState) Task=`e7f12d18-dc63-4abc-80b0-78b5c839d6a1`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:19:06,988::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:19:06,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:19:06,989::task::1168::TaskManager.Task::(prepare) Task=`e7f12d18-dc63-4abc-80b0-78b5c839d6a1`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:19:06,989::task::579::TaskManager.Task::(_updateState) Task=`e7f12d18-dc63-4abc-80b0-78b5c839d6a1`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:19:06,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:19:06,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:19:06,989::task::974::TaskManager.Task::(_decref) Task=`e7f12d18-dc63-4abc-80b0-78b5c839d6a1`::ref 0 aborting False >Thread-286425::DEBUG::2014-01-16 16:19:07,163::task::579::TaskManager.Task::(_updateState) Task=`65a42dd6-f928-4b51-a093-6fe922d1213c`::moving from state init -> state preparing >Thread-286425::INFO::2014-01-16 16:19:07,163::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286425::INFO::2014-01-16 16:19:07,164::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252824', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265332', 'lastCheck': '3.9', 'valid': True}} >Thread-286425::DEBUG::2014-01-16 16:19:07,164::task::1168::TaskManager.Task::(prepare) Task=`65a42dd6-f928-4b51-a093-6fe922d1213c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252824', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265332', 'lastCheck': '3.9', 'valid': True}} >Thread-286425::DEBUG::2014-01-16 16:19:07,164::task::579::TaskManager.Task::(_updateState) Task=`65a42dd6-f928-4b51-a093-6fe922d1213c`::moving from state preparing -> state finished >Thread-286425::DEBUG::2014-01-16 16:19:07,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286425::DEBUG::2014-01-16 16:19:07,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286425::DEBUG::2014-01-16 16:19:07,164::task::974::TaskManager.Task::(_decref) Task=`65a42dd6-f928-4b51-a093-6fe922d1213c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:07,545::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:07,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:19:07,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:19:07,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:19:08,044::task::579::TaskManager.Task::(_updateState) Task=`c390f5fb-60ba-4c88-b7d0-df02626a8c7f`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:19:08,044::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:19:08,045::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:19:08,045::task::1168::TaskManager.Task::(prepare) Task=`c390f5fb-60ba-4c88-b7d0-df02626a8c7f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:19:08,045::task::579::TaskManager.Task::(_updateState) Task=`c390f5fb-60ba-4c88-b7d0-df02626a8c7f`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:19:08,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:19:08,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:19:08,045::task::974::TaskManager.Task::(_decref) Task=`c390f5fb-60ba-4c88-b7d0-df02626a8c7f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:08,546::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:08,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:19:08,918::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:19:08,918::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:09,919::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:19:09,919::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:19:09,919::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:19:09,919::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:10,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:10,920::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:19:11,053::task::579::TaskManager.Task::(_updateState) Task=`d66237f0-5337-42c1-8e0e-12b4212aab6a`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:19:11,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:19:11,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:19:11,054::task::1168::TaskManager.Task::(prepare) Task=`d66237f0-5337-42c1-8e0e-12b4212aab6a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:19:11,054::task::579::TaskManager.Task::(_updateState) Task=`d66237f0-5337-42c1-8e0e-12b4212aab6a`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:19:11,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:19:11,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:19:11,054::task::974::TaskManager.Task::(_decref) Task=`d66237f0-5337-42c1-8e0e-12b4212aab6a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:11,921::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:19:11,921::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:12,549::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:12,549::task::579::TaskManager.Task::(_updateState) Task=`ea380b47-37dd-4616-a0f6-c0b5d273399c`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:19:12,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:19:12,550::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:19:12,550::task::1168::TaskManager.Task::(prepare) Task=`ea380b47-37dd-4616-a0f6-c0b5d273399c`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:19:12,550::task::579::TaskManager.Task::(_updateState) Task=`ea380b47-37dd-4616-a0f6-c0b5d273399c`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:19:12,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:19:12,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:19:12,551::task::974::TaskManager.Task::(_decref) Task=`ea380b47-37dd-4616-a0f6-c0b5d273399c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:12,552::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:19:12,553::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:19:12,554::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:12,555::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:12,556::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:12,922::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:19:13,222::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:19:13,238::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000224101 s, 18.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:19:13,923::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:19:14,465::task::579::TaskManager.Task::(_updateState) Task=`7f2bac45-4e24-41d8-9dc1-67ef6c8cb29d`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:19:14,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:19:14,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:19:14,466::task::1168::TaskManager.Task::(prepare) Task=`7f2bac45-4e24-41d8-9dc1-67ef6c8cb29d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:19:14,466::task::579::TaskManager.Task::(_updateState) Task=`7f2bac45-4e24-41d8-9dc1-67ef6c8cb29d`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:19:14,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:19:14,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:19:14,467::task::974::TaskManager.Task::(_decref) Task=`7f2bac45-4e24-41d8-9dc1-67ef6c8cb29d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:14,558::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:14,925::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:19:15,123::task::579::TaskManager.Task::(_updateState) Task=`daebc26d-8e2a-4a46-907c-47713ede57b4`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:19:15,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:19:15,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:19:15,124::task::1168::TaskManager.Task::(prepare) Task=`daebc26d-8e2a-4a46-907c-47713ede57b4`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:19:15,124::task::579::TaskManager.Task::(_updateState) Task=`daebc26d-8e2a-4a46-907c-47713ede57b4`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:19:15,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:19:15,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:19:15,124::task::974::TaskManager.Task::(_decref) Task=`daebc26d-8e2a-4a46-907c-47713ede57b4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:15,925::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:19:16,051::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:19:16,067::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000296953 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:19:16,559::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:16,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:17,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:17,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:19:17,928::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:19:18,226::task::579::TaskManager.Task::(_updateState) Task=`bcbc7efa-89bf-4421-b1b1-7cd531565e80`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:19:18,227::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:19:18,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:19:18,227::task::1168::TaskManager.Task::(prepare) Task=`bcbc7efa-89bf-4421-b1b1-7cd531565e80`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:19:18,227::task::579::TaskManager.Task::(_updateState) Task=`bcbc7efa-89bf-4421-b1b1-7cd531565e80`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:19:18,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:19:18,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:19:18,228::task::974::TaskManager.Task::(_decref) Task=`bcbc7efa-89bf-4421-b1b1-7cd531565e80`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:19:18,228::task::579::TaskManager.Task::(_updateState) Task=`db6f92b9-f0f1-4d74-843a-da4ad0f1d9e0`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:19:18,228::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:19:18,229::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:19:18,229::task::1168::TaskManager.Task::(prepare) Task=`db6f92b9-f0f1-4d74-843a-da4ad0f1d9e0`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:19:18,229::task::579::TaskManager.Task::(_updateState) Task=`db6f92b9-f0f1-4d74-843a-da4ad0f1d9e0`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:19:18,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:19:18,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:19:18,229::task::974::TaskManager.Task::(_decref) Task=`db6f92b9-f0f1-4d74-843a-da4ad0f1d9e0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:18,562::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:18,930::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:19,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:20,563::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:20,932::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:21,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:22,564::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:22,565::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:19:22,623::task::579::TaskManager.Task::(_updateState) Task=`ce1760d4-195f-4d01-9d94-ad4ebd475992`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:19:22,623::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:19:22,624::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:19:22,624::task::1168::TaskManager.Task::(prepare) Task=`ce1760d4-195f-4d01-9d94-ad4ebd475992`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:19:22,624::task::579::TaskManager.Task::(_updateState) Task=`ce1760d4-195f-4d01-9d94-ad4ebd475992`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:19:22,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:19:22,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:19:22,625::task::974::TaskManager.Task::(_decref) Task=`ce1760d4-195f-4d01-9d94-ad4ebd475992`::ref 0 aborting False >Thread-286431::DEBUG::2014-01-16 16:19:22,912::task::579::TaskManager.Task::(_updateState) Task=`a8eaf51a-c195-47b3-90e8-35eaf2c87e03`::moving from state init -> state preparing >Thread-286431::INFO::2014-01-16 16:19:22,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286431::INFO::2014-01-16 16:19:22,912::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000296953', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224101', 'lastCheck': '9.7', 'valid': True}} >Thread-286431::DEBUG::2014-01-16 16:19:22,912::task::1168::TaskManager.Task::(prepare) Task=`a8eaf51a-c195-47b3-90e8-35eaf2c87e03`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000296953', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224101', 'lastCheck': '9.7', 'valid': True}} >Thread-286431::DEBUG::2014-01-16 16:19:22,912::task::579::TaskManager.Task::(_updateState) Task=`a8eaf51a-c195-47b3-90e8-35eaf2c87e03`::moving from state preparing -> state finished >Thread-286431::DEBUG::2014-01-16 16:19:22,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286431::DEBUG::2014-01-16 16:19:22,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286431::DEBUG::2014-01-16 16:19:22,913::task::974::TaskManager.Task::(_decref) Task=`a8eaf51a-c195-47b3-90e8-35eaf2c87e03`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:22,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:19:22,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:19:22,935::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:19:23,244::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:19:23,260::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000245905 s, 16.7 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 16:19:23,648::task::579::TaskManager.Task::(_updateState) Task=`2ea73fdc-b2e6-454c-a44b-75beb95df795`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:19:23,648::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:19:23,649::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:19:23,649::task::1168::TaskManager.Task::(prepare) Task=`2ea73fdc-b2e6-454c-a44b-75beb95df795`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:19:23,649::task::579::TaskManager.Task::(_updateState) Task=`2ea73fdc-b2e6-454c-a44b-75beb95df795`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:19:23,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:19:23,649::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:19:23,650::task::974::TaskManager.Task::(_decref) Task=`2ea73fdc-b2e6-454c-a44b-75beb95df795`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:23,936::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:19:23,936::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:24,567::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:24,937::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:19:24,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:19:24,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:25,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:19:25,939::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:19:26,077::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:19:26,096::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000307231 s, 1.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:19:26,136::task::579::TaskManager.Task::(_updateState) Task=`9316604d-42ba-43bb-a280-20b09a743b4e`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:19:26,137::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:19:26,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:19:26,138::task::1168::TaskManager.Task::(prepare) Task=`9316604d-42ba-43bb-a280-20b09a743b4e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:19:26,138::task::579::TaskManager.Task::(_updateState) Task=`9316604d-42ba-43bb-a280-20b09a743b4e`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:19:26,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:19:26,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:19:26,138::task::974::TaskManager.Task::(_decref) Task=`9316604d-42ba-43bb-a280-20b09a743b4e`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:19:26,185::task::579::TaskManager.Task::(_updateState) Task=`bbd64521-2936-44de-8954-6a2fc53eb7df`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:19:26,185::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:19:26,185::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:19:26,185::task::1168::TaskManager.Task::(prepare) Task=`bbd64521-2936-44de-8954-6a2fc53eb7df`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:19:26,186::task::579::TaskManager.Task::(_updateState) Task=`bbd64521-2936-44de-8954-6a2fc53eb7df`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:19:26,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:19:26,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:19:26,186::task::974::TaskManager.Task::(_decref) Task=`bbd64521-2936-44de-8954-6a2fc53eb7df`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:26,569::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:26,940::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:19:26,940::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:27,571::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:19:27,571::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:19:27,574::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:27,941::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:28,576::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:28,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:19:28,942::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:29,944::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:19:29,944::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:30,577::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:30,945::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:19:30,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:19:30,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:19:30,946::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:19:31,138::task::579::TaskManager.Task::(_updateState) Task=`ef785d4e-335d-4743-ba1b-4fbd5fe06a35`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:19:31,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:19:31,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:19:31,139::task::1168::TaskManager.Task::(prepare) Task=`ef785d4e-335d-4743-ba1b-4fbd5fe06a35`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:19:31,139::task::579::TaskManager.Task::(_updateState) Task=`ef785d4e-335d-4743-ba1b-4fbd5fe06a35`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:19:31,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:19:31,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:19:31,139::task::974::TaskManager.Task::(_decref) Task=`ef785d4e-335d-4743-ba1b-4fbd5fe06a35`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:31,947::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:19:31,947::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:19:31,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:32,578::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:32,579::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:32,949::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:19:32,949::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:19:33,265::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:19:33,282::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000195872 s, 20.9 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:19:33,890::task::579::TaskManager.Task::(_updateState) Task=`90bddeb9-b71f-4614-889c-aeb7b682ff9c`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:19:33,891::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:19:33,891::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:19:33,891::task::1168::TaskManager.Task::(prepare) Task=`90bddeb9-b71f-4614-889c-aeb7b682ff9c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:19:33,891::task::579::TaskManager.Task::(_updateState) Task=`90bddeb9-b71f-4614-889c-aeb7b682ff9c`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:19:33,891::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:19:33,891::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:19:33,892::task::974::TaskManager.Task::(_decref) Task=`90bddeb9-b71f-4614-889c-aeb7b682ff9c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:33,950::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:19:33,951::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:19:33,951::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:19:33,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:34,580::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:19:34,616::task::579::TaskManager.Task::(_updateState) Task=`b45a9ae1-2b6a-4c0b-ab4c-934b0e4c238b`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:19:34,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:19:34,617::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:19:34,617::task::1168::TaskManager.Task::(prepare) Task=`b45a9ae1-2b6a-4c0b-ab4c-934b0e4c238b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:19:34,617::task::579::TaskManager.Task::(_updateState) Task=`b45a9ae1-2b6a-4c0b-ab4c-934b0e4c238b`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:19:34,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:19:34,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:19:34,617::task::974::TaskManager.Task::(_decref) Task=`b45a9ae1-2b6a-4c0b-ab4c-934b0e4c238b`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:19:34,668::task::579::TaskManager.Task::(_updateState) Task=`8dfc3b32-a006-49f5-b067-a5836104ae02`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:19:34,668::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:19:34,669::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:19:34,669::task::1168::TaskManager.Task::(prepare) Task=`8dfc3b32-a006-49f5-b067-a5836104ae02`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:19:34,669::task::579::TaskManager.Task::(_updateState) Task=`8dfc3b32-a006-49f5-b067-a5836104ae02`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:19:34,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:19:34,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:19:34,669::task::974::TaskManager.Task::(_decref) Task=`8dfc3b32-a006-49f5-b067-a5836104ae02`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:19:34,679::task::579::TaskManager.Task::(_updateState) Task=`320e78ea-6531-41d7-a8c4-ee61a501de24`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:19:34,679::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:19:34,680::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:19:34,680::task::1168::TaskManager.Task::(prepare) Task=`320e78ea-6531-41d7-a8c4-ee61a501de24`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:19:34,680::task::579::TaskManager.Task::(_updateState) Task=`320e78ea-6531-41d7-a8c4-ee61a501de24`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:19:34,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:19:34,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:19:34,681::task::974::TaskManager.Task::(_decref) Task=`320e78ea-6531-41d7-a8c4-ee61a501de24`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:34,952::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:19:35,548::task::579::TaskManager.Task::(_updateState) Task=`e3caaf4a-02d1-45ac-a79c-647acc2211cb`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:19:35,548::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:19:35,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:19:35,549::task::1168::TaskManager.Task::(prepare) Task=`e3caaf4a-02d1-45ac-a79c-647acc2211cb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:19:35,549::task::579::TaskManager.Task::(_updateState) Task=`e3caaf4a-02d1-45ac-a79c-647acc2211cb`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:19:35,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:19:35,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:19:35,549::task::974::TaskManager.Task::(_decref) Task=`e3caaf4a-02d1-45ac-a79c-647acc2211cb`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:19:35,909::task::579::TaskManager.Task::(_updateState) Task=`2a836868-706a-4f35-b110-80bc4a536fb5`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:19:35,909::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:19:35,909::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:19:35,909::task::1168::TaskManager.Task::(prepare) Task=`2a836868-706a-4f35-b110-80bc4a536fb5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:19:35,910::task::579::TaskManager.Task::(_updateState) Task=`2a836868-706a-4f35-b110-80bc4a536fb5`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:19:35,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:19:35,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:19:35,910::task::974::TaskManager.Task::(_decref) Task=`2a836868-706a-4f35-b110-80bc4a536fb5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:35,953::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:19:35,954::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:19:35,954::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:19:35,954::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:35,954::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:19:35,955::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20::DEBUG::2014-01-16 16:19:36,103::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:19:36,120::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029647 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:19:36,582::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:19:36,738::task::579::TaskManager.Task::(_updateState) Task=`e17d476d-085b-47d5-8d14-614645021899`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:19:36,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:19:36,738::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:19:36,738::task::1168::TaskManager.Task::(prepare) Task=`e17d476d-085b-47d5-8d14-614645021899`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:19:36,738::task::579::TaskManager.Task::(_updateState) Task=`e17d476d-085b-47d5-8d14-614645021899`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:19:36,739::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:19:36,739::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:19:36,739::task::974::TaskManager.Task::(_decref) Task=`e17d476d-085b-47d5-8d14-614645021899`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:19:36,739::task::579::TaskManager.Task::(_updateState) Task=`6919c2e1-7079-445c-8f4c-cf08b716d5d2`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:19:36,739::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:19:36,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:19:36,740::task::1168::TaskManager.Task::(prepare) Task=`6919c2e1-7079-445c-8f4c-cf08b716d5d2`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:19:36,740::task::579::TaskManager.Task::(_updateState) Task=`6919c2e1-7079-445c-8f4c-cf08b716d5d2`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:19:36,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:19:36,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:19:36,740::task::974::TaskManager.Task::(_decref) Task=`6919c2e1-7079-445c-8f4c-cf08b716d5d2`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:19:36,741::task::579::TaskManager.Task::(_updateState) Task=`607ab4e9-32c5-4447-a933-19fa058d1f52`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:19:36,741::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:19:36,741::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:19:36,741::task::1168::TaskManager.Task::(prepare) Task=`607ab4e9-32c5-4447-a933-19fa058d1f52`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:19:36,741::task::579::TaskManager.Task::(_updateState) Task=`607ab4e9-32c5-4447-a933-19fa058d1f52`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:19:36,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:19:36,742::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:19:36,742::task::974::TaskManager.Task::(_decref) Task=`607ab4e9-32c5-4447-a933-19fa058d1f52`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:36,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:37,583::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:37,957::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:19:37,957::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:19:37,957::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:38,585::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286437::DEBUG::2014-01-16 16:19:38,626::task::579::TaskManager.Task::(_updateState) Task=`4cb103f5-828a-41c2-9002-c9a09113b7a8`::moving from state init -> state preparing >Thread-286437::INFO::2014-01-16 16:19:38,627::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286437::INFO::2014-01-16 16:19:38,627::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029647', 'lastCheck': '2.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000195872', 'lastCheck': '5.3', 'valid': True}} >Thread-286437::DEBUG::2014-01-16 16:19:38,627::task::1168::TaskManager.Task::(prepare) Task=`4cb103f5-828a-41c2-9002-c9a09113b7a8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029647', 'lastCheck': '2.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000195872', 'lastCheck': '5.3', 'valid': True}} >Thread-286437::DEBUG::2014-01-16 16:19:38,627::task::579::TaskManager.Task::(_updateState) Task=`4cb103f5-828a-41c2-9002-c9a09113b7a8`::moving from state preparing -> state finished >Thread-286437::DEBUG::2014-01-16 16:19:38,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286437::DEBUG::2014-01-16 16:19:38,627::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286437::DEBUG::2014-01-16 16:19:38,628::task::974::TaskManager.Task::(_decref) Task=`4cb103f5-828a-41c2-9002-c9a09113b7a8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:38,957::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:19:38,958::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:19:38,958::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:39,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:19:39,960::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:19:39,960::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:19:39,960::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:40,586::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:40,961::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:41,962::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:19:41,962::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:42,587::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:42,589::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:19:42,590::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:19:42,591::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:42,963::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:19:43,289::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:19:43,306::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000217533 s, 18.8 MB/s\n'; <rc> = 0 >Thread-16244::DEBUG::2014-01-16 16:19:43,564::task::579::TaskManager.Task::(_updateState) Task=`0bdc2beb-8afe-417d-a5f6-3fb531285567`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:19:43,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:19:43,565::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:19:43,565::task::1168::TaskManager.Task::(prepare) Task=`0bdc2beb-8afe-417d-a5f6-3fb531285567`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:19:43,565::task::579::TaskManager.Task::(_updateState) Task=`0bdc2beb-8afe-417d-a5f6-3fb531285567`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:19:43,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:19:43,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:19:43,566::task::974::TaskManager.Task::(_decref) Task=`0bdc2beb-8afe-417d-a5f6-3fb531285567`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:43,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:44,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:44,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:45,967::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:19:46,128::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:19:46,145::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029253 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:19:46,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:46,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:47,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:19:47,719::task::579::TaskManager.Task::(_updateState) Task=`ca8f4d1d-e9f7-4a06-bf49-67df6e20b0d7`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:19:47,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:19:47,719::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:19:47,719::task::1168::TaskManager.Task::(prepare) Task=`ca8f4d1d-e9f7-4a06-bf49-67df6e20b0d7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:19:47,720::task::579::TaskManager.Task::(_updateState) Task=`ca8f4d1d-e9f7-4a06-bf49-67df6e20b0d7`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:19:47,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:19:47,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:19:47,720::task::974::TaskManager.Task::(_decref) Task=`ca8f4d1d-e9f7-4a06-bf49-67df6e20b0d7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:47,970::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:19:47,970::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:48,597::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:48,972::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:49,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:50,599::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:50,975::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:19:51,701::task::579::TaskManager.Task::(_updateState) Task=`1fab16db-ea56-4ba3-9096-668a23b0ed6b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:19:51,701::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:19:51,702::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:19:51,702::task::1168::TaskManager.Task::(prepare) Task=`1fab16db-ea56-4ba3-9096-668a23b0ed6b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:19:51,702::task::579::TaskManager.Task::(_updateState) Task=`1fab16db-ea56-4ba3-9096-668a23b0ed6b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:19:51,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:19:51,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:19:51,702::task::974::TaskManager.Task::(_decref) Task=`1fab16db-ea56-4ba3-9096-668a23b0ed6b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:19:51,702::task::579::TaskManager.Task::(_updateState) Task=`e1cefa29-3112-49c9-b47d-ab30ba8c5ecb`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:19:51,703::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:19:51,703::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:19:51,703::task::1168::TaskManager.Task::(prepare) Task=`e1cefa29-3112-49c9-b47d-ab30ba8c5ecb`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:19:51,703::task::579::TaskManager.Task::(_updateState) Task=`e1cefa29-3112-49c9-b47d-ab30ba8c5ecb`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:19:51,703::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:19:51,703::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:19:51,703::task::974::TaskManager.Task::(_decref) Task=`e1cefa29-3112-49c9-b47d-ab30ba8c5ecb`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:19:51,704::task::579::TaskManager.Task::(_updateState) Task=`a72e5d49-c32c-428a-98c1-c3fd9cad5521`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:19:51,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:19:51,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:19:51,704::task::1168::TaskManager.Task::(prepare) Task=`a72e5d49-c32c-428a-98c1-c3fd9cad5521`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:19:51,704::task::579::TaskManager.Task::(_updateState) Task=`a72e5d49-c32c-428a-98c1-c3fd9cad5521`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:19:51,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:19:51,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:19:51,705::task::974::TaskManager.Task::(_decref) Task=`a72e5d49-c32c-428a-98c1-c3fd9cad5521`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:51,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:52,605::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:19:52,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:52,977::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:19:52,978::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:19:52,978::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:19:53,311::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:19:53,328::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000200544 s, 20.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:19:53,979::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:19:53,979::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286443::DEBUG::2014-01-16 16:19:54,382::task::579::TaskManager.Task::(_updateState) Task=`def89eb4-6a40-42dc-8f46-ff64ecf33db9`::moving from state init -> state preparing >Thread-286443::INFO::2014-01-16 16:19:54,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286443::INFO::2014-01-16 16:19:54,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029253', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000200544', 'lastCheck': '1.1', 'valid': True}} >Thread-286443::DEBUG::2014-01-16 16:19:54,382::task::1168::TaskManager.Task::(prepare) Task=`def89eb4-6a40-42dc-8f46-ff64ecf33db9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029253', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000200544', 'lastCheck': '1.1', 'valid': True}} >Thread-286443::DEBUG::2014-01-16 16:19:54,383::task::579::TaskManager.Task::(_updateState) Task=`def89eb4-6a40-42dc-8f46-ff64ecf33db9`::moving from state preparing -> state finished >Thread-286443::DEBUG::2014-01-16 16:19:54,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286443::DEBUG::2014-01-16 16:19:54,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286443::DEBUG::2014-01-16 16:19:54,383::task::974::TaskManager.Task::(_decref) Task=`def89eb4-6a40-42dc-8f46-ff64ecf33db9`::ref 0 aborting False >Thread-84941::DEBUG::2014-01-16 16:19:54,583::task::579::TaskManager.Task::(_updateState) Task=`2a4ea29c-70f3-432f-b446-01a6f8136714`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:19:54,583::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:19:54,584::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:19:54,584::task::1168::TaskManager.Task::(prepare) Task=`2a4ea29c-70f3-432f-b446-01a6f8136714`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:19:54,584::task::579::TaskManager.Task::(_updateState) Task=`2a4ea29c-70f3-432f-b446-01a6f8136714`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:19:54,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:19:54,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:19:54,584::task::974::TaskManager.Task::(_decref) Task=`2a4ea29c-70f3-432f-b446-01a6f8136714`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:19:54,608::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:54,981::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:19:54,981::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:19:54,981::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:55,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:19:55,982::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:19:56,153::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:19:56,171::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000973567 s, 375 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:19:56,609::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:56,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:19:56,984::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:57,612::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:19:57,612::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:19:57,613::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:19:57,985::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:19:58,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:19:58,800::task::579::TaskManager.Task::(_updateState) Task=`6a2fa11e-6e9c-4e38-87f4-a0cfd2a4fe47`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:19:58,800::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:19:58,801::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:19:58,801::task::1168::TaskManager.Task::(prepare) Task=`6a2fa11e-6e9c-4e38-87f4-a0cfd2a4fe47`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:19:58,801::task::579::TaskManager.Task::(_updateState) Task=`6a2fa11e-6e9c-4e38-87f4-a0cfd2a4fe47`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:19:58,801::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:19:58,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:19:58,802::task::974::TaskManager.Task::(_decref) Task=`6a2fa11e-6e9c-4e38-87f4-a0cfd2a4fe47`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:19:58,802::task::579::TaskManager.Task::(_updateState) Task=`bfe5506e-621a-4223-85d0-eae82217863f`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:19:58,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:19:58,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:19:58,803::task::1168::TaskManager.Task::(prepare) Task=`bfe5506e-621a-4223-85d0-eae82217863f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:19:58,803::task::579::TaskManager.Task::(_updateState) Task=`bfe5506e-621a-4223-85d0-eae82217863f`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:19:58,803::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:19:58,803::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:19:58,803::task::974::TaskManager.Task::(_decref) Task=`bfe5506e-621a-4223-85d0-eae82217863f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:19:58,987::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:19:58,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:19:59,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:19:59,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:00,616::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:00,989::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:20:00,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:20:00,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:20:00,990::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:20:01,705::task::579::TaskManager.Task::(_updateState) Task=`ee58b222-002e-46e3-83e8-0b21a13dce9e`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:20:01,706::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:20:01,706::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:20:01,706::task::1168::TaskManager.Task::(prepare) Task=`ee58b222-002e-46e3-83e8-0b21a13dce9e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:20:01,706::task::579::TaskManager.Task::(_updateState) Task=`ee58b222-002e-46e3-83e8-0b21a13dce9e`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:20:01,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:20:01,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:20:01,707::task::974::TaskManager.Task::(_decref) Task=`ee58b222-002e-46e3-83e8-0b21a13dce9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:01,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:20:01,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:20:01,991::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:02,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:02,620::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:02,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:20:02,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:20:03,331::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:20:03,332::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:20:03,332::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:20:03,332::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:20:03,335::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:03,352::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000203557 s, 10.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:20:03,352::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000203557 s, 10.1 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:20:03,352::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:20:03,353::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:20:03,353::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:20:03,353::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:20:03,353::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:20:03,354::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:20:03,354::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:20:03,354::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:20:03,355::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:03,570::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:20:03,573::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:20:03,574::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:20:03,576::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:20:03,576::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:20:03,576::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:20:03,576::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:03,751::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:20:03,755::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:03,771::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000199559 s, 20.5 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 16:20:03,891::task::579::TaskManager.Task::(_updateState) Task=`c74d655b-3576-4e45-8159-090e014cb615`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:20:03,892::task::579::TaskManager.Task::(_updateState) Task=`654c0ea0-e046-4ac1-ad7d-2e3d9075f690`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:20:03,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:20:03,895::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:20:03,898::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:20:03,900::task::1168::TaskManager.Task::(prepare) Task=`c74d655b-3576-4e45-8159-090e014cb615`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:20:03,902::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:20:03,903::task::579::TaskManager.Task::(_updateState) Task=`c74d655b-3576-4e45-8159-090e014cb615`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:20:03,905::task::1168::TaskManager.Task::(prepare) Task=`654c0ea0-e046-4ac1-ad7d-2e3d9075f690`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:20:03,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:20:03,909::task::579::TaskManager.Task::(_updateState) Task=`654c0ea0-e046-4ac1-ad7d-2e3d9075f690`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:20:03,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:20:03,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:20:03,912::task::974::TaskManager.Task::(_decref) Task=`c74d655b-3576-4e45-8159-090e014cb615`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:20:03,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:20:03,914::task::974::TaskManager.Task::(_decref) Task=`654c0ea0-e046-4ac1-ad7d-2e3d9075f690`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:03,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:20:03,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:20:03,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:20:03,994::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:04,622::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:20:04,986::task::579::TaskManager.Task::(_updateState) Task=`2f5cb433-cc33-4b3a-96d4-8280d4e3f4a5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:20:04,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:20:04,987::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:20:04,987::task::1168::TaskManager.Task::(prepare) Task=`2f5cb433-cc33-4b3a-96d4-8280d4e3f4a5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:20:04,987::task::579::TaskManager.Task::(_updateState) Task=`2f5cb433-cc33-4b3a-96d4-8280d4e3f4a5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:20:04,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:20:04,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:20:04,987::task::974::TaskManager.Task::(_decref) Task=`2f5cb433-cc33-4b3a-96d4-8280d4e3f4a5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:20:04,988::task::579::TaskManager.Task::(_updateState) Task=`85e68287-571c-442f-bc00-bcad22b4aa11`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:20:04,988::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:20:04,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:20:04,988::task::1168::TaskManager.Task::(prepare) Task=`85e68287-571c-442f-bc00-bcad22b4aa11`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:20:04,988::task::579::TaskManager.Task::(_updateState) Task=`85e68287-571c-442f-bc00-bcad22b4aa11`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:20:04,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:20:04,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:20:04,989::task::974::TaskManager.Task::(_decref) Task=`85e68287-571c-442f-bc00-bcad22b4aa11`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:04,995::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:20:05,151::task::579::TaskManager.Task::(_updateState) Task=`682ddc66-bc49-468a-bd45-6d660e976c34`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:20:05,152::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:20:05,152::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:20:05,153::task::1168::TaskManager.Task::(prepare) Task=`682ddc66-bc49-468a-bd45-6d660e976c34`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:20:05,153::task::579::TaskManager.Task::(_updateState) Task=`682ddc66-bc49-468a-bd45-6d660e976c34`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:20:05,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:20:05,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:20:05,153::task::974::TaskManager.Task::(_decref) Task=`682ddc66-bc49-468a-bd45-6d660e976c34`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:20:05,153::task::579::TaskManager.Task::(_updateState) Task=`8cab8f2c-0e91-44be-98a1-8010ac2dd23f`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:20:05,154::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:20:05,154::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:20:05,154::task::1168::TaskManager.Task::(prepare) Task=`8cab8f2c-0e91-44be-98a1-8010ac2dd23f`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:20:05,155::task::579::TaskManager.Task::(_updateState) Task=`8cab8f2c-0e91-44be-98a1-8010ac2dd23f`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:20:05,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:20:05,155::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:20:05,155::task::974::TaskManager.Task::(_decref) Task=`8cab8f2c-0e91-44be-98a1-8010ac2dd23f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:05,996::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:20:05,996::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:20:05,996::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:20:05,996::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:05,997::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:20:05,999::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:20:06,019::task::579::TaskManager.Task::(_updateState) Task=`ef8ee76e-d34d-44ee-8b51-67d5b53dc3bb`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:20:06,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:20:06,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:20:06,020::task::1168::TaskManager.Task::(prepare) Task=`ef8ee76e-d34d-44ee-8b51-67d5b53dc3bb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:20:06,020::task::579::TaskManager.Task::(_updateState) Task=`ef8ee76e-d34d-44ee-8b51-67d5b53dc3bb`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:20:06,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:20:06,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:20:06,020::task::974::TaskManager.Task::(_decref) Task=`ef8ee76e-d34d-44ee-8b51-67d5b53dc3bb`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:20:06,182::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:20:06,198::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000310814 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:20:06,235::task::579::TaskManager.Task::(_updateState) Task=`a3b42d97-60de-4d1a-bcf6-fa471fc3d1f8`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:20:06,235::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:20:06,236::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:20:06,236::task::1168::TaskManager.Task::(prepare) Task=`a3b42d97-60de-4d1a-bcf6-fa471fc3d1f8`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:20:06,237::task::579::TaskManager.Task::(_updateState) Task=`a3b42d97-60de-4d1a-bcf6-fa471fc3d1f8`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:20:06,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:20:06,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:20:06,237::task::974::TaskManager.Task::(_decref) Task=`a3b42d97-60de-4d1a-bcf6-fa471fc3d1f8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:06,624::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:07,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:20:07,163::task::579::TaskManager.Task::(_updateState) Task=`a96d14a6-8c38-44f0-86a4-21c87f71dfba`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:20:07,163::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:20:07,164::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:20:07,164::task::1168::TaskManager.Task::(prepare) Task=`a96d14a6-8c38-44f0-86a4-21c87f71dfba`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:20:07,164::task::579::TaskManager.Task::(_updateState) Task=`a96d14a6-8c38-44f0-86a4-21c87f71dfba`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:20:07,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:20:07,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:20:07,165::task::974::TaskManager.Task::(_decref) Task=`a96d14a6-8c38-44f0-86a4-21c87f71dfba`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:07,626::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:08,001::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:20:08,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:20:08,002::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:20:08,242::task::579::TaskManager.Task::(_updateState) Task=`bf4e44a1-8fcf-46cc-9b3b-adce9e5575ae`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:20:08,242::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:20:08,243::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:20:08,243::task::1168::TaskManager.Task::(prepare) Task=`bf4e44a1-8fcf-46cc-9b3b-adce9e5575ae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:20:08,243::task::579::TaskManager.Task::(_updateState) Task=`bf4e44a1-8fcf-46cc-9b3b-adce9e5575ae`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:20:08,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:20:08,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:20:08,243::task::974::TaskManager.Task::(_decref) Task=`bf4e44a1-8fcf-46cc-9b3b-adce9e5575ae`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:08,627::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:09,003::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:20:09,003::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:20:09,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:10,004::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:20:10,004::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:20:10,005::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:20:10,005::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286449::DEBUG::2014-01-16 16:20:10,303::task::579::TaskManager.Task::(_updateState) Task=`47d34873-18c4-4720-a24b-b7904b9dd874`::moving from state init -> state preparing >Thread-286449::INFO::2014-01-16 16:20:10,303::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286449::INFO::2014-01-16 16:20:10,303::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310814', 'lastCheck': '4.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000199559', 'lastCheck': '6.5', 'valid': True}} >Thread-286449::DEBUG::2014-01-16 16:20:10,304::task::1168::TaskManager.Task::(prepare) Task=`47d34873-18c4-4720-a24b-b7904b9dd874`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310814', 'lastCheck': '4.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000199559', 'lastCheck': '6.5', 'valid': True}} >Thread-286449::DEBUG::2014-01-16 16:20:10,304::task::579::TaskManager.Task::(_updateState) Task=`47d34873-18c4-4720-a24b-b7904b9dd874`::moving from state preparing -> state finished >Thread-286449::DEBUG::2014-01-16 16:20:10,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286449::DEBUG::2014-01-16 16:20:10,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286449::DEBUG::2014-01-16 16:20:10,304::task::974::TaskManager.Task::(_decref) Task=`47d34873-18c4-4720-a24b-b7904b9dd874`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:10,629::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:11,006::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:20:11,246::task::579::TaskManager.Task::(_updateState) Task=`4a100d4e-306a-4f52-97da-c875ba252884`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:20:11,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:20:11,247::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:20:11,247::task::1168::TaskManager.Task::(prepare) Task=`4a100d4e-306a-4f52-97da-c875ba252884`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:20:11,247::task::579::TaskManager.Task::(_updateState) Task=`4a100d4e-306a-4f52-97da-c875ba252884`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:20:11,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:20:11,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:20:11,247::task::974::TaskManager.Task::(_decref) Task=`4a100d4e-306a-4f52-97da-c875ba252884`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:12,007::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:20:12,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:12,631::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:12,631::task::579::TaskManager.Task::(_updateState) Task=`70aa650c-a78d-44a1-9a01-d9756590249d`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:20:12,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:20:12,632::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:20:12,632::task::1168::TaskManager.Task::(prepare) Task=`70aa650c-a78d-44a1-9a01-d9756590249d`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:20:12,632::task::579::TaskManager.Task::(_updateState) Task=`70aa650c-a78d-44a1-9a01-d9756590249d`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:20:12,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:20:12,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:20:12,633::task::974::TaskManager.Task::(_decref) Task=`70aa650c-a78d-44a1-9a01-d9756590249d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:12,635::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:20:12,635::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:20:12,641::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:12,643::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:12,643::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:13,009::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:20:13,778::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:13,795::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000253224 s, 16.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:20:14,010::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:20:14,643::task::579::TaskManager.Task::(_updateState) Task=`8465d18e-19e6-4230-b359-c4344add5ce5`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:20:14,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:20:14,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:20:14,643::task::1168::TaskManager.Task::(prepare) Task=`8465d18e-19e6-4230-b359-c4344add5ce5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:20:14,644::task::579::TaskManager.Task::(_updateState) Task=`8465d18e-19e6-4230-b359-c4344add5ce5`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:20:14,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:20:14,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:20:14,645::task::974::TaskManager.Task::(_decref) Task=`8465d18e-19e6-4230-b359-c4344add5ce5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:14,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:15,011::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:20:15,208::task::579::TaskManager.Task::(_updateState) Task=`b7ddc4c7-cf8a-49f7-81af-fafe8a3fc576`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:20:15,209::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:20:15,210::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:20:15,210::task::1168::TaskManager.Task::(prepare) Task=`b7ddc4c7-cf8a-49f7-81af-fafe8a3fc576`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:20:15,210::task::579::TaskManager.Task::(_updateState) Task=`b7ddc4c7-cf8a-49f7-81af-fafe8a3fc576`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:20:15,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:20:15,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:20:15,211::task::974::TaskManager.Task::(_decref) Task=`b7ddc4c7-cf8a-49f7-81af-fafe8a3fc576`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:16,013::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:20:16,205::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:20:16,221::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026287 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:20:16,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:17,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:17,649::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:18,015::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:20:18,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:20:18,614::task::579::TaskManager.Task::(_updateState) Task=`6b1f7d83-7494-4f2e-b714-dd38e3829797`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:20:18,615::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:20:18,615::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:20:18,615::task::1168::TaskManager.Task::(prepare) Task=`6b1f7d83-7494-4f2e-b714-dd38e3829797`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:20:18,616::task::579::TaskManager.Task::(_updateState) Task=`6b1f7d83-7494-4f2e-b714-dd38e3829797`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:20:18,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:20:18,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:20:18,616::task::974::TaskManager.Task::(_decref) Task=`6b1f7d83-7494-4f2e-b714-dd38e3829797`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:20:18,616::task::579::TaskManager.Task::(_updateState) Task=`3a3739f6-b161-4587-aef2-adb96c90abe8`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:20:18,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:20:18,617::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:20:18,617::task::1168::TaskManager.Task::(prepare) Task=`3a3739f6-b161-4587-aef2-adb96c90abe8`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:20:18,617::task::579::TaskManager.Task::(_updateState) Task=`3a3739f6-b161-4587-aef2-adb96c90abe8`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:20:18,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:20:18,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:20:18,617::task::974::TaskManager.Task::(_decref) Task=`3a3739f6-b161-4587-aef2-adb96c90abe8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:18,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:19,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:20,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:20,652::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:21,019::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:22,021::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:22,653::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:22,654::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:20:22,799::task::579::TaskManager.Task::(_updateState) Task=`9e2e9366-f191-43a8-90ac-d887aa178e3c`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:20:22,800::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:20:22,800::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:20:22,800::task::1168::TaskManager.Task::(prepare) Task=`9e2e9366-f191-43a8-90ac-d887aa178e3c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:20:22,800::task::579::TaskManager.Task::(_updateState) Task=`9e2e9366-f191-43a8-90ac-d887aa178e3c`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:20:22,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:20:22,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:20:22,801::task::974::TaskManager.Task::(_decref) Task=`9e2e9366-f191-43a8-90ac-d887aa178e3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:23,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:20:23,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:20:23,023::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:20:23,713::task::579::TaskManager.Task::(_updateState) Task=`dc4d562b-207e-468c-bec2-d972b1da42fd`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:20:23,713::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:20:23,714::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:20:23,714::task::1168::TaskManager.Task::(prepare) Task=`dc4d562b-207e-468c-bec2-d972b1da42fd`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:20:23,714::task::579::TaskManager.Task::(_updateState) Task=`dc4d562b-207e-468c-bec2-d972b1da42fd`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:20:23,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:20:23,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:20:23,715::task::974::TaskManager.Task::(_decref) Task=`dc4d562b-207e-468c-bec2-d972b1da42fd`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:20:23,801::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:23,817::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024072 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:20:24,023::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:20:24,023::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:24,655::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:25,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:20:25,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:20:25,025::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:26,026::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:20:26,026::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:20:26,229::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:20:26,245::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273995 s, 1.3 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:20:26,304::task::579::TaskManager.Task::(_updateState) Task=`2388b2ae-72f5-4f85-bb35-f34d0f5d7b86`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:20:26,304::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:20:26,305::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:20:26,305::task::1168::TaskManager.Task::(prepare) Task=`2388b2ae-72f5-4f85-bb35-f34d0f5d7b86`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:20:26,305::task::579::TaskManager.Task::(_updateState) Task=`2388b2ae-72f5-4f85-bb35-f34d0f5d7b86`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:20:26,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:20:26,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:20:26,306::task::974::TaskManager.Task::(_decref) Task=`2388b2ae-72f5-4f85-bb35-f34d0f5d7b86`::ref 0 aborting False >Thread-286455::DEBUG::2014-01-16 16:20:26,323::task::579::TaskManager.Task::(_updateState) Task=`1f184801-4cd3-461a-a52a-95badc934630`::moving from state init -> state preparing >Thread-286455::INFO::2014-01-16 16:20:26,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286455::INFO::2014-01-16 16:20:26,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273995', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024072', 'lastCheck': '2.5', 'valid': True}} >Thread-286455::DEBUG::2014-01-16 16:20:26,324::task::1168::TaskManager.Task::(prepare) Task=`1f184801-4cd3-461a-a52a-95badc934630`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273995', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024072', 'lastCheck': '2.5', 'valid': True}} >Thread-286455::DEBUG::2014-01-16 16:20:26,324::task::579::TaskManager.Task::(_updateState) Task=`1f184801-4cd3-461a-a52a-95badc934630`::moving from state preparing -> state finished >Thread-286455::DEBUG::2014-01-16 16:20:26,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286455::DEBUG::2014-01-16 16:20:26,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286455::DEBUG::2014-01-16 16:20:26,325::task::974::TaskManager.Task::(_decref) Task=`1f184801-4cd3-461a-a52a-95badc934630`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:20:26,348::task::579::TaskManager.Task::(_updateState) Task=`b2e65e7e-0c33-4741-a69e-c1d08a4609cf`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:20:26,348::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:20:26,348::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:20:26,348::task::1168::TaskManager.Task::(prepare) Task=`b2e65e7e-0c33-4741-a69e-c1d08a4609cf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:20:26,349::task::579::TaskManager.Task::(_updateState) Task=`b2e65e7e-0c33-4741-a69e-c1d08a4609cf`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:20:26,349::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:20:26,349::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:20:26,349::task::974::TaskManager.Task::(_decref) Task=`b2e65e7e-0c33-4741-a69e-c1d08a4609cf`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:26,657::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:27,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:20:27,028::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:27,659::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:20:27,659::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:20:27,660::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:28,029::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:28,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:29,030::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:20:29,031::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:30,032::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:20:30,032::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:30,663::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:31,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:20:31,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:20:31,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:20:31,034::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:20:31,313::task::579::TaskManager.Task::(_updateState) Task=`aee0dc4f-4684-4e68-8aa1-29e2bbdc23b3`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:20:31,314::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:20:31,314::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:20:31,314::task::1168::TaskManager.Task::(prepare) Task=`aee0dc4f-4684-4e68-8aa1-29e2bbdc23b3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:20:31,314::task::579::TaskManager.Task::(_updateState) Task=`aee0dc4f-4684-4e68-8aa1-29e2bbdc23b3`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:20:31,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:20:31,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:20:31,315::task::974::TaskManager.Task::(_decref) Task=`aee0dc4f-4684-4e68-8aa1-29e2bbdc23b3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:32,035::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:20:32,035::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:20:32,035::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:32,664::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:32,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:33,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:20:33,037::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:20:33,823::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:33,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000234976 s, 17.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:20:34,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:20:34,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:20:34,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:20:34,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:20:34,062::task::579::TaskManager.Task::(_updateState) Task=`efd74c29-47cd-42f5-8c3b-64b9f09d74c9`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:20:34,062::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:20:34,062::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:20:34,062::task::1168::TaskManager.Task::(prepare) Task=`efd74c29-47cd-42f5-8c3b-64b9f09d74c9`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:20:34,063::task::579::TaskManager.Task::(_updateState) Task=`efd74c29-47cd-42f5-8c3b-64b9f09d74c9`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:20:34,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:20:34,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:20:34,063::task::974::TaskManager.Task::(_decref) Task=`efd74c29-47cd-42f5-8c3b-64b9f09d74c9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:34,667::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:20:34,789::task::579::TaskManager.Task::(_updateState) Task=`b64bc7c1-f50d-4296-bc3b-315450abb89a`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:20:34,789::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:20:34,790::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:20:34,790::task::1168::TaskManager.Task::(prepare) Task=`b64bc7c1-f50d-4296-bc3b-315450abb89a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:20:34,790::task::579::TaskManager.Task::(_updateState) Task=`b64bc7c1-f50d-4296-bc3b-315450abb89a`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:20:34,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:20:34,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:20:34,790::task::974::TaskManager.Task::(_decref) Task=`b64bc7c1-f50d-4296-bc3b-315450abb89a`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:20:34,849::task::579::TaskManager.Task::(_updateState) Task=`87d46cb4-1ff6-41c1-b7af-7e0059c7c301`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:20:34,849::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:20:34,849::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:20:34,849::task::1168::TaskManager.Task::(prepare) Task=`87d46cb4-1ff6-41c1-b7af-7e0059c7c301`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:20:34,850::task::579::TaskManager.Task::(_updateState) Task=`87d46cb4-1ff6-41c1-b7af-7e0059c7c301`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:20:34,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:20:34,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:20:34,850::task::974::TaskManager.Task::(_decref) Task=`87d46cb4-1ff6-41c1-b7af-7e0059c7c301`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:20:34,855::task::579::TaskManager.Task::(_updateState) Task=`894daf5e-0bdc-4dbb-b4cf-9eb06570c2ab`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:20:34,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:20:34,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:20:34,855::task::1168::TaskManager.Task::(prepare) Task=`894daf5e-0bdc-4dbb-b4cf-9eb06570c2ab`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:20:34,856::task::579::TaskManager.Task::(_updateState) Task=`894daf5e-0bdc-4dbb-b4cf-9eb06570c2ab`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:20:34,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:20:34,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:20:34,856::task::974::TaskManager.Task::(_decref) Task=`894daf5e-0bdc-4dbb-b4cf-9eb06570c2ab`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:35,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:20:35,729::task::579::TaskManager.Task::(_updateState) Task=`9db52652-4820-4cef-8e5c-20656b5d21ad`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:20:35,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:20:35,730::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:20:35,730::task::1168::TaskManager.Task::(prepare) Task=`9db52652-4820-4cef-8e5c-20656b5d21ad`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:20:35,731::task::579::TaskManager.Task::(_updateState) Task=`9db52652-4820-4cef-8e5c-20656b5d21ad`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:20:35,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:20:35,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:20:35,731::task::974::TaskManager.Task::(_decref) Task=`9db52652-4820-4cef-8e5c-20656b5d21ad`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:36,040::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:20:36,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:20:36,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:20:36,041::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:36,041::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:20:36,041::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-12152::DEBUG::2014-01-16 16:20:36,075::task::579::TaskManager.Task::(_updateState) Task=`8c10ca8d-b209-451f-9e31-052f490ecab9`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:20:36,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:20:36,075::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:20:36,075::task::1168::TaskManager.Task::(prepare) Task=`8c10ca8d-b209-451f-9e31-052f490ecab9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:20:36,076::task::579::TaskManager.Task::(_updateState) Task=`8c10ca8d-b209-451f-9e31-052f490ecab9`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:20:36,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:20:36,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:20:36,076::task::974::TaskManager.Task::(_decref) Task=`8c10ca8d-b209-451f-9e31-052f490ecab9`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:20:36,254::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:20:36,271::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000268312 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:20:36,675::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:20:37,022::task::579::TaskManager.Task::(_updateState) Task=`52214ea1-cea1-40c2-a786-18c466e5d191`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:20:37,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:20:37,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:20:37,023::task::1168::TaskManager.Task::(prepare) Task=`52214ea1-cea1-40c2-a786-18c466e5d191`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:20:37,024::task::579::TaskManager.Task::(_updateState) Task=`52214ea1-cea1-40c2-a786-18c466e5d191`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:20:37,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:20:37,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:20:37,024::task::974::TaskManager.Task::(_decref) Task=`52214ea1-cea1-40c2-a786-18c466e5d191`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:20:37,024::task::579::TaskManager.Task::(_updateState) Task=`2d39e5dd-bc96-4439-8e52-1c8d9a774401`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:20:37,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:20:37,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:20:37,025::task::1168::TaskManager.Task::(prepare) Task=`2d39e5dd-bc96-4439-8e52-1c8d9a774401`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:20:37,025::task::579::TaskManager.Task::(_updateState) Task=`2d39e5dd-bc96-4439-8e52-1c8d9a774401`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:20:37,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:20:37,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:20:37,025::task::974::TaskManager.Task::(_decref) Task=`2d39e5dd-bc96-4439-8e52-1c8d9a774401`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:20:37,026::task::579::TaskManager.Task::(_updateState) Task=`e21dcbfc-8f15-4e4f-a999-60c2e39c47eb`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:20:37,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:20:37,026::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:20:37,026::task::1168::TaskManager.Task::(prepare) Task=`e21dcbfc-8f15-4e4f-a999-60c2e39c47eb`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:20:37,026::task::579::TaskManager.Task::(_updateState) Task=`e21dcbfc-8f15-4e4f-a999-60c2e39c47eb`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:20:37,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:20:37,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:20:37,027::task::974::TaskManager.Task::(_decref) Task=`e21dcbfc-8f15-4e4f-a999-60c2e39c47eb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:37,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:37,676::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:38,043::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:20:38,043::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:20:38,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:38,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:39,044::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:20:39,045::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:20:39,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:40,046::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:20:40,046::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:20:40,047::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:20:40,047::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:40,679::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:41,048::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286461::DEBUG::2014-01-16 16:20:42,044::task::579::TaskManager.Task::(_updateState) Task=`067854fa-be25-4a0d-8b18-13159f696437`::moving from state init -> state preparing >Thread-286461::INFO::2014-01-16 16:20:42,044::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286461::INFO::2014-01-16 16:20:42,044::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268312', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234976', 'lastCheck': '8.2', 'valid': True}} >Thread-286461::DEBUG::2014-01-16 16:20:42,044::task::1168::TaskManager.Task::(prepare) Task=`067854fa-be25-4a0d-8b18-13159f696437`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268312', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234976', 'lastCheck': '8.2', 'valid': True}} >Thread-286461::DEBUG::2014-01-16 16:20:42,045::task::579::TaskManager.Task::(_updateState) Task=`067854fa-be25-4a0d-8b18-13159f696437`::moving from state preparing -> state finished >Thread-286461::DEBUG::2014-01-16 16:20:42,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286461::DEBUG::2014-01-16 16:20:42,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286461::DEBUG::2014-01-16 16:20:42,045::task::974::TaskManager.Task::(_decref) Task=`067854fa-be25-4a0d-8b18-13159f696437`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:42,049::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:20:42,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:42,680::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:42,682::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:20:42,682::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:20:42,684::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:43,051::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:20:43,744::task::579::TaskManager.Task::(_updateState) Task=`c62c4caf-a1c6-4b91-995b-39ecc99820c9`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:20:43,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:20:43,745::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:20:43,745::task::1168::TaskManager.Task::(prepare) Task=`c62c4caf-a1c6-4b91-995b-39ecc99820c9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:20:43,745::task::579::TaskManager.Task::(_updateState) Task=`c62c4caf-a1c6-4b91-995b-39ecc99820c9`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:20:43,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:20:43,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:20:43,745::task::974::TaskManager.Task::(_decref) Task=`c62c4caf-a1c6-4b91-995b-39ecc99820c9`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:20:43,844::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:43,861::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213459 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:20:44,052::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:44,685::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:45,053::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:46,055::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:20:46,278::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:20:46,294::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286933 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:20:46,687::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:47,056::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:47,688::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:20:47,906::task::579::TaskManager.Task::(_updateState) Task=`fb22edbe-38e8-4730-b789-65d3da86f9c3`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:20:47,906::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:20:47,907::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:20:47,907::task::1168::TaskManager.Task::(prepare) Task=`fb22edbe-38e8-4730-b789-65d3da86f9c3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:20:47,907::task::579::TaskManager.Task::(_updateState) Task=`fb22edbe-38e8-4730-b789-65d3da86f9c3`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:20:47,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:20:47,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:20:47,908::task::974::TaskManager.Task::(_decref) Task=`fb22edbe-38e8-4730-b789-65d3da86f9c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:48,057::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:20:48,058::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:48,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:49,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:50,060::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:50,691::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:51,061::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:52,062::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:20:52,269::task::579::TaskManager.Task::(_updateState) Task=`0a74b2fd-0922-42b2-965c-cf5ddf315078`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:20:52,269::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:20:52,270::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:20:52,270::task::1168::TaskManager.Task::(prepare) Task=`0a74b2fd-0922-42b2-965c-cf5ddf315078`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:20:52,270::task::579::TaskManager.Task::(_updateState) Task=`0a74b2fd-0922-42b2-965c-cf5ddf315078`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:20:52,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:20:52,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:20:52,270::task::974::TaskManager.Task::(_decref) Task=`0a74b2fd-0922-42b2-965c-cf5ddf315078`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:20:52,271::task::579::TaskManager.Task::(_updateState) Task=`6de079a2-dba8-4f85-903e-fe5455c8c852`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:20:52,271::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:20:52,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:20:52,271::task::1168::TaskManager.Task::(prepare) Task=`6de079a2-dba8-4f85-903e-fe5455c8c852`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:20:52,271::task::579::TaskManager.Task::(_updateState) Task=`6de079a2-dba8-4f85-903e-fe5455c8c852`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:20:52,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:20:52,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:20:52,272::task::974::TaskManager.Task::(_decref) Task=`6de079a2-dba8-4f85-903e-fe5455c8c852`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:20:52,272::task::579::TaskManager.Task::(_updateState) Task=`543236c9-d033-4670-8a7b-b60d664ecbce`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:20:52,272::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:20:52,272::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:20:52,272::task::1168::TaskManager.Task::(prepare) Task=`543236c9-d033-4670-8a7b-b60d664ecbce`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:20:52,272::task::579::TaskManager.Task::(_updateState) Task=`543236c9-d033-4670-8a7b-b60d664ecbce`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:20:52,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:20:52,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:20:52,273::task::974::TaskManager.Task::(_decref) Task=`543236c9-d033-4670-8a7b-b60d664ecbce`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:20:52,692::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:20:52,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:53,062::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:20:53,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:20:53,063::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:20:53,868::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:20:53,885::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000203504 s, 20.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:20:54,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:20:54,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:54,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:20:54,755::task::579::TaskManager.Task::(_updateState) Task=`0d5af993-df4e-4d93-b25b-820725ee65d0`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:20:54,755::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:20:54,755::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:20:54,756::task::1168::TaskManager.Task::(prepare) Task=`0d5af993-df4e-4d93-b25b-820725ee65d0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:20:54,756::task::579::TaskManager.Task::(_updateState) Task=`0d5af993-df4e-4d93-b25b-820725ee65d0`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:20:54,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:20:54,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:20:54,756::task::974::TaskManager.Task::(_decref) Task=`0d5af993-df4e-4d93-b25b-820725ee65d0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:55,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:20:55,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:20:55,066::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:20:56,067::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:20:56,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:20:56,302::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:20:56,318::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264065 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:20:56,696::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:20:57,069::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:20:57,069::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:57,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:20:57,698::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:20:57,699::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286467::DEBUG::2014-01-16 16:20:57,825::task::579::TaskManager.Task::(_updateState) Task=`a9d4c7c0-ff1a-4c6a-9f80-a2c144077bb3`::moving from state init -> state preparing >Thread-286467::INFO::2014-01-16 16:20:57,825::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286467::INFO::2014-01-16 16:20:57,826::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264065', 'lastCheck': '1.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000203504', 'lastCheck': '3.9', 'valid': True}} >Thread-286467::DEBUG::2014-01-16 16:20:57,826::task::1168::TaskManager.Task::(prepare) Task=`a9d4c7c0-ff1a-4c6a-9f80-a2c144077bb3`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264065', 'lastCheck': '1.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000203504', 'lastCheck': '3.9', 'valid': True}} >Thread-286467::DEBUG::2014-01-16 16:20:57,826::task::579::TaskManager.Task::(_updateState) Task=`a9d4c7c0-ff1a-4c6a-9f80-a2c144077bb3`::moving from state preparing -> state finished >Thread-286467::DEBUG::2014-01-16 16:20:57,826::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286467::DEBUG::2014-01-16 16:20:57,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286467::DEBUG::2014-01-16 16:20:57,827::task::974::TaskManager.Task::(_decref) Task=`a9d4c7c0-ff1a-4c6a-9f80-a2c144077bb3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:58,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:20:58,701::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:20:59,024::task::579::TaskManager.Task::(_updateState) Task=`02664813-53c2-4271-ac41-8c3618e7d574`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:20:59,025::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:20:59,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:20:59,025::task::1168::TaskManager.Task::(prepare) Task=`02664813-53c2-4271-ac41-8c3618e7d574`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:20:59,025::task::579::TaskManager.Task::(_updateState) Task=`02664813-53c2-4271-ac41-8c3618e7d574`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:20:59,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:20:59,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:20:59,026::task::974::TaskManager.Task::(_decref) Task=`02664813-53c2-4271-ac41-8c3618e7d574`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:20:59,026::task::579::TaskManager.Task::(_updateState) Task=`53c1f504-4dee-4b92-9e97-0b35fbd88372`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:20:59,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:20:59,026::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:20:59,027::task::1168::TaskManager.Task::(prepare) Task=`53c1f504-4dee-4b92-9e97-0b35fbd88372`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:20:59,027::task::579::TaskManager.Task::(_updateState) Task=`53c1f504-4dee-4b92-9e97-0b35fbd88372`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:20:59,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:20:59,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:20:59,027::task::974::TaskManager.Task::(_decref) Task=`53c1f504-4dee-4b92-9e97-0b35fbd88372`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:20:59,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:20:59,071::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:00,072::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:21:00,072::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:00,702::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:01,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:21:01,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:21:01,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:21:01,075::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:21:01,867::task::579::TaskManager.Task::(_updateState) Task=`eb17e961-ae74-4a49-a314-af9c093cf83f`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:21:01,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:21:01,867::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:21:01,868::task::1168::TaskManager.Task::(prepare) Task=`eb17e961-ae74-4a49-a314-af9c093cf83f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:21:01,868::task::579::TaskManager.Task::(_updateState) Task=`eb17e961-ae74-4a49-a314-af9c093cf83f`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:21:01,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:21:01,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:21:01,868::task::974::TaskManager.Task::(_decref) Task=`eb17e961-ae74-4a49-a314-af9c093cf83f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:02,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:21:02,076::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:21:02,076::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:02,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:02,705::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:03,077::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:21:03,078::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:21:03,890::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:21:03,907::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000206726 s, 19.8 MB/s\n'; <rc> = 0 >Thread-251782::DEBUG::2014-01-16 16:21:04,013::task::579::TaskManager.Task::(_updateState) Task=`d6a4e0b6-8470-461e-a953-30a60627c124`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 16:21:04,014::task::579::TaskManager.Task::(_updateState) Task=`e8db7626-6df8-4448-8516-317e2fc66a93`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:21:04,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:21:04,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:21:04,018::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:21:04,018::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:21:04,018::task::1168::TaskManager.Task::(prepare) Task=`e8db7626-6df8-4448-8516-317e2fc66a93`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:21:04,019::task::1168::TaskManager.Task::(prepare) Task=`d6a4e0b6-8470-461e-a953-30a60627c124`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:21:04,019::task::579::TaskManager.Task::(_updateState) Task=`e8db7626-6df8-4448-8516-317e2fc66a93`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:21:04,020::task::579::TaskManager.Task::(_updateState) Task=`d6a4e0b6-8470-461e-a953-30a60627c124`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:21:04,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:21:04,021::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:21:04,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:21:04,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:21:04,023::task::974::TaskManager.Task::(_decref) Task=`e8db7626-6df8-4448-8516-317e2fc66a93`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:21:04,023::task::974::TaskManager.Task::(_decref) Task=`d6a4e0b6-8470-461e-a953-30a60627c124`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:04,078::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:21:04,079::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:21:04,079::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:21:04,079::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:04,706::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:05,080::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:21:05,212::task::579::TaskManager.Task::(_updateState) Task=`a52342c9-3ffa-4674-8e66-9c6bbf798dd5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:21:05,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:21:05,213::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:21:05,213::task::1168::TaskManager.Task::(prepare) Task=`a52342c9-3ffa-4674-8e66-9c6bbf798dd5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:21:05,213::task::579::TaskManager.Task::(_updateState) Task=`a52342c9-3ffa-4674-8e66-9c6bbf798dd5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:21:05,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:21:05,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:21:05,214::task::974::TaskManager.Task::(_decref) Task=`a52342c9-3ffa-4674-8e66-9c6bbf798dd5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:21:05,214::task::579::TaskManager.Task::(_updateState) Task=`a54ab4e1-e7ee-4574-a77e-efa6f8a0ff3f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:21:05,214::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:21:05,214::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:21:05,215::task::1168::TaskManager.Task::(prepare) Task=`a54ab4e1-e7ee-4574-a77e-efa6f8a0ff3f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:21:05,215::task::579::TaskManager.Task::(_updateState) Task=`a54ab4e1-e7ee-4574-a77e-efa6f8a0ff3f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:21:05,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:21:05,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:21:05,215::task::974::TaskManager.Task::(_decref) Task=`a54ab4e1-e7ee-4574-a77e-efa6f8a0ff3f`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:21:05,252::task::579::TaskManager.Task::(_updateState) Task=`98f66cf2-db95-4338-9fb3-7f708212a5fd`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:21:05,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:21:05,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:21:05,252::task::1168::TaskManager.Task::(prepare) Task=`98f66cf2-db95-4338-9fb3-7f708212a5fd`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:21:05,253::task::579::TaskManager.Task::(_updateState) Task=`98f66cf2-db95-4338-9fb3-7f708212a5fd`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:21:05,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:21:05,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:21:05,253::task::974::TaskManager.Task::(_decref) Task=`98f66cf2-db95-4338-9fb3-7f708212a5fd`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:21:05,253::task::579::TaskManager.Task::(_updateState) Task=`1274af28-f27b-4ae8-bd67-cd6473d238ca`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:21:05,254::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:21:05,254::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:21:05,254::task::1168::TaskManager.Task::(prepare) Task=`1274af28-f27b-4ae8-bd67-cd6473d238ca`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:21:05,254::task::579::TaskManager.Task::(_updateState) Task=`1274af28-f27b-4ae8-bd67-cd6473d238ca`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:21:05,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:21:05,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:21:05,255::task::974::TaskManager.Task::(_decref) Task=`1274af28-f27b-4ae8-bd67-cd6473d238ca`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:06,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:21:06,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:21:06,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:21:06,082::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:06,083::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:21:06,083::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:21:06,187::task::579::TaskManager.Task::(_updateState) Task=`a38869f8-ccd6-4871-8a47-e7c47ba6ce94`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:21:06,188::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:21:06,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:21:06,188::task::1168::TaskManager.Task::(prepare) Task=`a38869f8-ccd6-4871-8a47-e7c47ba6ce94`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:21:06,188::task::579::TaskManager.Task::(_updateState) Task=`a38869f8-ccd6-4871-8a47-e7c47ba6ce94`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:21:06,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:21:06,189::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:21:06,189::task::974::TaskManager.Task::(_decref) Task=`a38869f8-ccd6-4871-8a47-e7c47ba6ce94`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:21:06,320::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:21:06,325::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:21:06,326::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:21:06,331::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:21:06,333::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:21:06,333::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:21:06,333::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:21:06,339::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:21:06,355::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000241683 s, 1.5 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:21:06,380::task::579::TaskManager.Task::(_updateState) Task=`07778d55-dc09-4e8d-853d-5442f206f92a`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:21:06,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:21:06,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:21:06,381::task::1168::TaskManager.Task::(prepare) Task=`07778d55-dc09-4e8d-853d-5442f206f92a`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:21:06,381::task::579::TaskManager.Task::(_updateState) Task=`07778d55-dc09-4e8d-853d-5442f206f92a`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:21:06,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:21:06,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:21:06,382::task::974::TaskManager.Task::(_decref) Task=`07778d55-dc09-4e8d-853d-5442f206f92a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:06,707::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:07,084::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:21:07,334::task::579::TaskManager.Task::(_updateState) Task=`30916494-2738-4108-b4cb-0c524b36a61f`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:21:07,334::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:21:07,334::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:21:07,334::task::1168::TaskManager.Task::(prepare) Task=`30916494-2738-4108-b4cb-0c524b36a61f`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:21:07,334::task::579::TaskManager.Task::(_updateState) Task=`30916494-2738-4108-b4cb-0c524b36a61f`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:21:07,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:21:07,335::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:21:07,335::task::974::TaskManager.Task::(_decref) Task=`30916494-2738-4108-b4cb-0c524b36a61f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:07,708::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:08,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:21:08,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:21:08,086::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:21:08,418::task::579::TaskManager.Task::(_updateState) Task=`4ba2cd86-b927-4e47-b9fe-db103c416e9d`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:21:08,418::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:21:08,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:21:08,419::task::1168::TaskManager.Task::(prepare) Task=`4ba2cd86-b927-4e47-b9fe-db103c416e9d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:21:08,419::task::579::TaskManager.Task::(_updateState) Task=`4ba2cd86-b927-4e47-b9fe-db103c416e9d`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:21:08,419::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:21:08,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:21:08,420::task::974::TaskManager.Task::(_decref) Task=`4ba2cd86-b927-4e47-b9fe-db103c416e9d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:08,710::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:09,088::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:21:09,088::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:21:09,088::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:10,089::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:21:10,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:21:10,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:21:10,090::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:10,711::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:11,091::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:21:11,415::task::579::TaskManager.Task::(_updateState) Task=`869a4291-d2a0-44a9-93e3-6a617fd32e6b`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:21:11,415::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:21:11,415::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:21:11,416::task::1168::TaskManager.Task::(prepare) Task=`869a4291-d2a0-44a9-93e3-6a617fd32e6b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:21:11,416::task::579::TaskManager.Task::(_updateState) Task=`869a4291-d2a0-44a9-93e3-6a617fd32e6b`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:21:11,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:21:11,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:21:11,416::task::974::TaskManager.Task::(_decref) Task=`869a4291-d2a0-44a9-93e3-6a617fd32e6b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:12,093::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:21:12,093::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:12,712::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:12,713::task::579::TaskManager.Task::(_updateState) Task=`274ca2cf-391d-4e5f-9810-1c9c848efcf1`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:21:12,713::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:21:12,713::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:21:12,714::task::1168::TaskManager.Task::(prepare) Task=`274ca2cf-391d-4e5f-9810-1c9c848efcf1`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:21:12,714::task::579::TaskManager.Task::(_updateState) Task=`274ca2cf-391d-4e5f-9810-1c9c848efcf1`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:21:12,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:21:12,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:21:12,714::task::974::TaskManager.Task::(_decref) Task=`274ca2cf-391d-4e5f-9810-1c9c848efcf1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:12,716::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:21:12,716::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:21:12,717::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:12,719::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:12,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:13,094::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286474::DEBUG::2014-01-16 16:21:13,578::task::579::TaskManager.Task::(_updateState) Task=`b56195a2-f182-4b67-ace2-cef36f504929`::moving from state init -> state preparing >Thread-286474::INFO::2014-01-16 16:21:13,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286474::INFO::2014-01-16 16:21:13,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000241683', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000206726', 'lastCheck': '9.7', 'valid': True}} >Thread-286474::DEBUG::2014-01-16 16:21:13,579::task::1168::TaskManager.Task::(prepare) Task=`b56195a2-f182-4b67-ace2-cef36f504929`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000241683', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000206726', 'lastCheck': '9.7', 'valid': True}} >Thread-286474::DEBUG::2014-01-16 16:21:13,579::task::579::TaskManager.Task::(_updateState) Task=`b56195a2-f182-4b67-ace2-cef36f504929`::moving from state preparing -> state finished >Thread-286474::DEBUG::2014-01-16 16:21:13,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286474::DEBUG::2014-01-16 16:21:13,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286474::DEBUG::2014-01-16 16:21:13,579::task::974::TaskManager.Task::(_decref) Task=`b56195a2-f182-4b67-ace2-cef36f504929`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:21:13,913::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:21:13,930::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000214401 s, 19.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:21:14,095::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:14,721::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:21:14,811::task::579::TaskManager.Task::(_updateState) Task=`2a6a940c-6903-416c-8cad-254307ffb0c6`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:21:14,812::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:21:14,812::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:21:14,812::task::1168::TaskManager.Task::(prepare) Task=`2a6a940c-6903-416c-8cad-254307ffb0c6`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:21:14,813::task::579::TaskManager.Task::(_updateState) Task=`2a6a940c-6903-416c-8cad-254307ffb0c6`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:21:14,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:21:14,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:21:14,813::task::974::TaskManager.Task::(_decref) Task=`2a6a940c-6903-416c-8cad-254307ffb0c6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:15,096::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:21:15,295::task::579::TaskManager.Task::(_updateState) Task=`180a309c-c93b-4d62-8221-a73d6120dec3`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:21:15,295::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:21:15,296::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:21:15,296::task::1168::TaskManager.Task::(prepare) Task=`180a309c-c93b-4d62-8221-a73d6120dec3`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:21:15,296::task::579::TaskManager.Task::(_updateState) Task=`180a309c-c93b-4d62-8221-a73d6120dec3`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:21:15,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:21:15,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:21:15,296::task::974::TaskManager.Task::(_decref) Task=`180a309c-c93b-4d62-8221-a73d6120dec3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:16,098::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:21:16,363::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:21:16,379::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00038172 s, 956 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:21:16,723::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:17,099::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:17,724::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:18,100::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:21:18,101::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:18,726::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:21:18,989::task::579::TaskManager.Task::(_updateState) Task=`5b5addae-14ba-459a-8653-e664b55b118d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:21:18,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:21:18,989::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:21:18,990::task::1168::TaskManager.Task::(prepare) Task=`5b5addae-14ba-459a-8653-e664b55b118d`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:21:18,990::task::579::TaskManager.Task::(_updateState) Task=`5b5addae-14ba-459a-8653-e664b55b118d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:21:18,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:21:18,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:21:18,990::task::974::TaskManager.Task::(_decref) Task=`5b5addae-14ba-459a-8653-e664b55b118d`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:21:18,990::task::579::TaskManager.Task::(_updateState) Task=`0f3d2f0d-4bee-46b2-adc9-928f2dc4346e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:21:18,991::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:21:18,991::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:21:18,991::task::1168::TaskManager.Task::(prepare) Task=`0f3d2f0d-4bee-46b2-adc9-928f2dc4346e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:21:18,991::task::579::TaskManager.Task::(_updateState) Task=`0f3d2f0d-4bee-46b2-adc9-928f2dc4346e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:21:18,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:21:18,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:21:18,991::task::974::TaskManager.Task::(_decref) Task=`0f3d2f0d-4bee-46b2-adc9-928f2dc4346e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:19,102::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:20,103::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:20,727::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:21,104::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:22,105::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:22,729::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:22,730::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:21:22,968::task::579::TaskManager.Task::(_updateState) Task=`fa1556b7-e7eb-4207-9b5b-7b0cd8164f62`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:21:22,968::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:21:22,968::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:21:22,968::task::1168::TaskManager.Task::(prepare) Task=`fa1556b7-e7eb-4207-9b5b-7b0cd8164f62`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:21:22,968::task::579::TaskManager.Task::(_updateState) Task=`fa1556b7-e7eb-4207-9b5b-7b0cd8164f62`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:21:22,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:21:22,969::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:21:22,969::task::974::TaskManager.Task::(_decref) Task=`fa1556b7-e7eb-4207-9b5b-7b0cd8164f62`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:23,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:21:23,107::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:21:23,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:21:23,780::task::579::TaskManager.Task::(_updateState) Task=`ffd618f5-b9ff-47b3-8fa1-759ee38365ed`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:21:23,780::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:21:23,780::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:21:23,781::task::1168::TaskManager.Task::(prepare) Task=`ffd618f5-b9ff-47b3-8fa1-759ee38365ed`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:21:23,781::task::579::TaskManager.Task::(_updateState) Task=`ffd618f5-b9ff-47b3-8fa1-759ee38365ed`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:21:23,781::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:21:23,781::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:21:23,781::task::974::TaskManager.Task::(_decref) Task=`ffd618f5-b9ff-47b3-8fa1-759ee38365ed`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:21:23,937::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:21:23,954::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000259521 s, 15.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:21:24,108::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:21:24,108::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:24,731::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:25,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:21:25,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:21:25,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:26,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:21:26,110::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:21:26,387::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:21:26,403::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000312259 s, 1.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:21:26,465::task::579::TaskManager.Task::(_updateState) Task=`1c74d73a-b39b-42c5-ae36-08014807e43c`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:21:26,465::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:21:26,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:21:26,466::task::1168::TaskManager.Task::(prepare) Task=`1c74d73a-b39b-42c5-ae36-08014807e43c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:21:26,466::task::579::TaskManager.Task::(_updateState) Task=`1c74d73a-b39b-42c5-ae36-08014807e43c`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:21:26,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:21:26,466::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:21:26,466::task::974::TaskManager.Task::(_decref) Task=`1c74d73a-b39b-42c5-ae36-08014807e43c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:21:26,510::task::579::TaskManager.Task::(_updateState) Task=`1ad5d944-314d-4bc3-90dc-86ec4f6a2eed`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:21:26,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:21:26,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:21:26,512::task::1168::TaskManager.Task::(prepare) Task=`1ad5d944-314d-4bc3-90dc-86ec4f6a2eed`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:21:26,512::task::579::TaskManager.Task::(_updateState) Task=`1ad5d944-314d-4bc3-90dc-86ec4f6a2eed`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:21:26,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:21:26,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:21:26,512::task::974::TaskManager.Task::(_decref) Task=`1ad5d944-314d-4bc3-90dc-86ec4f6a2eed`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:26,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:27,111::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:21:27,111::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:27,735::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:21:27,736::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:21:27,737::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:28,112::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:28,738::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:29,114::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:21:29,114::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286480::DEBUG::2014-01-16 16:21:29,321::task::579::TaskManager.Task::(_updateState) Task=`3203f104-6ca0-4d53-b3ce-fdf2808c88a7`::moving from state init -> state preparing >Thread-286480::INFO::2014-01-16 16:21:29,322::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286480::INFO::2014-01-16 16:21:29,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312259', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259521', 'lastCheck': '5.4', 'valid': True}} >Thread-286480::DEBUG::2014-01-16 16:21:29,322::task::1168::TaskManager.Task::(prepare) Task=`3203f104-6ca0-4d53-b3ce-fdf2808c88a7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312259', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259521', 'lastCheck': '5.4', 'valid': True}} >Thread-286480::DEBUG::2014-01-16 16:21:29,322::task::579::TaskManager.Task::(_updateState) Task=`3203f104-6ca0-4d53-b3ce-fdf2808c88a7`::moving from state preparing -> state finished >Thread-286480::DEBUG::2014-01-16 16:21:29,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286480::DEBUG::2014-01-16 16:21:29,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286480::DEBUG::2014-01-16 16:21:29,322::task::974::TaskManager.Task::(_decref) Task=`3203f104-6ca0-4d53-b3ce-fdf2808c88a7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:30,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:21:30,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:30,739::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:31,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:21:31,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:21:31,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:21:31,116::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:21:31,486::task::579::TaskManager.Task::(_updateState) Task=`4f7315f2-f2a7-4a9a-9311-c2d6f3925c97`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:21:31,486::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:21:31,486::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:21:31,486::task::1168::TaskManager.Task::(prepare) Task=`4f7315f2-f2a7-4a9a-9311-c2d6f3925c97`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:21:31,487::task::579::TaskManager.Task::(_updateState) Task=`4f7315f2-f2a7-4a9a-9311-c2d6f3925c97`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:21:31,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:21:31,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:21:31,487::task::974::TaskManager.Task::(_decref) Task=`4f7315f2-f2a7-4a9a-9311-c2d6f3925c97`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:32,118::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:21:32,118::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:21:32,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:32,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:32,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:33,119::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:21:33,119::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:21:33,960::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:21:33,976::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260991 s, 15.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:21:34,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:21:34,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:21:34,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:21:34,121::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:21:34,226::task::579::TaskManager.Task::(_updateState) Task=`61efa5cd-7881-44cd-8dca-1a54552af828`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:21:34,226::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:21:34,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:21:34,227::task::1168::TaskManager.Task::(prepare) Task=`61efa5cd-7881-44cd-8dca-1a54552af828`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:21:34,227::task::579::TaskManager.Task::(_updateState) Task=`61efa5cd-7881-44cd-8dca-1a54552af828`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:21:34,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:21:34,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:21:34,228::task::974::TaskManager.Task::(_decref) Task=`61efa5cd-7881-44cd-8dca-1a54552af828`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:34,743::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:21:34,948::task::579::TaskManager.Task::(_updateState) Task=`88e8902f-d399-4f68-aa24-a6639cedecae`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:21:34,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:21:34,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:21:34,949::task::1168::TaskManager.Task::(prepare) Task=`88e8902f-d399-4f68-aa24-a6639cedecae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:21:34,949::task::579::TaskManager.Task::(_updateState) Task=`88e8902f-d399-4f68-aa24-a6639cedecae`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:21:34,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:21:34,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:21:34,950::task::974::TaskManager.Task::(_decref) Task=`88e8902f-d399-4f68-aa24-a6639cedecae`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:21:35,012::task::579::TaskManager.Task::(_updateState) Task=`a59b4804-f3f2-478b-9b12-13db20b21a4b`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:21:35,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:21:35,013::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:21:35,013::task::1168::TaskManager.Task::(prepare) Task=`a59b4804-f3f2-478b-9b12-13db20b21a4b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:21:35,013::task::579::TaskManager.Task::(_updateState) Task=`a59b4804-f3f2-478b-9b12-13db20b21a4b`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:21:35,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:21:35,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:21:35,013::task::974::TaskManager.Task::(_decref) Task=`a59b4804-f3f2-478b-9b12-13db20b21a4b`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:21:35,029::task::579::TaskManager.Task::(_updateState) Task=`4f16bd78-c1a3-458b-939c-6c04cbf92620`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:21:35,029::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:21:35,029::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:21:35,029::task::1168::TaskManager.Task::(prepare) Task=`4f16bd78-c1a3-458b-939c-6c04cbf92620`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:21:35,030::task::579::TaskManager.Task::(_updateState) Task=`4f16bd78-c1a3-458b-939c-6c04cbf92620`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:21:35,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:21:35,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:21:35,030::task::974::TaskManager.Task::(_decref) Task=`4f16bd78-c1a3-458b-939c-6c04cbf92620`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:35,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:21:35,895::task::579::TaskManager.Task::(_updateState) Task=`5aeb8e91-73fc-4e42-b7ad-047547f7208a`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:21:35,895::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:21:35,896::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:21:35,896::task::1168::TaskManager.Task::(prepare) Task=`5aeb8e91-73fc-4e42-b7ad-047547f7208a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:21:35,897::task::579::TaskManager.Task::(_updateState) Task=`5aeb8e91-73fc-4e42-b7ad-047547f7208a`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:21:35,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:21:35,897::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:21:35,897::task::974::TaskManager.Task::(_decref) Task=`5aeb8e91-73fc-4e42-b7ad-047547f7208a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:36,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:21:36,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:21:36,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:21:36,124::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:36,124::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:21:36,125::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-12152::DEBUG::2014-01-16 16:21:36,236::task::579::TaskManager.Task::(_updateState) Task=`1a2c5f7e-3f5b-486f-9418-4365d2ef8344`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:21:36,236::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:21:36,236::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:21:36,237::task::1168::TaskManager.Task::(prepare) Task=`1a2c5f7e-3f5b-486f-9418-4365d2ef8344`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:21:36,237::task::579::TaskManager.Task::(_updateState) Task=`1a2c5f7e-3f5b-486f-9418-4365d2ef8344`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:21:36,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:21:36,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:21:36,237::task::974::TaskManager.Task::(_decref) Task=`1a2c5f7e-3f5b-486f-9418-4365d2ef8344`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:21:36,411::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:21:36,427::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000259765 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:21:36,744::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:37,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:21:37,291::task::579::TaskManager.Task::(_updateState) Task=`f9f80bc4-ba43-45b5-8b21-745f93751697`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:21:37,291::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:21:37,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:21:37,291::task::1168::TaskManager.Task::(prepare) Task=`f9f80bc4-ba43-45b5-8b21-745f93751697`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:21:37,292::task::579::TaskManager.Task::(_updateState) Task=`f9f80bc4-ba43-45b5-8b21-745f93751697`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:21:37,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:21:37,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:21:37,292::task::974::TaskManager.Task::(_decref) Task=`f9f80bc4-ba43-45b5-8b21-745f93751697`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:21:37,292::task::579::TaskManager.Task::(_updateState) Task=`67b93ee2-019f-4861-865d-435e04be029c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:21:37,292::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:21:37,293::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:21:37,293::task::1168::TaskManager.Task::(prepare) Task=`67b93ee2-019f-4861-865d-435e04be029c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:21:37,293::task::579::TaskManager.Task::(_updateState) Task=`67b93ee2-019f-4861-865d-435e04be029c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:21:37,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:21:37,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:21:37,293::task::974::TaskManager.Task::(_decref) Task=`67b93ee2-019f-4861-865d-435e04be029c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:21:37,293::task::579::TaskManager.Task::(_updateState) Task=`5c062472-cb00-4f6a-bd88-159c7abbd79c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:21:37,294::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:21:37,294::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:21:37,294::task::1168::TaskManager.Task::(prepare) Task=`5c062472-cb00-4f6a-bd88-159c7abbd79c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:21:37,294::task::579::TaskManager.Task::(_updateState) Task=`5c062472-cb00-4f6a-bd88-159c7abbd79c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:21:37,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:21:37,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:21:37,295::task::974::TaskManager.Task::(_decref) Task=`5c062472-cb00-4f6a-bd88-159c7abbd79c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:21:37,746::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:38,127::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:21:38,127::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:21:38,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:38,748::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:39,129::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:21:39,129::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:21:39,129::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:40,130::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:21:40,130::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:21:40,130::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:21:40,130::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:40,749::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:41,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:42,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:21:42,133::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:42,752::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:42,754::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:21:42,754::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:21:42,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:43,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:21:43,915::task::579::TaskManager.Task::(_updateState) Task=`0308810b-f5c1-4e56-a02f-b1ecfc9ae636`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:21:43,915::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:21:43,915::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:21:43,915::task::1168::TaskManager.Task::(prepare) Task=`0308810b-f5c1-4e56-a02f-b1ecfc9ae636`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:21:43,916::task::579::TaskManager.Task::(_updateState) Task=`0308810b-f5c1-4e56-a02f-b1ecfc9ae636`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:21:43,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:21:43,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:21:43,916::task::974::TaskManager.Task::(_decref) Task=`0308810b-f5c1-4e56-a02f-b1ecfc9ae636`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:21:43,982::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:21:44,001::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235463 s, 17.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:21:44,136::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:44,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:45,137::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286486::DEBUG::2014-01-16 16:21:45,490::task::579::TaskManager.Task::(_updateState) Task=`7e28e633-b6d0-4efa-b080-d7b1b823eed2`::moving from state init -> state preparing >Thread-286486::INFO::2014-01-16 16:21:45,491::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286486::INFO::2014-01-16 16:21:45,491::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259765', 'lastCheck': '9.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235463', 'lastCheck': '1.5', 'valid': True}} >Thread-286486::DEBUG::2014-01-16 16:21:45,491::task::1168::TaskManager.Task::(prepare) Task=`7e28e633-b6d0-4efa-b080-d7b1b823eed2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259765', 'lastCheck': '9.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235463', 'lastCheck': '1.5', 'valid': True}} >Thread-286486::DEBUG::2014-01-16 16:21:45,491::task::579::TaskManager.Task::(_updateState) Task=`7e28e633-b6d0-4efa-b080-d7b1b823eed2`::moving from state preparing -> state finished >Thread-286486::DEBUG::2014-01-16 16:21:45,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286486::DEBUG::2014-01-16 16:21:45,491::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286486::DEBUG::2014-01-16 16:21:45,492::task::974::TaskManager.Task::(_decref) Task=`7e28e633-b6d0-4efa-b080-d7b1b823eed2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:46,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:21:46,435::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:21:46,451::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000323654 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:21:46,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:47,139::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:47,760::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:21:48,085::task::579::TaskManager.Task::(_updateState) Task=`29ad6a52-faee-4589-aa55-5e3ec635b6e6`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:21:48,086::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:21:48,086::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:21:48,086::task::1168::TaskManager.Task::(prepare) Task=`29ad6a52-faee-4589-aa55-5e3ec635b6e6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:21:48,087::task::579::TaskManager.Task::(_updateState) Task=`29ad6a52-faee-4589-aa55-5e3ec635b6e6`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:21:48,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:21:48,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:21:48,087::task::974::TaskManager.Task::(_decref) Task=`29ad6a52-faee-4589-aa55-5e3ec635b6e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:48,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:21:48,141::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:48,761::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:49,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:50,143::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:50,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:51,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:52,146::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:52,763::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:21:52,765::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:21:52,840::task::579::TaskManager.Task::(_updateState) Task=`722b0d1d-1b46-465b-b845-3b0360ef255b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:21:52,840::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:21:52,841::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:21:52,841::task::1168::TaskManager.Task::(prepare) Task=`722b0d1d-1b46-465b-b845-3b0360ef255b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:21:52,841::task::579::TaskManager.Task::(_updateState) Task=`722b0d1d-1b46-465b-b845-3b0360ef255b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:21:52,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:21:52,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:21:52,841::task::974::TaskManager.Task::(_decref) Task=`722b0d1d-1b46-465b-b845-3b0360ef255b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:21:52,842::task::579::TaskManager.Task::(_updateState) Task=`23511bdf-a805-4839-9072-0c3269bc6b80`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:21:52,842::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:21:52,842::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:21:52,843::task::1168::TaskManager.Task::(prepare) Task=`23511bdf-a805-4839-9072-0c3269bc6b80`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:21:52,843::task::579::TaskManager.Task::(_updateState) Task=`23511bdf-a805-4839-9072-0c3269bc6b80`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:21:52,843::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:21:52,843::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:21:52,843::task::974::TaskManager.Task::(_decref) Task=`23511bdf-a805-4839-9072-0c3269bc6b80`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:21:52,844::task::579::TaskManager.Task::(_updateState) Task=`532d1d5f-a06b-4677-9002-bad90a001a2c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:21:52,844::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:21:52,844::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:21:52,844::task::1168::TaskManager.Task::(prepare) Task=`532d1d5f-a06b-4677-9002-bad90a001a2c`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:21:52,844::task::579::TaskManager.Task::(_updateState) Task=`532d1d5f-a06b-4677-9002-bad90a001a2c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:21:52,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:21:52,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:21:52,845::task::974::TaskManager.Task::(_decref) Task=`532d1d5f-a06b-4677-9002-bad90a001a2c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:53,146::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:21:53,147::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:21:53,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:21:54,007::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:21:54,025::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000314573 s, 13.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:21:54,147::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:21:54,148::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:54,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:21:54,926::task::579::TaskManager.Task::(_updateState) Task=`420aa104-ab91-45fb-a7cd-5334344c8092`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:21:54,926::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:21:54,926::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:21:54,926::task::1168::TaskManager.Task::(prepare) Task=`420aa104-ab91-45fb-a7cd-5334344c8092`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:21:54,927::task::579::TaskManager.Task::(_updateState) Task=`420aa104-ab91-45fb-a7cd-5334344c8092`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:21:54,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:21:54,927::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:21:54,927::task::974::TaskManager.Task::(_decref) Task=`420aa104-ab91-45fb-a7cd-5334344c8092`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:21:55,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:21:55,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:21:55,149::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:21:56,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:21:56,151::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:21:56,459::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:21:56,475::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000288602 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:21:56,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:57,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:21:57,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:57,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:21:57,770::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:21:57,771::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:58,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:21:58,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:21:59,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:21:59,155::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:21:59,250::task::579::TaskManager.Task::(_updateState) Task=`0a03c761-dd73-41c5-824e-e6324f30ad29`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:21:59,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:21:59,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:21:59,251::task::1168::TaskManager.Task::(prepare) Task=`0a03c761-dd73-41c5-824e-e6324f30ad29`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:21:59,251::task::579::TaskManager.Task::(_updateState) Task=`0a03c761-dd73-41c5-824e-e6324f30ad29`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:21:59,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:21:59,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:21:59,251::task::974::TaskManager.Task::(_decref) Task=`0a03c761-dd73-41c5-824e-e6324f30ad29`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:21:59,252::task::579::TaskManager.Task::(_updateState) Task=`558a7781-1e2d-4a21-ac87-240c1a1a51da`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:21:59,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:21:59,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:21:59,252::task::1168::TaskManager.Task::(prepare) Task=`558a7781-1e2d-4a21-ac87-240c1a1a51da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:21:59,252::task::579::TaskManager.Task::(_updateState) Task=`558a7781-1e2d-4a21-ac87-240c1a1a51da`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:21:59,252::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:21:59,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:21:59,253::task::974::TaskManager.Task::(_decref) Task=`558a7781-1e2d-4a21-ac87-240c1a1a51da`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:00,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:22:00,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:00,773::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:01,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:22:01,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:22:01,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:22:01,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:22:02,045::task::579::TaskManager.Task::(_updateState) Task=`bb48d065-6030-484f-8380-0ba04a4f5ca2`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:22:02,045::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:22:02,046::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:22:02,046::task::1168::TaskManager.Task::(prepare) Task=`bb48d065-6030-484f-8380-0ba04a4f5ca2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:22:02,046::task::579::TaskManager.Task::(_updateState) Task=`bb48d065-6030-484f-8380-0ba04a4f5ca2`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:22:02,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:22:02,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:22:02,047::task::974::TaskManager.Task::(_decref) Task=`bb48d065-6030-484f-8380-0ba04a4f5ca2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:02,159::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:22:02,160::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:22:02,160::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286492::DEBUG::2014-01-16 16:22:02,184::task::579::TaskManager.Task::(_updateState) Task=`c6ace165-db37-4371-ba81-dee1f35d26fc`::moving from state init -> state preparing >Thread-286492::INFO::2014-01-16 16:22:02,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286492::INFO::2014-01-16 16:22:02,185::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288602', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314573', 'lastCheck': '8.2', 'valid': True}} >Thread-286492::DEBUG::2014-01-16 16:22:02,185::task::1168::TaskManager.Task::(prepare) Task=`c6ace165-db37-4371-ba81-dee1f35d26fc`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288602', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314573', 'lastCheck': '8.2', 'valid': True}} >Thread-286492::DEBUG::2014-01-16 16:22:02,185::task::579::TaskManager.Task::(_updateState) Task=`c6ace165-db37-4371-ba81-dee1f35d26fc`::moving from state preparing -> state finished >Thread-286492::DEBUG::2014-01-16 16:22:02,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286492::DEBUG::2014-01-16 16:22:02,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286492::DEBUG::2014-01-16 16:22:02,185::task::974::TaskManager.Task::(_decref) Task=`c6ace165-db37-4371-ba81-dee1f35d26fc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:02,775::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:02,776::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:03,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:22:03,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:22:04,030::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:22:04,047::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000318468 s, 12.9 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 16:22:04,101::task::579::TaskManager.Task::(_updateState) Task=`b05fbbab-fe98-4fd0-9997-17078eda3dc8`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:22:04,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:22:04,102::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:22:04,103::task::1168::TaskManager.Task::(prepare) Task=`b05fbbab-fe98-4fd0-9997-17078eda3dc8`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:22:04,105::task::579::TaskManager.Task::(_updateState) Task=`b05fbbab-fe98-4fd0-9997-17078eda3dc8`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:22:04,105::task::579::TaskManager.Task::(_updateState) Task=`2eb011b5-19ed-4068-9f91-1c8196d906a9`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 16:22:04,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:22:04,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::INFO::2014-01-16 16:22:04,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 16:22:04,108::task::974::TaskManager.Task::(_decref) Task=`b05fbbab-fe98-4fd0-9997-17078eda3dc8`::ref 0 aborting False >Thread-251782::INFO::2014-01-16 16:22:04,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:22:04,110::task::1168::TaskManager.Task::(prepare) Task=`2eb011b5-19ed-4068-9f91-1c8196d906a9`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:22:04,110::task::579::TaskManager.Task::(_updateState) Task=`2eb011b5-19ed-4068-9f91-1c8196d906a9`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:22:04,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:22:04,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:22:04,111::task::974::TaskManager.Task::(_decref) Task=`2eb011b5-19ed-4068-9f91-1c8196d906a9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:04,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:22:04,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:22:04,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:22:04,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:04,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:05,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:22:05,350::task::579::TaskManager.Task::(_updateState) Task=`0bfb0ba3-41c2-40cc-904d-9d959d867c2d`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:22:05,350::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:22:05,350::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:22:05,351::task::1168::TaskManager.Task::(prepare) Task=`0bfb0ba3-41c2-40cc-904d-9d959d867c2d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:22:05,351::task::579::TaskManager.Task::(_updateState) Task=`0bfb0ba3-41c2-40cc-904d-9d959d867c2d`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:22:05,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:22:05,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:22:05,351::task::974::TaskManager.Task::(_decref) Task=`0bfb0ba3-41c2-40cc-904d-9d959d867c2d`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:22:05,352::task::579::TaskManager.Task::(_updateState) Task=`878b8311-2c31-4380-a053-e4bd03048dfc`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:22:05,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:22:05,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:22:05,352::task::1168::TaskManager.Task::(prepare) Task=`878b8311-2c31-4380-a053-e4bd03048dfc`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:22:05,352::task::579::TaskManager.Task::(_updateState) Task=`878b8311-2c31-4380-a053-e4bd03048dfc`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:22:05,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:22:05,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:22:05,353::task::974::TaskManager.Task::(_decref) Task=`878b8311-2c31-4380-a053-e4bd03048dfc`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:22:05,437::task::579::TaskManager.Task::(_updateState) Task=`510785c5-e3db-462a-8b82-4f66acaa548e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:22:05,437::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:22:05,438::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:22:05,438::task::1168::TaskManager.Task::(prepare) Task=`510785c5-e3db-462a-8b82-4f66acaa548e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:22:05,438::task::579::TaskManager.Task::(_updateState) Task=`510785c5-e3db-462a-8b82-4f66acaa548e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:22:05,438::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:22:05,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:22:05,438::task::974::TaskManager.Task::(_decref) Task=`510785c5-e3db-462a-8b82-4f66acaa548e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:22:05,439::task::579::TaskManager.Task::(_updateState) Task=`ba9bbc7a-4be5-4842-bd6e-78246ac09386`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:22:05,439::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:22:05,439::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:22:05,439::task::1168::TaskManager.Task::(prepare) Task=`ba9bbc7a-4be5-4842-bd6e-78246ac09386`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:22:05,439::task::579::TaskManager.Task::(_updateState) Task=`ba9bbc7a-4be5-4842-bd6e-78246ac09386`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:22:05,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:22:05,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:22:05,440::task::974::TaskManager.Task::(_decref) Task=`ba9bbc7a-4be5-4842-bd6e-78246ac09386`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:06,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:22:06,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:22:06,166::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:22:06,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:06,166::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:22:06,166::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:22:06,351::task::579::TaskManager.Task::(_updateState) Task=`1f30c277-a5ee-4e47-93b6-65b4b2249a3b`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:22:06,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:22:06,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:22:06,352::task::1168::TaskManager.Task::(prepare) Task=`1f30c277-a5ee-4e47-93b6-65b4b2249a3b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:22:06,352::task::579::TaskManager.Task::(_updateState) Task=`1f30c277-a5ee-4e47-93b6-65b4b2249a3b`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:22:06,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:22:06,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:22:06,352::task::974::TaskManager.Task::(_decref) Task=`1f30c277-a5ee-4e47-93b6-65b4b2249a3b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:22:06,484::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:22:06,502::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000282352 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:22:06,523::task::579::TaskManager.Task::(_updateState) Task=`48f5645b-d872-4e5b-92df-cdc4475ff2fd`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:22:06,523::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:22:06,523::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:22:06,524::task::1168::TaskManager.Task::(prepare) Task=`48f5645b-d872-4e5b-92df-cdc4475ff2fd`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:22:06,524::task::579::TaskManager.Task::(_updateState) Task=`48f5645b-d872-4e5b-92df-cdc4475ff2fd`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:22:06,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:22:06,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:22:06,524::task::974::TaskManager.Task::(_decref) Task=`48f5645b-d872-4e5b-92df-cdc4475ff2fd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:06,778::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:07,168::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:22:07,498::task::579::TaskManager.Task::(_updateState) Task=`2cb6e7c8-acae-49bd-a27d-770d961eb86d`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:22:07,498::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:22:07,499::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:22:07,499::task::1168::TaskManager.Task::(prepare) Task=`2cb6e7c8-acae-49bd-a27d-770d961eb86d`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:22:07,499::task::579::TaskManager.Task::(_updateState) Task=`2cb6e7c8-acae-49bd-a27d-770d961eb86d`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:22:07,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:22:07,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:22:07,499::task::974::TaskManager.Task::(_decref) Task=`2cb6e7c8-acae-49bd-a27d-770d961eb86d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:07,780::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:08,169::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:22:08,169::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:22:08,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:22:08,590::task::579::TaskManager.Task::(_updateState) Task=`ad6ef9a5-e424-4262-9419-7f2e2c8eb3e5`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:22:08,591::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:22:08,591::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:22:08,591::task::1168::TaskManager.Task::(prepare) Task=`ad6ef9a5-e424-4262-9419-7f2e2c8eb3e5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:22:08,591::task::579::TaskManager.Task::(_updateState) Task=`ad6ef9a5-e424-4262-9419-7f2e2c8eb3e5`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:22:08,591::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:22:08,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:22:08,592::task::974::TaskManager.Task::(_decref) Task=`ad6ef9a5-e424-4262-9419-7f2e2c8eb3e5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:08,781::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:09,171::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:22:09,171::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:22:09,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:10,172::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:22:10,172::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:22:10,172::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:22:10,172::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:10,782::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:11,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:22:11,599::task::579::TaskManager.Task::(_updateState) Task=`bb77a4f7-b546-4c0c-97ab-c4017a184abb`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:22:11,600::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:22:11,600::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:22:11,600::task::1168::TaskManager.Task::(prepare) Task=`bb77a4f7-b546-4c0c-97ab-c4017a184abb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:22:11,600::task::579::TaskManager.Task::(_updateState) Task=`bb77a4f7-b546-4c0c-97ab-c4017a184abb`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:22:11,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:22:11,601::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:22:11,601::task::974::TaskManager.Task::(_decref) Task=`bb77a4f7-b546-4c0c-97ab-c4017a184abb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:12,175::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:22:12,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:12,784::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:12,784::task::579::TaskManager.Task::(_updateState) Task=`bc5845ec-9950-443b-b006-1212d3856df8`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:22:12,785::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:22:12,785::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:22:12,785::task::1168::TaskManager.Task::(prepare) Task=`bc5845ec-9950-443b-b006-1212d3856df8`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:22:12,785::task::579::TaskManager.Task::(_updateState) Task=`bc5845ec-9950-443b-b006-1212d3856df8`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:22:12,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:22:12,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:22:12,786::task::974::TaskManager.Task::(_decref) Task=`bc5845ec-9950-443b-b006-1212d3856df8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:12,788::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:22:12,788::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:22:12,790::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:12,792::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:12,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:13,176::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:22:14,052::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:22:14,068::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210614 s, 19.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:22:14,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:14,795::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:22:14,985::task::579::TaskManager.Task::(_updateState) Task=`726fc3fe-d616-4514-8b26-3b7dd7312d2a`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:22:14,985::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:22:14,986::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:22:14,986::task::1168::TaskManager.Task::(prepare) Task=`726fc3fe-d616-4514-8b26-3b7dd7312d2a`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:22:14,986::task::579::TaskManager.Task::(_updateState) Task=`726fc3fe-d616-4514-8b26-3b7dd7312d2a`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:22:14,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:22:14,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:22:14,986::task::974::TaskManager.Task::(_decref) Task=`726fc3fe-d616-4514-8b26-3b7dd7312d2a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:15,178::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:22:15,371::task::579::TaskManager.Task::(_updateState) Task=`977f396a-754e-4d29-9b79-d4d9d1300e55`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:22:15,372::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:22:15,372::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:22:15,372::task::1168::TaskManager.Task::(prepare) Task=`977f396a-754e-4d29-9b79-d4d9d1300e55`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:22:15,372::task::579::TaskManager.Task::(_updateState) Task=`977f396a-754e-4d29-9b79-d4d9d1300e55`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:22:15,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:22:15,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:22:15,373::task::974::TaskManager.Task::(_decref) Task=`977f396a-754e-4d29-9b79-d4d9d1300e55`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:16,180::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:22:16,510::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:22:16,529::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000316799 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:22:16,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:17,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:17,798::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286498::DEBUG::2014-01-16 16:22:18,122::task::579::TaskManager.Task::(_updateState) Task=`96e4a733-c260-439a-b31e-66a6d082d8f6`::moving from state init -> state preparing >Thread-286498::INFO::2014-01-16 16:22:18,122::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286498::INFO::2014-01-16 16:22:18,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316799', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000210614', 'lastCheck': '4.1', 'valid': True}} >Thread-286498::DEBUG::2014-01-16 16:22:18,122::task::1168::TaskManager.Task::(prepare) Task=`96e4a733-c260-439a-b31e-66a6d082d8f6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316799', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000210614', 'lastCheck': '4.1', 'valid': True}} >Thread-286498::DEBUG::2014-01-16 16:22:18,123::task::579::TaskManager.Task::(_updateState) Task=`96e4a733-c260-439a-b31e-66a6d082d8f6`::moving from state preparing -> state finished >Thread-286498::DEBUG::2014-01-16 16:22:18,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286498::DEBUG::2014-01-16 16:22:18,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286498::DEBUG::2014-01-16 16:22:18,123::task::974::TaskManager.Task::(_decref) Task=`96e4a733-c260-439a-b31e-66a6d082d8f6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:18,182::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:22:18,182::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:18,799::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:19,184::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:22:19,366::task::579::TaskManager.Task::(_updateState) Task=`ae4d2f71-f370-4778-a108-7d364289cf65`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:22:19,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:22:19,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:22:19,366::task::1168::TaskManager.Task::(prepare) Task=`ae4d2f71-f370-4778-a108-7d364289cf65`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:22:19,366::task::579::TaskManager.Task::(_updateState) Task=`ae4d2f71-f370-4778-a108-7d364289cf65`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:22:19,367::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:22:19,367::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:22:19,367::task::974::TaskManager.Task::(_decref) Task=`ae4d2f71-f370-4778-a108-7d364289cf65`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:22:19,367::task::579::TaskManager.Task::(_updateState) Task=`87830fdd-6e18-4ed1-96db-ab1db0fdf800`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:22:19,367::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:22:19,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:22:19,368::task::1168::TaskManager.Task::(prepare) Task=`87830fdd-6e18-4ed1-96db-ab1db0fdf800`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:22:19,368::task::579::TaskManager.Task::(_updateState) Task=`87830fdd-6e18-4ed1-96db-ab1db0fdf800`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:22:19,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:22:19,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:22:19,369::task::974::TaskManager.Task::(_decref) Task=`87830fdd-6e18-4ed1-96db-ab1db0fdf800`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:20,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:20,800::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:21,186::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:22,188::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:22,802::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:22,803::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:22:23,143::task::579::TaskManager.Task::(_updateState) Task=`fb6a49e3-0125-4374-98be-1c5119fe4dfe`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:22:23,143::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:22:23,144::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:22:23,144::task::1168::TaskManager.Task::(prepare) Task=`fb6a49e3-0125-4374-98be-1c5119fe4dfe`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:22:23,144::task::579::TaskManager.Task::(_updateState) Task=`fb6a49e3-0125-4374-98be-1c5119fe4dfe`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:22:23,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:22:23,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:22:23,145::task::974::TaskManager.Task::(_decref) Task=`fb6a49e3-0125-4374-98be-1c5119fe4dfe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:23,189::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:22:23,189::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:22:23,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:22:23,844::task::579::TaskManager.Task::(_updateState) Task=`ac24d36d-e02e-491e-a0e4-e6f9086362eb`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:22:23,844::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:22:23,845::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:22:23,845::task::1168::TaskManager.Task::(prepare) Task=`ac24d36d-e02e-491e-a0e4-e6f9086362eb`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:22:23,845::task::579::TaskManager.Task::(_updateState) Task=`ac24d36d-e02e-491e-a0e4-e6f9086362eb`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:22:23,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:22:23,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:22:23,846::task::974::TaskManager.Task::(_decref) Task=`ac24d36d-e02e-491e-a0e4-e6f9086362eb`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:22:24,075::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:22:24,101::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258715 s, 15.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:22:24,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:22:24,191::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:24,805::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:25,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:22:25,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:22:25,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:26,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:22:26,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:22:26,539::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:22:26,556::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000263556 s, 1.4 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:22:26,644::task::579::TaskManager.Task::(_updateState) Task=`3d5a8948-5415-43b5-8591-0ed6193513c0`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:22:26,644::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:22:26,644::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:22:26,645::task::1168::TaskManager.Task::(prepare) Task=`3d5a8948-5415-43b5-8591-0ed6193513c0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:22:26,645::task::579::TaskManager.Task::(_updateState) Task=`3d5a8948-5415-43b5-8591-0ed6193513c0`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:22:26,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:22:26,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:22:26,645::task::974::TaskManager.Task::(_decref) Task=`3d5a8948-5415-43b5-8591-0ed6193513c0`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:22:26,679::task::579::TaskManager.Task::(_updateState) Task=`509dd792-0117-47e9-8de6-477dcf0b47f7`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:22:26,680::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:22:26,680::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:22:26,680::task::1168::TaskManager.Task::(prepare) Task=`509dd792-0117-47e9-8de6-477dcf0b47f7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:22:26,680::task::579::TaskManager.Task::(_updateState) Task=`509dd792-0117-47e9-8de6-477dcf0b47f7`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:22:26,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:22:26,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:22:26,681::task::974::TaskManager.Task::(_decref) Task=`509dd792-0117-47e9-8de6-477dcf0b47f7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:26,806::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:27,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:22:27,195::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:27,808::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:22:27,809::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:22:27,817::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:28,195::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:28,818::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:29,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:22:29,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:30,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:22:30,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:30,819::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:31,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:22:31,199::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:22:31,199::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:22:31,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:22:31,674::task::579::TaskManager.Task::(_updateState) Task=`690fb80b-9d15-4b0e-834b-e986be5c72f6`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:22:31,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:22:31,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:22:31,674::task::1168::TaskManager.Task::(prepare) Task=`690fb80b-9d15-4b0e-834b-e986be5c72f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:22:31,675::task::579::TaskManager.Task::(_updateState) Task=`690fb80b-9d15-4b0e-834b-e986be5c72f6`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:22:31,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:22:31,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:22:31,675::task::974::TaskManager.Task::(_decref) Task=`690fb80b-9d15-4b0e-834b-e986be5c72f6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:32,201::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:22:32,201::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:22:32,201::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:32,821::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:32,822::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:33,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:22:33,203::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286504::DEBUG::2014-01-16 16:22:33,980::task::579::TaskManager.Task::(_updateState) Task=`5afee5ea-6bd6-42e4-b536-a66cdf54d176`::moving from state init -> state preparing >Thread-286504::INFO::2014-01-16 16:22:33,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286504::INFO::2014-01-16 16:22:33,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263556', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258715', 'lastCheck': '9.9', 'valid': True}} >Thread-286504::DEBUG::2014-01-16 16:22:33,981::task::1168::TaskManager.Task::(prepare) Task=`5afee5ea-6bd6-42e4-b536-a66cdf54d176`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263556', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258715', 'lastCheck': '9.9', 'valid': True}} >Thread-286504::DEBUG::2014-01-16 16:22:33,981::task::579::TaskManager.Task::(_updateState) Task=`5afee5ea-6bd6-42e4-b536-a66cdf54d176`::moving from state preparing -> state finished >Thread-286504::DEBUG::2014-01-16 16:22:33,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286504::DEBUG::2014-01-16 16:22:33,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286504::DEBUG::2014-01-16 16:22:33,982::task::974::TaskManager.Task::(_decref) Task=`5afee5ea-6bd6-42e4-b536-a66cdf54d176`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:22:34,109::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:22:34,134::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000244814 s, 16.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:22:34,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:22:34,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:22:34,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:22:34,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:22:34,393::task::579::TaskManager.Task::(_updateState) Task=`b0824367-6f8d-4361-a0ed-98913ee0224e`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:22:34,394::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:22:34,394::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:22:34,394::task::1168::TaskManager.Task::(prepare) Task=`b0824367-6f8d-4361-a0ed-98913ee0224e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:22:34,394::task::579::TaskManager.Task::(_updateState) Task=`b0824367-6f8d-4361-a0ed-98913ee0224e`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:22:34,395::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:22:34,395::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:22:34,395::task::974::TaskManager.Task::(_decref) Task=`b0824367-6f8d-4361-a0ed-98913ee0224e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:34,823::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:22:35,116::task::579::TaskManager.Task::(_updateState) Task=`e9198498-4f16-4bbc-b383-029f139625c2`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:22:35,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:22:35,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:22:35,117::task::1168::TaskManager.Task::(prepare) Task=`e9198498-4f16-4bbc-b383-029f139625c2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:22:35,117::task::579::TaskManager.Task::(_updateState) Task=`e9198498-4f16-4bbc-b383-029f139625c2`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:22:35,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:22:35,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:22:35,117::task::974::TaskManager.Task::(_decref) Task=`e9198498-4f16-4bbc-b383-029f139625c2`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:22:35,180::task::579::TaskManager.Task::(_updateState) Task=`b6704eeb-8fc3-4b23-a279-0dba0a03bd19`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:22:35,181::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:22:35,181::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:22:35,181::task::1168::TaskManager.Task::(prepare) Task=`b6704eeb-8fc3-4b23-a279-0dba0a03bd19`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:22:35,181::task::579::TaskManager.Task::(_updateState) Task=`b6704eeb-8fc3-4b23-a279-0dba0a03bd19`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:22:35,181::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:22:35,181::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:22:35,182::task::974::TaskManager.Task::(_decref) Task=`b6704eeb-8fc3-4b23-a279-0dba0a03bd19`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:22:35,204::task::579::TaskManager.Task::(_updateState) Task=`5c7bca7a-21bc-49ff-b2c2-c0932e5faef9`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:22:35,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:22:35,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:22:35,205::task::1168::TaskManager.Task::(prepare) Task=`5c7bca7a-21bc-49ff-b2c2-c0932e5faef9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:22:35,205::task::579::TaskManager.Task::(_updateState) Task=`5c7bca7a-21bc-49ff-b2c2-c0932e5faef9`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:22:35,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:22:35,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:22:35,205::task::974::TaskManager.Task::(_decref) Task=`5c7bca7a-21bc-49ff-b2c2-c0932e5faef9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:35,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:22:36,066::task::579::TaskManager.Task::(_updateState) Task=`60c5618c-5773-4cdc-bf12-2b34657b6aec`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:22:36,066::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:22:36,067::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:22:36,067::task::1168::TaskManager.Task::(prepare) Task=`60c5618c-5773-4cdc-bf12-2b34657b6aec`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:22:36,067::task::579::TaskManager.Task::(_updateState) Task=`60c5618c-5773-4cdc-bf12-2b34657b6aec`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:22:36,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:22:36,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:22:36,068::task::974::TaskManager.Task::(_decref) Task=`60c5618c-5773-4cdc-bf12-2b34657b6aec`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:36,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:22:36,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:22:36,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:22:36,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:36,209::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:22:36,210::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-12152::DEBUG::2014-01-16 16:22:36,416::task::579::TaskManager.Task::(_updateState) Task=`a03a84c8-d07e-4830-8f05-7d631d9ffdcf`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:22:36,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:22:36,417::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:22:36,417::task::1168::TaskManager.Task::(prepare) Task=`a03a84c8-d07e-4830-8f05-7d631d9ffdcf`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:22:36,417::task::579::TaskManager.Task::(_updateState) Task=`a03a84c8-d07e-4830-8f05-7d631d9ffdcf`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:22:36,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:22:36,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:22:36,417::task::974::TaskManager.Task::(_decref) Task=`a03a84c8-d07e-4830-8f05-7d631d9ffdcf`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:22:36,563::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:22:36,579::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000263308 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:22:36,825::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:37,211::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:22:37,575::task::579::TaskManager.Task::(_updateState) Task=`e77e45ce-1bbc-4dab-b60f-905a9683f4d5`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:22:37,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:22:37,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:22:37,576::task::1168::TaskManager.Task::(prepare) Task=`e77e45ce-1bbc-4dab-b60f-905a9683f4d5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:22:37,576::task::579::TaskManager.Task::(_updateState) Task=`e77e45ce-1bbc-4dab-b60f-905a9683f4d5`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:22:37,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:22:37,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:22:37,577::task::974::TaskManager.Task::(_decref) Task=`e77e45ce-1bbc-4dab-b60f-905a9683f4d5`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:22:37,577::task::579::TaskManager.Task::(_updateState) Task=`daab0842-6676-4fd0-835e-969ed28435f9`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:22:37,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:22:37,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:22:37,578::task::1168::TaskManager.Task::(prepare) Task=`daab0842-6676-4fd0-835e-969ed28435f9`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:22:37,578::task::579::TaskManager.Task::(_updateState) Task=`daab0842-6676-4fd0-835e-969ed28435f9`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:22:37,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:22:37,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:22:37,578::task::974::TaskManager.Task::(_decref) Task=`daab0842-6676-4fd0-835e-969ed28435f9`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:22:37,578::task::579::TaskManager.Task::(_updateState) Task=`1877b492-79f2-4013-b9e3-a9f59b6ce233`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:22:37,579::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:22:37,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:22:37,579::task::1168::TaskManager.Task::(prepare) Task=`1877b492-79f2-4013-b9e3-a9f59b6ce233`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:22:37,579::task::579::TaskManager.Task::(_updateState) Task=`1877b492-79f2-4013-b9e3-a9f59b6ce233`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:22:37,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:22:37,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:22:37,580::task::974::TaskManager.Task::(_decref) Task=`1877b492-79f2-4013-b9e3-a9f59b6ce233`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:37,826::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:38,213::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:22:38,213::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:22:38,213::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:38,827::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:39,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:22:39,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:22:39,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:40,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:22:40,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:22:40,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:22:40,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:40,828::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:41,217::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:42,218::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:22:42,219::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:42,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:42,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:22:42,831::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:22:42,833::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:43,220::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:22:44,098::task::579::TaskManager.Task::(_updateState) Task=`1741ca89-0c7f-472a-92e8-dbf3f83c02f4`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:22:44,098::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:22:44,099::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:22:44,099::task::1168::TaskManager.Task::(prepare) Task=`1741ca89-0c7f-472a-92e8-dbf3f83c02f4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:22:44,099::task::579::TaskManager.Task::(_updateState) Task=`1741ca89-0c7f-472a-92e8-dbf3f83c02f4`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:22:44,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:22:44,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:22:44,099::task::974::TaskManager.Task::(_decref) Task=`1741ca89-0c7f-472a-92e8-dbf3f83c02f4`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:22:44,139::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:22:44,164::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237694 s, 17.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:22:44,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:44,834::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:45,223::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:46,224::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:22:46,587::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:22:46,603::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308019 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:22:46,836::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:47,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:47,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:48,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:22:48,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:22:48,276::task::579::TaskManager.Task::(_updateState) Task=`e7dfcfef-f844-489a-85fa-5ccdfe57c85c`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:22:48,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:22:48,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:22:48,277::task::1168::TaskManager.Task::(prepare) Task=`e7dfcfef-f844-489a-85fa-5ccdfe57c85c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:22:48,278::task::579::TaskManager.Task::(_updateState) Task=`e7dfcfef-f844-489a-85fa-5ccdfe57c85c`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:22:48,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:22:48,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:22:48,278::task::974::TaskManager.Task::(_decref) Task=`e7dfcfef-f844-489a-85fa-5ccdfe57c85c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:22:48,845::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:49,228::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286510::DEBUG::2014-01-16 16:22:50,015::task::579::TaskManager.Task::(_updateState) Task=`a829669a-8346-41d1-9d8e-b25645202c1e`::moving from state init -> state preparing >Thread-286510::INFO::2014-01-16 16:22:50,015::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286510::INFO::2014-01-16 16:22:50,015::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308019', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237694', 'lastCheck': '5.8', 'valid': True}} >Thread-286510::DEBUG::2014-01-16 16:22:50,015::task::1168::TaskManager.Task::(prepare) Task=`a829669a-8346-41d1-9d8e-b25645202c1e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308019', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237694', 'lastCheck': '5.8', 'valid': True}} >Thread-286510::DEBUG::2014-01-16 16:22:50,015::task::579::TaskManager.Task::(_updateState) Task=`a829669a-8346-41d1-9d8e-b25645202c1e`::moving from state preparing -> state finished >Thread-286510::DEBUG::2014-01-16 16:22:50,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286510::DEBUG::2014-01-16 16:22:50,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286510::DEBUG::2014-01-16 16:22:50,016::task::974::TaskManager.Task::(_decref) Task=`a829669a-8346-41d1-9d8e-b25645202c1e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:50,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:50,847::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:51,231::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:52,232::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:52,848::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:22:52,849::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:53,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:22:53,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:22:53,233::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:22:53,430::task::579::TaskManager.Task::(_updateState) Task=`2dbd4028-6eb7-4134-affe-913889e933f5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:22:53,430::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:22:53,430::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:22:53,431::task::1168::TaskManager.Task::(prepare) Task=`2dbd4028-6eb7-4134-affe-913889e933f5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:22:53,431::task::579::TaskManager.Task::(_updateState) Task=`2dbd4028-6eb7-4134-affe-913889e933f5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:22:53,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:22:53,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:22:53,431::task::974::TaskManager.Task::(_decref) Task=`2dbd4028-6eb7-4134-affe-913889e933f5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:22:53,431::task::579::TaskManager.Task::(_updateState) Task=`02ece586-94ef-4a50-adeb-df8e764d2126`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:22:53,432::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:22:53,432::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:22:53,432::task::1168::TaskManager.Task::(prepare) Task=`02ece586-94ef-4a50-adeb-df8e764d2126`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:22:53,432::task::579::TaskManager.Task::(_updateState) Task=`02ece586-94ef-4a50-adeb-df8e764d2126`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:22:53,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:22:53,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:22:53,432::task::974::TaskManager.Task::(_decref) Task=`02ece586-94ef-4a50-adeb-df8e764d2126`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:22:53,433::task::579::TaskManager.Task::(_updateState) Task=`af60346c-bf87-4cfe-9878-3407f94d9a28`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:22:53,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:22:53,433::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:22:53,433::task::1168::TaskManager.Task::(prepare) Task=`af60346c-bf87-4cfe-9878-3407f94d9a28`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:22:53,434::task::579::TaskManager.Task::(_updateState) Task=`af60346c-bf87-4cfe-9878-3407f94d9a28`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:22:53,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:22:53,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:22:53,434::task::974::TaskManager.Task::(_decref) Task=`af60346c-bf87-4cfe-9878-3407f94d9a28`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:22:54,169::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:22:54,198::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024455 s, 16.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:22:54,235::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:22:54,235::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:54,850::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:22:55,108::task::579::TaskManager.Task::(_updateState) Task=`4288b82c-053b-4160-b9e6-a3d4f6910135`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:22:55,108::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:22:55,109::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:22:55,109::task::1168::TaskManager.Task::(prepare) Task=`4288b82c-053b-4160-b9e6-a3d4f6910135`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:22:55,109::task::579::TaskManager.Task::(_updateState) Task=`4288b82c-053b-4160-b9e6-a3d4f6910135`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:22:55,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:22:55,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:22:55,109::task::974::TaskManager.Task::(_decref) Task=`4288b82c-053b-4160-b9e6-a3d4f6910135`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:22:55,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:22:55,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:22:55,236::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:22:56,237::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:22:56,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:22:56,610::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:22:56,627::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000284622 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:22:56,852::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:57,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:22:57,238::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:57,854::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:22:57,854::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:22:57,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:58,239::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:22:58,856::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:22:59,241::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:22:59,241::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:22:59,482::task::579::TaskManager.Task::(_updateState) Task=`74bd4f1f-83fa-4b18-8522-2ab252422a5b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:22:59,482::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:22:59,483::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:22:59,483::task::1168::TaskManager.Task::(prepare) Task=`74bd4f1f-83fa-4b18-8522-2ab252422a5b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:22:59,483::task::579::TaskManager.Task::(_updateState) Task=`74bd4f1f-83fa-4b18-8522-2ab252422a5b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:22:59,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:22:59,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:22:59,484::task::974::TaskManager.Task::(_decref) Task=`74bd4f1f-83fa-4b18-8522-2ab252422a5b`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:22:59,484::task::579::TaskManager.Task::(_updateState) Task=`18fb2622-af45-436f-b932-50ae4b6a4c3c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:22:59,484::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:22:59,484::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:22:59,484::task::1168::TaskManager.Task::(prepare) Task=`18fb2622-af45-436f-b932-50ae4b6a4c3c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:22:59,484::task::579::TaskManager.Task::(_updateState) Task=`18fb2622-af45-436f-b932-50ae4b6a4c3c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:22:59,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:22:59,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:22:59,485::task::974::TaskManager.Task::(_decref) Task=`18fb2622-af45-436f-b932-50ae4b6a4c3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:00,241::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:23:00,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:00,858::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:01,243::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:23:01,243::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:23:01,243::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:23:01,244::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:23:02,221::task::579::TaskManager.Task::(_updateState) Task=`44d3f9b6-c9b0-47d0-a3e3-08aa27201cb1`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:23:02,221::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:23:02,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:23:02,222::task::1168::TaskManager.Task::(prepare) Task=`44d3f9b6-c9b0-47d0-a3e3-08aa27201cb1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:23:02,222::task::579::TaskManager.Task::(_updateState) Task=`44d3f9b6-c9b0-47d0-a3e3-08aa27201cb1`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:23:02,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:23:02,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:23:02,222::task::974::TaskManager.Task::(_decref) Task=`44d3f9b6-c9b0-47d0-a3e3-08aa27201cb1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:02,244::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:23:02,244::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:23:02,244::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:02,859::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:02,860::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:03,245::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:23:03,246::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 16:23:04,190::task::579::TaskManager.Task::(_updateState) Task=`a349bf56-4efb-4c7f-855c-bffa77a1445c`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:23:04,191::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:23:04,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:23:04,192::task::1168::TaskManager.Task::(prepare) Task=`a349bf56-4efb-4c7f-855c-bffa77a1445c`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:23:04,193::task::579::TaskManager.Task::(_updateState) Task=`0445b0ba-bd5c-4962-9460-6eaaba27e67a`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:23:04,193::task::579::TaskManager.Task::(_updateState) Task=`a349bf56-4efb-4c7f-855c-bffa77a1445c`::moving from state preparing -> state finished >Thread-53040::INFO::2014-01-16 16:23:04,193::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:23:04,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:23:04,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:23:04,194::task::974::TaskManager.Task::(_decref) Task=`a349bf56-4efb-4c7f-855c-bffa77a1445c`::ref 0 aborting False >Thread-53040::INFO::2014-01-16 16:23:04,194::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:23:04,195::task::1168::TaskManager.Task::(prepare) Task=`0445b0ba-bd5c-4962-9460-6eaaba27e67a`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:23:04,195::task::579::TaskManager.Task::(_updateState) Task=`0445b0ba-bd5c-4962-9460-6eaaba27e67a`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:23:04,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:23:04,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:23:04,195::task::974::TaskManager.Task::(_decref) Task=`0445b0ba-bd5c-4962-9460-6eaaba27e67a`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:23:04,204::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:23:04,229::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000212344 s, 19.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:23:04,246::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:23:04,247::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:23:04,247::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:23:04,247::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:04,861::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:05,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:23:05,438::task::579::TaskManager.Task::(_updateState) Task=`bb9f6fce-ec6c-4808-b368-0a82c3d63846`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:23:05,438::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:23:05,439::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:23:05,440::task::1168::TaskManager.Task::(prepare) Task=`bb9f6fce-ec6c-4808-b368-0a82c3d63846`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:23:05,440::task::579::TaskManager.Task::(_updateState) Task=`bb9f6fce-ec6c-4808-b368-0a82c3d63846`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:23:05,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:23:05,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:23:05,440::task::974::TaskManager.Task::(_decref) Task=`bb9f6fce-ec6c-4808-b368-0a82c3d63846`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:23:05,441::task::579::TaskManager.Task::(_updateState) Task=`dbc44767-a580-4597-8ab7-c96f11d6255a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:23:05,441::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:23:05,441::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:23:05,441::task::1168::TaskManager.Task::(prepare) Task=`dbc44767-a580-4597-8ab7-c96f11d6255a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:23:05,441::task::579::TaskManager.Task::(_updateState) Task=`dbc44767-a580-4597-8ab7-c96f11d6255a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:23:05,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:23:05,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:23:05,442::task::974::TaskManager.Task::(_decref) Task=`dbc44767-a580-4597-8ab7-c96f11d6255a`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:23:05,663::task::579::TaskManager.Task::(_updateState) Task=`8a5d769d-ebeb-447d-b1cc-0ad6683b33a9`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:23:05,664::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:23:05,664::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:23:05,664::task::1168::TaskManager.Task::(prepare) Task=`8a5d769d-ebeb-447d-b1cc-0ad6683b33a9`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:23:05,665::task::579::TaskManager.Task::(_updateState) Task=`8a5d769d-ebeb-447d-b1cc-0ad6683b33a9`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:23:05,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:23:05,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:23:05,666::task::974::TaskManager.Task::(_decref) Task=`8a5d769d-ebeb-447d-b1cc-0ad6683b33a9`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:23:05,666::task::579::TaskManager.Task::(_updateState) Task=`a033eb4a-6a85-41dd-8ea4-b4fd96acf8b6`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:23:05,666::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:23:05,667::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:23:05,667::task::1168::TaskManager.Task::(prepare) Task=`a033eb4a-6a85-41dd-8ea4-b4fd96acf8b6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:23:05,667::task::579::TaskManager.Task::(_updateState) Task=`a033eb4a-6a85-41dd-8ea4-b4fd96acf8b6`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:23:05,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:23:05,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:23:05,668::task::974::TaskManager.Task::(_decref) Task=`a033eb4a-6a85-41dd-8ea4-b4fd96acf8b6`::ref 0 aborting False >Thread-286516::DEBUG::2014-01-16 16:23:06,137::task::579::TaskManager.Task::(_updateState) Task=`f5774d7c-80c6-4add-b6e9-dead0bba15f2`::moving from state init -> state preparing >Thread-286516::INFO::2014-01-16 16:23:06,137::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286516::INFO::2014-01-16 16:23:06,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284622', 'lastCheck': '9.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212344', 'lastCheck': '1.9', 'valid': True}} >Thread-286516::DEBUG::2014-01-16 16:23:06,138::task::1168::TaskManager.Task::(prepare) Task=`f5774d7c-80c6-4add-b6e9-dead0bba15f2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284622', 'lastCheck': '9.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212344', 'lastCheck': '1.9', 'valid': True}} >Thread-286516::DEBUG::2014-01-16 16:23:06,138::task::579::TaskManager.Task::(_updateState) Task=`f5774d7c-80c6-4add-b6e9-dead0bba15f2`::moving from state preparing -> state finished >Thread-286516::DEBUG::2014-01-16 16:23:06,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286516::DEBUG::2014-01-16 16:23:06,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286516::DEBUG::2014-01-16 16:23:06,139::task::974::TaskManager.Task::(_decref) Task=`f5774d7c-80c6-4add-b6e9-dead0bba15f2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:06,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:23:06,249::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:23:06,249::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:23:06,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:06,249::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:23:06,251::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:23:06,520::task::579::TaskManager.Task::(_updateState) Task=`7073194b-944a-4e05-a579-d7f410985cef`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:23:06,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:23:06,521::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:23:06,521::task::1168::TaskManager.Task::(prepare) Task=`7073194b-944a-4e05-a579-d7f410985cef`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:23:06,521::task::579::TaskManager.Task::(_updateState) Task=`7073194b-944a-4e05-a579-d7f410985cef`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:23:06,521::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:23:06,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:23:06,522::task::974::TaskManager.Task::(_decref) Task=`7073194b-944a-4e05-a579-d7f410985cef`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:23:06,636::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:23:06,652::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272041 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:23:06,667::task::579::TaskManager.Task::(_updateState) Task=`29de38c7-6376-41dd-906c-a562f37a8735`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:23:06,668::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:23:06,668::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:23:06,668::task::1168::TaskManager.Task::(prepare) Task=`29de38c7-6376-41dd-906c-a562f37a8735`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:23:06,668::task::579::TaskManager.Task::(_updateState) Task=`29de38c7-6376-41dd-906c-a562f37a8735`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:23:06,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:23:06,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:23:06,669::task::974::TaskManager.Task::(_decref) Task=`29de38c7-6376-41dd-906c-a562f37a8735`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:06,863::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:07,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:23:07,674::task::579::TaskManager.Task::(_updateState) Task=`c5f8116f-36a9-4bb7-b10f-2299d6488ca9`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:23:07,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:23:07,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:23:07,675::task::1168::TaskManager.Task::(prepare) Task=`c5f8116f-36a9-4bb7-b10f-2299d6488ca9`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:23:07,675::task::579::TaskManager.Task::(_updateState) Task=`c5f8116f-36a9-4bb7-b10f-2299d6488ca9`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:23:07,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:23:07,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:23:07,675::task::974::TaskManager.Task::(_decref) Task=`c5f8116f-36a9-4bb7-b10f-2299d6488ca9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:07,864::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:08,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:23:08,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:23:08,253::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:23:08,764::task::579::TaskManager.Task::(_updateState) Task=`30f5a5e8-59db-4ac7-9d56-acbf9b141ef0`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:23:08,765::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:23:08,765::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:23:08,765::task::1168::TaskManager.Task::(prepare) Task=`30f5a5e8-59db-4ac7-9d56-acbf9b141ef0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:23:08,765::task::579::TaskManager.Task::(_updateState) Task=`30f5a5e8-59db-4ac7-9d56-acbf9b141ef0`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:23:08,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:23:08,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:23:08,766::task::974::TaskManager.Task::(_decref) Task=`30f5a5e8-59db-4ac7-9d56-acbf9b141ef0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:08,865::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:09,255::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:23:09,255::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:23:09,255::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:10,257::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:23:10,257::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:23:10,257::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:23:10,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:10,866::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:11,258::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:23:11,772::task::579::TaskManager.Task::(_updateState) Task=`4a5fc921-a04b-40c7-864e-de4cd1485323`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:23:11,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:23:11,772::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:23:11,773::task::1168::TaskManager.Task::(prepare) Task=`4a5fc921-a04b-40c7-864e-de4cd1485323`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:23:11,773::task::579::TaskManager.Task::(_updateState) Task=`4a5fc921-a04b-40c7-864e-de4cd1485323`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:23:11,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:23:11,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:23:11,773::task::974::TaskManager.Task::(_decref) Task=`4a5fc921-a04b-40c7-864e-de4cd1485323`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:12,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:23:12,260::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:12,868::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:12,868::task::579::TaskManager.Task::(_updateState) Task=`b493a1c6-d8eb-4ce9-a7e3-d509a8ff5370`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:23:12,868::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:23:12,869::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:23:12,869::task::1168::TaskManager.Task::(prepare) Task=`b493a1c6-d8eb-4ce9-a7e3-d509a8ff5370`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:23:12,869::task::579::TaskManager.Task::(_updateState) Task=`b493a1c6-d8eb-4ce9-a7e3-d509a8ff5370`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:23:12,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:23:12,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:23:12,869::task::974::TaskManager.Task::(_decref) Task=`b493a1c6-d8eb-4ce9-a7e3-d509a8ff5370`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:12,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:23:12,871::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:23:12,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:12,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:12,875::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:13,261::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:14,234::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:23:14,262::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:14,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026658 s, 15.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:14,876::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:23:15,164::task::579::TaskManager.Task::(_updateState) Task=`8909af87-f38a-43fa-af4c-fc1658f68daf`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:23:15,164::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:23:15,164::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:23:15,165::task::1168::TaskManager.Task::(prepare) Task=`8909af87-f38a-43fa-af4c-fc1658f68daf`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:23:15,165::task::579::TaskManager.Task::(_updateState) Task=`8909af87-f38a-43fa-af4c-fc1658f68daf`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:23:15,165::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:23:15,165::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:23:15,165::task::974::TaskManager.Task::(_decref) Task=`8909af87-f38a-43fa-af4c-fc1658f68daf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:15,265::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:23:15,457::task::579::TaskManager.Task::(_updateState) Task=`bca3dd68-e1d2-4b5e-a738-81206a2fb033`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:23:15,457::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:23:15,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:23:15,458::task::1168::TaskManager.Task::(prepare) Task=`bca3dd68-e1d2-4b5e-a738-81206a2fb033`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:23:15,459::task::579::TaskManager.Task::(_updateState) Task=`bca3dd68-e1d2-4b5e-a738-81206a2fb033`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:23:15,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:23:15,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:23:15,459::task::974::TaskManager.Task::(_decref) Task=`bca3dd68-e1d2-4b5e-a738-81206a2fb033`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:16,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:23:16,660::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:23:16,676::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000304999 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:16,878::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:17,267::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:17,879::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:18,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:23:18,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:18,880::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:19,270::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:23:19,747::task::579::TaskManager.Task::(_updateState) Task=`784df7fb-d440-479d-971a-0f34255b52fa`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:23:19,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:23:19,748::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:23:19,748::task::1168::TaskManager.Task::(prepare) Task=`784df7fb-d440-479d-971a-0f34255b52fa`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:23:19,748::task::579::TaskManager.Task::(_updateState) Task=`784df7fb-d440-479d-971a-0f34255b52fa`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:23:19,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:23:19,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:23:19,749::task::974::TaskManager.Task::(_decref) Task=`784df7fb-d440-479d-971a-0f34255b52fa`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:23:19,749::task::579::TaskManager.Task::(_updateState) Task=`024a9815-9b39-47bd-8851-91d157e92b7e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:23:19,749::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:23:19,749::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:23:19,750::task::1168::TaskManager.Task::(prepare) Task=`024a9815-9b39-47bd-8851-91d157e92b7e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:23:19,750::task::579::TaskManager.Task::(_updateState) Task=`024a9815-9b39-47bd-8851-91d157e92b7e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:23:19,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:23:19,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:23:19,750::task::974::TaskManager.Task::(_decref) Task=`024a9815-9b39-47bd-8851-91d157e92b7e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:20,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:20,882::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:21,272::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286522::DEBUG::2014-01-16 16:23:22,271::task::579::TaskManager.Task::(_updateState) Task=`191f4daf-07fc-4a40-a13d-e7ba18bf13c2`::moving from state init -> state preparing >Thread-286522::INFO::2014-01-16 16:23:22,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286522::INFO::2014-01-16 16:23:22,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304999', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026658', 'lastCheck': '8.0', 'valid': True}} >Thread-286522::DEBUG::2014-01-16 16:23:22,272::task::1168::TaskManager.Task::(prepare) Task=`191f4daf-07fc-4a40-a13d-e7ba18bf13c2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304999', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026658', 'lastCheck': '8.0', 'valid': True}} >Thread-286522::DEBUG::2014-01-16 16:23:22,272::task::579::TaskManager.Task::(_updateState) Task=`191f4daf-07fc-4a40-a13d-e7ba18bf13c2`::moving from state preparing -> state finished >Thread-286522::DEBUG::2014-01-16 16:23:22,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286522::DEBUG::2014-01-16 16:23:22,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286522::DEBUG::2014-01-16 16:23:22,273::task::974::TaskManager.Task::(_decref) Task=`191f4daf-07fc-4a40-a13d-e7ba18bf13c2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:22,273::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:22,883::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:22,884::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:23,274::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:23:23,275::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:23:23,275::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:23:23,337::task::579::TaskManager.Task::(_updateState) Task=`3c3e0831-c1cf-4c07-98be-9de1b47fe412`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:23:23,338::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:23:23,338::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:23:23,338::task::1168::TaskManager.Task::(prepare) Task=`3c3e0831-c1cf-4c07-98be-9de1b47fe412`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:23:23,338::task::579::TaskManager.Task::(_updateState) Task=`3c3e0831-c1cf-4c07-98be-9de1b47fe412`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:23:23,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:23:23,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:23:23,339::task::974::TaskManager.Task::(_decref) Task=`3c3e0831-c1cf-4c07-98be-9de1b47fe412`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:23:23,913::task::579::TaskManager.Task::(_updateState) Task=`e524b6bc-a636-41c6-a33c-816da728190d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:23:23,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:23:23,914::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:23:23,914::task::1168::TaskManager.Task::(prepare) Task=`e524b6bc-a636-41c6-a33c-816da728190d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:23:23,914::task::579::TaskManager.Task::(_updateState) Task=`e524b6bc-a636-41c6-a33c-816da728190d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:23:23,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:23:23,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:23:23,914::task::974::TaskManager.Task::(_decref) Task=`e524b6bc-a636-41c6-a33c-816da728190d`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:23:24,270::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:23:24,286::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:23:24,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:24,300::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000286522 s, 14.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:24,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:25,295::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:23:25,296::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:23:25,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:26,296::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:23:26,297::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:23:26,684::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:23:26,700::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000364788 s, 1.0 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:23:26,828::task::579::TaskManager.Task::(_updateState) Task=`c464a6bf-6180-45bc-8b5c-8cae34b2e127`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:23:26,829::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:23:26,829::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:23:26,829::task::1168::TaskManager.Task::(prepare) Task=`c464a6bf-6180-45bc-8b5c-8cae34b2e127`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:23:26,829::task::579::TaskManager.Task::(_updateState) Task=`c464a6bf-6180-45bc-8b5c-8cae34b2e127`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:23:26,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:23:26,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:23:26,830::task::974::TaskManager.Task::(_decref) Task=`c464a6bf-6180-45bc-8b5c-8cae34b2e127`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:23:26,846::task::579::TaskManager.Task::(_updateState) Task=`d88b2810-eba3-4fbb-9e4f-103c1b8a83c6`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:23:26,846::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:23:26,847::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:23:26,847::task::1168::TaskManager.Task::(prepare) Task=`d88b2810-eba3-4fbb-9e4f-103c1b8a83c6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:23:26,847::task::579::TaskManager.Task::(_updateState) Task=`d88b2810-eba3-4fbb-9e4f-103c1b8a83c6`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:23:26,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:23:26,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:23:26,848::task::974::TaskManager.Task::(_decref) Task=`d88b2810-eba3-4fbb-9e4f-103c1b8a83c6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:26,887::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:27,298::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:23:27,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:27,889::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:23:27,889::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:23:27,890::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:28,299::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:28,892::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:29,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:23:29,301::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:30,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:23:30,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:30,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:31,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:23:31,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:23:31,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:23:31,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:23:31,859::task::579::TaskManager.Task::(_updateState) Task=`4a9a50ad-51d5-4c7d-a2c7-68afaf9dded1`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:23:31,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:23:31,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:23:31,860::task::1168::TaskManager.Task::(prepare) Task=`4a9a50ad-51d5-4c7d-a2c7-68afaf9dded1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:23:31,860::task::579::TaskManager.Task::(_updateState) Task=`4a9a50ad-51d5-4c7d-a2c7-68afaf9dded1`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:23:31,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:23:31,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:23:31,860::task::974::TaskManager.Task::(_decref) Task=`4a9a50ad-51d5-4c7d-a2c7-68afaf9dded1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:32,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:23:32,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:23:32,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:32,894::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:32,895::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:33,307::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:23:33,307::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:34,306::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:23:34,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:23:34,325::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:23:34,329::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:23:34,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:34,339::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000250761 s, 16.3 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:23:34,561::task::579::TaskManager.Task::(_updateState) Task=`03dfb35a-4f1d-44de-900d-fcd01fbc0c58`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:23:34,561::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:23:34,562::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:23:34,562::task::1168::TaskManager.Task::(prepare) Task=`03dfb35a-4f1d-44de-900d-fcd01fbc0c58`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:23:34,562::task::579::TaskManager.Task::(_updateState) Task=`03dfb35a-4f1d-44de-900d-fcd01fbc0c58`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:23:34,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:23:34,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:23:34,562::task::974::TaskManager.Task::(_decref) Task=`03dfb35a-4f1d-44de-900d-fcd01fbc0c58`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:34,897::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:23:35,277::task::579::TaskManager.Task::(_updateState) Task=`17a935f4-66c9-48b3-94f0-4aee5a6e567d`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:23:35,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:23:35,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:23:35,278::task::1168::TaskManager.Task::(prepare) Task=`17a935f4-66c9-48b3-94f0-4aee5a6e567d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:23:35,278::task::579::TaskManager.Task::(_updateState) Task=`17a935f4-66c9-48b3-94f0-4aee5a6e567d`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:23:35,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:23:35,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:23:35,279::task::974::TaskManager.Task::(_decref) Task=`17a935f4-66c9-48b3-94f0-4aee5a6e567d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:35,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 16:23:35,380::task::579::TaskManager.Task::(_updateState) Task=`20e863c0-9ce8-419d-8b19-4ee930b0db28`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:23:35,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:23:35,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:23:35,381::task::1168::TaskManager.Task::(prepare) Task=`20e863c0-9ce8-419d-8b19-4ee930b0db28`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:23:35,381::task::579::TaskManager.Task::(_updateState) Task=`20e863c0-9ce8-419d-8b19-4ee930b0db28`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:23:35,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:23:35,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:23:35,382::task::974::TaskManager.Task::(_decref) Task=`20e863c0-9ce8-419d-8b19-4ee930b0db28`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:23:35,384::task::579::TaskManager.Task::(_updateState) Task=`cf78a858-d777-4448-ba2d-3419f668d973`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:23:35,385::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:23:35,385::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:23:35,385::task::1168::TaskManager.Task::(prepare) Task=`cf78a858-d777-4448-ba2d-3419f668d973`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:23:35,386::task::579::TaskManager.Task::(_updateState) Task=`cf78a858-d777-4448-ba2d-3419f668d973`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:23:35,386::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:23:35,386::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:23:35,386::task::974::TaskManager.Task::(_decref) Task=`cf78a858-d777-4448-ba2d-3419f668d973`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:23:36,237::task::579::TaskManager.Task::(_updateState) Task=`15a16631-8ecf-4179-b9a2-1820b5faa9c9`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:23:36,238::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:23:36,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:23:36,238::task::1168::TaskManager.Task::(prepare) Task=`15a16631-8ecf-4179-b9a2-1820b5faa9c9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:23:36,238::task::579::TaskManager.Task::(_updateState) Task=`15a16631-8ecf-4179-b9a2-1820b5faa9c9`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:23:36,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:23:36,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:23:36,239::task::974::TaskManager.Task::(_decref) Task=`15a16631-8ecf-4179-b9a2-1820b5faa9c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:36,339::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:23:36,340::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:23:36,342::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:23:36,343::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:36,344::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:23:36,344::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-12152::DEBUG::2014-01-16 16:23:36,582::task::579::TaskManager.Task::(_updateState) Task=`9606d7f1-bf5d-481b-bcbd-ae9bb01c6531`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:23:36,583::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:23:36,583::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:23:36,583::task::1168::TaskManager.Task::(prepare) Task=`9606d7f1-bf5d-481b-bcbd-ae9bb01c6531`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:23:36,583::task::579::TaskManager.Task::(_updateState) Task=`9606d7f1-bf5d-481b-bcbd-ae9bb01c6531`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:23:36,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:23:36,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:23:36,584::task::974::TaskManager.Task::(_decref) Task=`9606d7f1-bf5d-481b-bcbd-ae9bb01c6531`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:23:36,708::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:23:36,723::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000269608 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:36,898::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:37,346::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:23:37,863::task::579::TaskManager.Task::(_updateState) Task=`2dbf25b6-4e36-473e-b5d7-147b5d7c5ae3`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:23:37,863::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:23:37,863::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:23:37,864::task::1168::TaskManager.Task::(prepare) Task=`2dbf25b6-4e36-473e-b5d7-147b5d7c5ae3`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:23:37,864::task::579::TaskManager.Task::(_updateState) Task=`2dbf25b6-4e36-473e-b5d7-147b5d7c5ae3`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:23:37,864::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:23:37,864::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:23:37,864::task::974::TaskManager.Task::(_decref) Task=`2dbf25b6-4e36-473e-b5d7-147b5d7c5ae3`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:23:37,865::task::579::TaskManager.Task::(_updateState) Task=`d2d12c0b-12e4-44ce-9fe3-a5fee636d6c7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:23:37,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:23:37,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:23:37,866::task::1168::TaskManager.Task::(prepare) Task=`d2d12c0b-12e4-44ce-9fe3-a5fee636d6c7`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:23:37,866::task::579::TaskManager.Task::(_updateState) Task=`d2d12c0b-12e4-44ce-9fe3-a5fee636d6c7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:23:37,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:23:37,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:23:37,867::task::974::TaskManager.Task::(_decref) Task=`d2d12c0b-12e4-44ce-9fe3-a5fee636d6c7`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:23:37,867::task::579::TaskManager.Task::(_updateState) Task=`61016e50-d886-4b51-8bfa-d26e1f150914`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:23:37,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:23:37,867::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:23:37,868::task::1168::TaskManager.Task::(prepare) Task=`61016e50-d886-4b51-8bfa-d26e1f150914`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:23:37,868::task::579::TaskManager.Task::(_updateState) Task=`61016e50-d886-4b51-8bfa-d26e1f150914`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:23:37,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:23:37,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:23:37,868::task::974::TaskManager.Task::(_decref) Task=`61016e50-d886-4b51-8bfa-d26e1f150914`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:37,901::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286528::DEBUG::2014-01-16 16:23:38,262::task::579::TaskManager.Task::(_updateState) Task=`4b71be64-e9ea-4357-b5cc-df22956ed898`::moving from state init -> state preparing >Thread-286528::INFO::2014-01-16 16:23:38,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286528::INFO::2014-01-16 16:23:38,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269608', 'lastCheck': '1.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250761', 'lastCheck': '3.9', 'valid': True}} >Thread-286528::DEBUG::2014-01-16 16:23:38,263::task::1168::TaskManager.Task::(prepare) Task=`4b71be64-e9ea-4357-b5cc-df22956ed898`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269608', 'lastCheck': '1.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250761', 'lastCheck': '3.9', 'valid': True}} >Thread-286528::DEBUG::2014-01-16 16:23:38,263::task::579::TaskManager.Task::(_updateState) Task=`4b71be64-e9ea-4357-b5cc-df22956ed898`::moving from state preparing -> state finished >Thread-286528::DEBUG::2014-01-16 16:23:38,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286528::DEBUG::2014-01-16 16:23:38,264::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286528::DEBUG::2014-01-16 16:23:38,264::task::974::TaskManager.Task::(_decref) Task=`4b71be64-e9ea-4357-b5cc-df22956ed898`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:38,349::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:23:38,353::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:23:38,356::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:38,903::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:39,358::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:23:39,359::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:23:39,359::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:40,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:23:40,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:23:40,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:23:40,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:40,904::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:41,362::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:42,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:23:42,363::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:42,905::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:42,908::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:23:42,908::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:23:42,909::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:43,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:23:44,264::task::579::TaskManager.Task::(_updateState) Task=`9b4b3304-4b4a-4452-8e6c-74f63d45c41e`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:23:44,264::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:23:44,264::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:23:44,264::task::1168::TaskManager.Task::(prepare) Task=`9b4b3304-4b4a-4452-8e6c-74f63d45c41e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:23:44,264::task::579::TaskManager.Task::(_updateState) Task=`9b4b3304-4b4a-4452-8e6c-74f63d45c41e`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:23:44,265::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:23:44,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:23:44,265::task::974::TaskManager.Task::(_decref) Task=`9b4b3304-4b4a-4452-8e6c-74f63d45c41e`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:23:44,345::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:23:44,368::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:44,378::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000312667 s, 13.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:44,910::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:45,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:46,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:23:46,731::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:23:46,747::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000431654 s, 846 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:46,912::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:47,376::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:47,914::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:48,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:23:48,377::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:23:48,458::task::579::TaskManager.Task::(_updateState) Task=`9a127e84-b5bc-4408-9dca-6e650029e340`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:23:48,459::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:23:48,459::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:23:48,459::task::1168::TaskManager.Task::(prepare) Task=`9a127e84-b5bc-4408-9dca-6e650029e340`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:23:48,459::task::579::TaskManager.Task::(_updateState) Task=`9a127e84-b5bc-4408-9dca-6e650029e340`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:23:48,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:23:48,460::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:23:48,460::task::974::TaskManager.Task::(_decref) Task=`9a127e84-b5bc-4408-9dca-6e650029e340`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:23:48,915::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:49,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:50,379::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:50,916::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:51,380::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:52,381::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:52,917::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:23:52,918::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:53,383::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:23:53,383::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:23:53,383::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286534::DEBUG::2014-01-16 16:23:54,010::task::579::TaskManager.Task::(_updateState) Task=`415d1b0c-cb47-4206-928e-006567707ca0`::moving from state init -> state preparing >Thread-286534::INFO::2014-01-16 16:23:54,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286534::INFO::2014-01-16 16:23:54,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431654', 'lastCheck': '7.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312667', 'lastCheck': '9.6', 'valid': True}} >Thread-286534::DEBUG::2014-01-16 16:23:54,010::task::1168::TaskManager.Task::(prepare) Task=`415d1b0c-cb47-4206-928e-006567707ca0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431654', 'lastCheck': '7.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312667', 'lastCheck': '9.6', 'valid': True}} >Thread-286534::DEBUG::2014-01-16 16:23:54,011::task::579::TaskManager.Task::(_updateState) Task=`415d1b0c-cb47-4206-928e-006567707ca0`::moving from state preparing -> state finished >Thread-286534::DEBUG::2014-01-16 16:23:54,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286534::DEBUG::2014-01-16 16:23:54,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286534::DEBUG::2014-01-16 16:23:54,011::task::974::TaskManager.Task::(_decref) Task=`415d1b0c-cb47-4206-928e-006567707ca0`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:23:54,021::task::579::TaskManager.Task::(_updateState) Task=`4948369a-7842-4ca3-88af-53bab166645a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:23:54,021::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:23:54,022::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:23:54,022::task::1168::TaskManager.Task::(prepare) Task=`4948369a-7842-4ca3-88af-53bab166645a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:23:54,022::task::579::TaskManager.Task::(_updateState) Task=`4948369a-7842-4ca3-88af-53bab166645a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:23:54,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:23:54,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:23:54,023::task::974::TaskManager.Task::(_decref) Task=`4948369a-7842-4ca3-88af-53bab166645a`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:23:54,023::task::579::TaskManager.Task::(_updateState) Task=`f7dab7d5-8afa-4ac7-81ca-544d2b9731c9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:23:54,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:23:54,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:23:54,023::task::1168::TaskManager.Task::(prepare) Task=`f7dab7d5-8afa-4ac7-81ca-544d2b9731c9`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:23:54,024::task::579::TaskManager.Task::(_updateState) Task=`f7dab7d5-8afa-4ac7-81ca-544d2b9731c9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:23:54,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:23:54,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:23:54,024::task::974::TaskManager.Task::(_decref) Task=`f7dab7d5-8afa-4ac7-81ca-544d2b9731c9`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:23:54,024::task::579::TaskManager.Task::(_updateState) Task=`1b7495cf-0b08-4856-9b6e-637616c0dc6f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:23:54,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:23:54,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:23:54,025::task::1168::TaskManager.Task::(prepare) Task=`1b7495cf-0b08-4856-9b6e-637616c0dc6f`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:23:54,025::task::579::TaskManager.Task::(_updateState) Task=`1b7495cf-0b08-4856-9b6e-637616c0dc6f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:23:54,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:23:54,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:23:54,025::task::974::TaskManager.Task::(_decref) Task=`1b7495cf-0b08-4856-9b6e-637616c0dc6f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:23:54,383::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:23:54,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:23:54,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:23:54,413::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000212211 s, 19.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:54,920::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:23:55,299::task::579::TaskManager.Task::(_updateState) Task=`a318a5cd-5811-418a-9314-3865a76128f3`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:23:55,299::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:23:55,300::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:23:55,300::task::1168::TaskManager.Task::(prepare) Task=`a318a5cd-5811-418a-9314-3865a76128f3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:23:55,300::task::579::TaskManager.Task::(_updateState) Task=`a318a5cd-5811-418a-9314-3865a76128f3`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:23:55,300::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:23:55,300::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:23:55,300::task::974::TaskManager.Task::(_decref) Task=`a318a5cd-5811-418a-9314-3865a76128f3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:23:55,409::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:23:55,409::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:23:55,409::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:23:56,411::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:23:56,411::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:23:56,755::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:23:56,771::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272508 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:23:56,921::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:57,412::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:23:57,412::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:57,923::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:23:57,923::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:23:57,925::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:58,414::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:23:58,926::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:23:59,415::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:23:59,415::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:23:59,707::task::579::TaskManager.Task::(_updateState) Task=`2dd53176-c948-491e-80f9-a7a389e6cf6f`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:23:59,707::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:23:59,707::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:23:59,708::task::1168::TaskManager.Task::(prepare) Task=`2dd53176-c948-491e-80f9-a7a389e6cf6f`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:23:59,708::task::579::TaskManager.Task::(_updateState) Task=`2dd53176-c948-491e-80f9-a7a389e6cf6f`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:23:59,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:23:59,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:23:59,708::task::974::TaskManager.Task::(_decref) Task=`2dd53176-c948-491e-80f9-a7a389e6cf6f`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:23:59,708::task::579::TaskManager.Task::(_updateState) Task=`e2c3bc5f-545e-440b-957a-7c055f2c79f7`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:23:59,709::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:23:59,709::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:23:59,709::task::1168::TaskManager.Task::(prepare) Task=`e2c3bc5f-545e-440b-957a-7c055f2c79f7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:23:59,709::task::579::TaskManager.Task::(_updateState) Task=`e2c3bc5f-545e-440b-957a-7c055f2c79f7`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:23:59,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:23:59,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:23:59,710::task::974::TaskManager.Task::(_decref) Task=`e2c3bc5f-545e-440b-957a-7c055f2c79f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:00,416::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:24:00,416::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:00,927::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:01,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:24:01,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:24:01,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:24:01,417::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:02,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:24:02,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:24:02,419::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:24:02,422::task::579::TaskManager.Task::(_updateState) Task=`e355e528-e59a-4e44-8bfd-23a7caf8bca2`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:24:02,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:24:02,423::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:24:02,423::task::1168::TaskManager.Task::(prepare) Task=`e355e528-e59a-4e44-8bfd-23a7caf8bca2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:24:02,423::task::579::TaskManager.Task::(_updateState) Task=`e355e528-e59a-4e44-8bfd-23a7caf8bca2`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:24:02,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:24:02,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:24:02,424::task::974::TaskManager.Task::(_decref) Task=`e355e528-e59a-4e44-8bfd-23a7caf8bca2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:02,928::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:02,929::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:03,420::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:24:03,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:24:04,287::task::579::TaskManager.Task::(_updateState) Task=`3b6461e9-3b3e-4287-8c49-bee254cb95e0`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:24:04,288::task::579::TaskManager.Task::(_updateState) Task=`91d8fcd7-708f-424d-b40c-628f80730479`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:24:04,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:24:04,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:24:04,289::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:24:04,289::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:24:04,289::task::1168::TaskManager.Task::(prepare) Task=`3b6461e9-3b3e-4287-8c49-bee254cb95e0`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:24:04,289::task::1168::TaskManager.Task::(prepare) Task=`91d8fcd7-708f-424d-b40c-628f80730479`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:24:04,289::task::579::TaskManager.Task::(_updateState) Task=`3b6461e9-3b3e-4287-8c49-bee254cb95e0`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:24:04,290::task::579::TaskManager.Task::(_updateState) Task=`91d8fcd7-708f-424d-b40c-628f80730479`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:24:04,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:24:04,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:24:04,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:24:04,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:24:04,290::task::974::TaskManager.Task::(_decref) Task=`3b6461e9-3b3e-4287-8c49-bee254cb95e0`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:24:04,291::task::974::TaskManager.Task::(_decref) Task=`91d8fcd7-708f-424d-b40c-628f80730479`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:24:04,418::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:24:04,433::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:24:04,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:24:04,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:24:04,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:04,449::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213348 s, 19.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:04,931::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:05,448::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:24:05,534::task::579::TaskManager.Task::(_updateState) Task=`5d601478-96ad-454d-95bd-e9313b4bb413`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:24:05,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:24:05,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:24:05,535::task::1168::TaskManager.Task::(prepare) Task=`5d601478-96ad-454d-95bd-e9313b4bb413`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:24:05,535::task::579::TaskManager.Task::(_updateState) Task=`5d601478-96ad-454d-95bd-e9313b4bb413`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:24:05,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:24:05,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:24:05,535::task::974::TaskManager.Task::(_decref) Task=`5d601478-96ad-454d-95bd-e9313b4bb413`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:24:05,535::task::579::TaskManager.Task::(_updateState) Task=`75ec4db3-2bfb-48ef-8c0c-3fd8ad826d0e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:24:05,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:24:05,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:24:05,536::task::1168::TaskManager.Task::(prepare) Task=`75ec4db3-2bfb-48ef-8c0c-3fd8ad826d0e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:24:05,536::task::579::TaskManager.Task::(_updateState) Task=`75ec4db3-2bfb-48ef-8c0c-3fd8ad826d0e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:24:05,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:24:05,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:24:05,539::task::974::TaskManager.Task::(_decref) Task=`75ec4db3-2bfb-48ef-8c0c-3fd8ad826d0e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:24:05,887::task::579::TaskManager.Task::(_updateState) Task=`809d6aa5-17d9-486f-ab16-6b69b64a829e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:24:05,887::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:24:05,888::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:24:05,888::task::1168::TaskManager.Task::(prepare) Task=`809d6aa5-17d9-486f-ab16-6b69b64a829e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:24:05,888::task::579::TaskManager.Task::(_updateState) Task=`809d6aa5-17d9-486f-ab16-6b69b64a829e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:24:05,888::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:24:05,888::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:24:05,888::task::974::TaskManager.Task::(_decref) Task=`809d6aa5-17d9-486f-ab16-6b69b64a829e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:24:05,889::task::579::TaskManager.Task::(_updateState) Task=`7bd6449c-9052-478c-baff-a9d92040a672`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:24:05,889::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:24:05,889::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:24:05,889::task::1168::TaskManager.Task::(prepare) Task=`7bd6449c-9052-478c-baff-a9d92040a672`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:24:05,889::task::579::TaskManager.Task::(_updateState) Task=`7bd6449c-9052-478c-baff-a9d92040a672`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:24:05,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:24:05,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:24:05,890::task::974::TaskManager.Task::(_decref) Task=`7bd6449c-9052-478c-baff-a9d92040a672`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:06,450::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:24:06,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:24:06,453::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:24:06,453::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:06,453::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:24:06,455::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:24:06,684::task::579::TaskManager.Task::(_updateState) Task=`835e3e20-7a16-400f-bb36-8a34255d396e`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:24:06,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:24:06,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:24:06,685::task::1168::TaskManager.Task::(prepare) Task=`835e3e20-7a16-400f-bb36-8a34255d396e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:24:06,685::task::579::TaskManager.Task::(_updateState) Task=`835e3e20-7a16-400f-bb36-8a34255d396e`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:24:06,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:24:06,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:24:06,685::task::974::TaskManager.Task::(_decref) Task=`835e3e20-7a16-400f-bb36-8a34255d396e`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:24:06,779::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:24:06,796::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000311522 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:24:06,806::task::579::TaskManager.Task::(_updateState) Task=`7840bc34-c169-45a7-867c-10ecddd80968`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:24:06,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:24:06,807::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:24:06,807::task::1168::TaskManager.Task::(prepare) Task=`7840bc34-c169-45a7-867c-10ecddd80968`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:24:06,807::task::579::TaskManager.Task::(_updateState) Task=`7840bc34-c169-45a7-867c-10ecddd80968`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:24:06,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:24:06,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:24:06,807::task::974::TaskManager.Task::(_decref) Task=`7840bc34-c169-45a7-867c-10ecddd80968`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:06,932::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:07,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:24:07,847::task::579::TaskManager.Task::(_updateState) Task=`e7be02e6-f68d-4ab6-91d1-c9266cf142c7`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:24:07,847::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:24:07,848::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:24:07,848::task::1168::TaskManager.Task::(prepare) Task=`e7be02e6-f68d-4ab6-91d1-c9266cf142c7`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:24:07,848::task::579::TaskManager.Task::(_updateState) Task=`e7be02e6-f68d-4ab6-91d1-c9266cf142c7`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:24:07,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:24:07,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:24:07,849::task::974::TaskManager.Task::(_decref) Task=`e7be02e6-f68d-4ab6-91d1-c9266cf142c7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:07,933::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:08,458::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:24:08,460::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:24:08,460::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:08,935::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:24:08,936::task::579::TaskManager.Task::(_updateState) Task=`f61ee612-c911-4c2e-8613-6f5bc16dd50e`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:24:08,937::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:24:08,937::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:24:08,937::task::1168::TaskManager.Task::(prepare) Task=`f61ee612-c911-4c2e-8613-6f5bc16dd50e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:24:08,937::task::579::TaskManager.Task::(_updateState) Task=`f61ee612-c911-4c2e-8613-6f5bc16dd50e`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:24:08,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:24:08,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:24:08,938::task::974::TaskManager.Task::(_decref) Task=`f61ee612-c911-4c2e-8613-6f5bc16dd50e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:09,461::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:24:09,461::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:24:09,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286540::DEBUG::2014-01-16 16:24:09,759::task::579::TaskManager.Task::(_updateState) Task=`be643f79-911f-4f3a-a04d-643b593359d6`::moving from state init -> state preparing >Thread-286540::INFO::2014-01-16 16:24:09,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286540::INFO::2014-01-16 16:24:09,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311522', 'lastCheck': '3.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213348', 'lastCheck': '5.3', 'valid': True}} >Thread-286540::DEBUG::2014-01-16 16:24:09,760::task::1168::TaskManager.Task::(prepare) Task=`be643f79-911f-4f3a-a04d-643b593359d6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311522', 'lastCheck': '3.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213348', 'lastCheck': '5.3', 'valid': True}} >Thread-286540::DEBUG::2014-01-16 16:24:09,760::task::579::TaskManager.Task::(_updateState) Task=`be643f79-911f-4f3a-a04d-643b593359d6`::moving from state preparing -> state finished >Thread-286540::DEBUG::2014-01-16 16:24:09,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286540::DEBUG::2014-01-16 16:24:09,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286540::DEBUG::2014-01-16 16:24:09,761::task::974::TaskManager.Task::(_decref) Task=`be643f79-911f-4f3a-a04d-643b593359d6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:10,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:24:10,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:24:10,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:24:10,464::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:10,938::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:11,465::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:24:11,960::task::579::TaskManager.Task::(_updateState) Task=`f4a885ef-d069-488f-8ae0-5f60a7c9f0e7`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:24:11,960::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:24:11,961::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:24:11,961::task::1168::TaskManager.Task::(prepare) Task=`f4a885ef-d069-488f-8ae0-5f60a7c9f0e7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:24:11,961::task::579::TaskManager.Task::(_updateState) Task=`f4a885ef-d069-488f-8ae0-5f60a7c9f0e7`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:24:11,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:24:11,961::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:24:11,961::task::974::TaskManager.Task::(_decref) Task=`f4a885ef-d069-488f-8ae0-5f60a7c9f0e7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:12,467::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:24:12,467::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:12,939::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:12,940::task::579::TaskManager.Task::(_updateState) Task=`e0a1e8a3-c1c0-4b16-ab56-ef46c7e6747a`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:24:12,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:24:12,941::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:24:12,941::task::1168::TaskManager.Task::(prepare) Task=`e0a1e8a3-c1c0-4b16-ab56-ef46c7e6747a`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:24:12,941::task::579::TaskManager.Task::(_updateState) Task=`e0a1e8a3-c1c0-4b16-ab56-ef46c7e6747a`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:24:12,941::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:24:12,941::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:24:12,942::task::974::TaskManager.Task::(_decref) Task=`e0a1e8a3-c1c0-4b16-ab56-ef46c7e6747a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:12,943::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:24:12,943::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:24:12,945::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:12,947::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:12,948::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:13,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:14,454::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:24:14,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:14,485::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237605 s, 17.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:14,950::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:24:15,339::task::579::TaskManager.Task::(_updateState) Task=`9f4acb30-b51d-4f74-aea3-4e0c428ad1e4`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:24:15,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:24:15,340::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:24:15,340::task::1168::TaskManager.Task::(prepare) Task=`9f4acb30-b51d-4f74-aea3-4e0c428ad1e4`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:24:15,340::task::579::TaskManager.Task::(_updateState) Task=`9f4acb30-b51d-4f74-aea3-4e0c428ad1e4`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:24:15,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:24:15,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:24:15,341::task::974::TaskManager.Task::(_decref) Task=`9f4acb30-b51d-4f74-aea3-4e0c428ad1e4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:15,478::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:24:15,545::task::579::TaskManager.Task::(_updateState) Task=`1cf8d4ce-9aed-4be5-88b8-02de0ca852ac`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:24:15,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:24:15,545::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:24:15,545::task::1168::TaskManager.Task::(prepare) Task=`1cf8d4ce-9aed-4be5-88b8-02de0ca852ac`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:24:15,546::task::579::TaskManager.Task::(_updateState) Task=`1cf8d4ce-9aed-4be5-88b8-02de0ca852ac`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:24:15,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:24:15,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:24:15,546::task::974::TaskManager.Task::(_decref) Task=`1cf8d4ce-9aed-4be5-88b8-02de0ca852ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:16,480::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:24:16,803::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:24:16,820::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026476 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:16,951::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:17,480::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:17,953::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:18,481::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:24:18,482::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:18,955::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:19,482::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:24:20,136::task::579::TaskManager.Task::(_updateState) Task=`826cc5dd-df4d-42ef-a51a-6926ce07875e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:24:20,136::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:24:20,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:24:20,137::task::1168::TaskManager.Task::(prepare) Task=`826cc5dd-df4d-42ef-a51a-6926ce07875e`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:24:20,137::task::579::TaskManager.Task::(_updateState) Task=`826cc5dd-df4d-42ef-a51a-6926ce07875e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:24:20,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:24:20,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:24:20,137::task::974::TaskManager.Task::(_decref) Task=`826cc5dd-df4d-42ef-a51a-6926ce07875e`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:24:20,138::task::579::TaskManager.Task::(_updateState) Task=`7439459b-9daf-4a26-ac99-2905071a5732`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:24:20,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:24:20,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:24:20,138::task::1168::TaskManager.Task::(prepare) Task=`7439459b-9daf-4a26-ac99-2905071a5732`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:24:20,138::task::579::TaskManager.Task::(_updateState) Task=`7439459b-9daf-4a26-ac99-2905071a5732`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:24:20,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:24:20,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:24:20,139::task::974::TaskManager.Task::(_decref) Task=`7439459b-9daf-4a26-ac99-2905071a5732`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:20,483::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:20,957::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:21,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:22,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:22,958::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:22,960::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:23,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:24:23,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:24:23,487::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:24:23,510::task::579::TaskManager.Task::(_updateState) Task=`7305f499-cbf3-4647-b05e-d5e358cbc8e0`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:24:23,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:24:23,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:24:23,511::task::1168::TaskManager.Task::(prepare) Task=`7305f499-cbf3-4647-b05e-d5e358cbc8e0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:24:23,511::task::579::TaskManager.Task::(_updateState) Task=`7305f499-cbf3-4647-b05e-d5e358cbc8e0`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:24:23,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:24:23,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:24:23,511::task::974::TaskManager.Task::(_decref) Task=`7305f499-cbf3-4647-b05e-d5e358cbc8e0`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:24:23,973::task::579::TaskManager.Task::(_updateState) Task=`f7f62f58-19fc-4204-91e0-b6e128c6f4ac`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:24:23,973::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:24:23,973::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:24:23,973::task::1168::TaskManager.Task::(prepare) Task=`f7f62f58-19fc-4204-91e0-b6e128c6f4ac`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:24:23,973::task::579::TaskManager.Task::(_updateState) Task=`f7f62f58-19fc-4204-91e0-b6e128c6f4ac`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:24:23,974::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:24:23,974::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:24:23,974::task::974::TaskManager.Task::(_decref) Task=`f7f62f58-19fc-4204-91e0-b6e128c6f4ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:24,488::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:24:24,489::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:24,490::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:24:24,516::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022705 s, 18.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:24,961::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286546::DEBUG::2014-01-16 16:24:25,474::task::579::TaskManager.Task::(_updateState) Task=`c288b85f-1f97-4b2d-b47b-8bf6d3b58d41`::moving from state init -> state preparing >Thread-286546::INFO::2014-01-16 16:24:25,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286546::INFO::2014-01-16 16:24:25,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026476', 'lastCheck': '8.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022705', 'lastCheck': '1.0', 'valid': True}} >Thread-286546::DEBUG::2014-01-16 16:24:25,475::task::1168::TaskManager.Task::(prepare) Task=`c288b85f-1f97-4b2d-b47b-8bf6d3b58d41`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026476', 'lastCheck': '8.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022705', 'lastCheck': '1.0', 'valid': True}} >Thread-286546::DEBUG::2014-01-16 16:24:25,476::task::579::TaskManager.Task::(_updateState) Task=`c288b85f-1f97-4b2d-b47b-8bf6d3b58d41`::moving from state preparing -> state finished >Thread-286546::DEBUG::2014-01-16 16:24:25,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286546::DEBUG::2014-01-16 16:24:25,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286546::DEBUG::2014-01-16 16:24:25,476::task::974::TaskManager.Task::(_decref) Task=`c288b85f-1f97-4b2d-b47b-8bf6d3b58d41`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:25,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:24:25,491::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:24:25,491::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:26,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:24:26,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:24:26,827::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:24:26,843::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000311603 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:26,963::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:24:26,993::task::579::TaskManager.Task::(_updateState) Task=`008b925c-6689-4439-95c9-6ac9503fffa4`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:24:26,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:24:26,994::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:24:26,994::task::1168::TaskManager.Task::(prepare) Task=`008b925c-6689-4439-95c9-6ac9503fffa4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:24:26,994::task::579::TaskManager.Task::(_updateState) Task=`008b925c-6689-4439-95c9-6ac9503fffa4`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:24:26,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:24:26,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:24:26,995::task::974::TaskManager.Task::(_decref) Task=`008b925c-6689-4439-95c9-6ac9503fffa4`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:24:27,018::task::579::TaskManager.Task::(_updateState) Task=`38a0277c-0e7f-4f9e-9edb-ab0c32b8d473`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:24:27,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:24:27,019::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:24:27,019::task::1168::TaskManager.Task::(prepare) Task=`38a0277c-0e7f-4f9e-9edb-ab0c32b8d473`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:24:27,019::task::579::TaskManager.Task::(_updateState) Task=`38a0277c-0e7f-4f9e-9edb-ab0c32b8d473`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:24:27,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:24:27,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:24:27,020::task::974::TaskManager.Task::(_decref) Task=`38a0277c-0e7f-4f9e-9edb-ab0c32b8d473`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:27,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:24:27,493::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:27,966::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:24:27,966::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:24:27,967::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:28,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:28,969::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:29,496::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:24:29,496::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:30,497::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:24:30,498::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:30,970::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:31,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:24:31,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:24:31,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:24:31,499::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:24:32,038::task::579::TaskManager.Task::(_updateState) Task=`b7f17c0e-a04a-4ba8-a6b7-e1f110ffe96a`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:24:32,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:24:32,040::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:24:32,040::task::1168::TaskManager.Task::(prepare) Task=`b7f17c0e-a04a-4ba8-a6b7-e1f110ffe96a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:24:32,040::task::579::TaskManager.Task::(_updateState) Task=`b7f17c0e-a04a-4ba8-a6b7-e1f110ffe96a`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:24:32,041::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:24:32,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:24:32,041::task::974::TaskManager.Task::(_decref) Task=`b7f17c0e-a04a-4ba8-a6b7-e1f110ffe96a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:32,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:24:32,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:24:32,501::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:32,971::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:32,972::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:33,502::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:24:33,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:34,503::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:24:34,503::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:24:34,503::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:24:34,503::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:34,522::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:24:34,547::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000222386 s, 18.4 MB/s\n'; <rc> = 0 >Thread-3168::DEBUG::2014-01-16 16:24:34,723::task::579::TaskManager.Task::(_updateState) Task=`cfd551ff-a5db-4dc9-b262-5734bcc50284`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:24:34,723::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:24:34,724::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:24:34,724::task::1168::TaskManager.Task::(prepare) Task=`cfd551ff-a5db-4dc9-b262-5734bcc50284`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:24:34,724::task::579::TaskManager.Task::(_updateState) Task=`cfd551ff-a5db-4dc9-b262-5734bcc50284`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:24:34,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:24:34,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:24:34,724::task::974::TaskManager.Task::(_decref) Task=`cfd551ff-a5db-4dc9-b262-5734bcc50284`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:34,974::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:24:35,439::task::579::TaskManager.Task::(_updateState) Task=`bb12840a-b402-4825-aa1d-364d88cccad0`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:24:35,440::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:24:35,440::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:24:35,440::task::1168::TaskManager.Task::(prepare) Task=`bb12840a-b402-4825-aa1d-364d88cccad0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:24:35,440::task::579::TaskManager.Task::(_updateState) Task=`bb12840a-b402-4825-aa1d-364d88cccad0`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:24:35,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:24:35,441::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:24:35,441::task::974::TaskManager.Task::(_decref) Task=`bb12840a-b402-4825-aa1d-364d88cccad0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:35,505::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 16:24:35,550::task::579::TaskManager.Task::(_updateState) Task=`cb691ef3-32b2-4003-9d8f-0eac1f864cd9`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:24:35,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:24:35,550::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:24:35,550::task::1168::TaskManager.Task::(prepare) Task=`cb691ef3-32b2-4003-9d8f-0eac1f864cd9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:24:35,551::task::579::TaskManager.Task::(_updateState) Task=`cb691ef3-32b2-4003-9d8f-0eac1f864cd9`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:24:35,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:24:35,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:24:35,551::task::974::TaskManager.Task::(_decref) Task=`cb691ef3-32b2-4003-9d8f-0eac1f864cd9`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:24:35,564::task::579::TaskManager.Task::(_updateState) Task=`89e8e155-13a5-4f53-a117-26d927f33cf3`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:24:35,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:24:35,565::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:24:35,566::task::1168::TaskManager.Task::(prepare) Task=`89e8e155-13a5-4f53-a117-26d927f33cf3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:24:35,566::task::579::TaskManager.Task::(_updateState) Task=`89e8e155-13a5-4f53-a117-26d927f33cf3`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:24:35,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:24:35,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:24:35,566::task::974::TaskManager.Task::(_decref) Task=`89e8e155-13a5-4f53-a117-26d927f33cf3`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:24:36,404::task::579::TaskManager.Task::(_updateState) Task=`d6d7483c-f540-42a5-85d7-9e654ee31203`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:24:36,404::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:24:36,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:24:36,404::task::1168::TaskManager.Task::(prepare) Task=`d6d7483c-f540-42a5-85d7-9e654ee31203`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:24:36,405::task::579::TaskManager.Task::(_updateState) Task=`d6d7483c-f540-42a5-85d7-9e654ee31203`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:24:36,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:24:36,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:24:36,405::task::974::TaskManager.Task::(_decref) Task=`d6d7483c-f540-42a5-85d7-9e654ee31203`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:36,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:24:36,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:24:36,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:24:36,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:36,507::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:24:36,508::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-12152::DEBUG::2014-01-16 16:24:36,745::task::579::TaskManager.Task::(_updateState) Task=`fee7b53a-e813-4623-af3a-1445333e0373`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:24:36,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:24:36,745::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:24:36,745::task::1168::TaskManager.Task::(prepare) Task=`fee7b53a-e813-4623-af3a-1445333e0373`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:24:36,746::task::579::TaskManager.Task::(_updateState) Task=`fee7b53a-e813-4623-af3a-1445333e0373`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:24:36,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:24:36,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:24:36,746::task::974::TaskManager.Task::(_decref) Task=`fee7b53a-e813-4623-af3a-1445333e0373`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:24:36,851::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:24:36,867::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292273 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:36,975::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:37,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:37,976::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:24:38,146::task::579::TaskManager.Task::(_updateState) Task=`ad12c834-4f3a-46d3-8f27-2e88da722689`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:24:38,146::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:24:38,147::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:24:38,147::task::1168::TaskManager.Task::(prepare) Task=`ad12c834-4f3a-46d3-8f27-2e88da722689`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:24:38,147::task::579::TaskManager.Task::(_updateState) Task=`ad12c834-4f3a-46d3-8f27-2e88da722689`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:24:38,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:24:38,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:24:38,147::task::974::TaskManager.Task::(_decref) Task=`ad12c834-4f3a-46d3-8f27-2e88da722689`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:24:38,148::task::579::TaskManager.Task::(_updateState) Task=`acdbc9c5-106c-46e1-960b-7c0eadad7055`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:24:38,148::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:24:38,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:24:38,148::task::1168::TaskManager.Task::(prepare) Task=`acdbc9c5-106c-46e1-960b-7c0eadad7055`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:24:38,148::task::579::TaskManager.Task::(_updateState) Task=`acdbc9c5-106c-46e1-960b-7c0eadad7055`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:24:38,149::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:24:38,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:24:38,149::task::974::TaskManager.Task::(_decref) Task=`acdbc9c5-106c-46e1-960b-7c0eadad7055`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:24:38,149::task::579::TaskManager.Task::(_updateState) Task=`1acc7650-f58b-4dd7-8d7f-021380d1a0b9`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:24:38,149::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:24:38,150::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:24:38,150::task::1168::TaskManager.Task::(prepare) Task=`1acc7650-f58b-4dd7-8d7f-021380d1a0b9`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:24:38,150::task::579::TaskManager.Task::(_updateState) Task=`1acc7650-f58b-4dd7-8d7f-021380d1a0b9`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:24:38,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:24:38,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:24:38,150::task::974::TaskManager.Task::(_decref) Task=`1acc7650-f58b-4dd7-8d7f-021380d1a0b9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:38,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:24:38,511::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:24:38,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:38,978::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:39,512::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:24:39,512::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:24:39,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:40,514::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:24:40,514::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:24:40,514::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:24:40,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:40,979::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286552::DEBUG::2014-01-16 16:24:41,344::task::579::TaskManager.Task::(_updateState) Task=`0f2104e2-f63d-4724-a400-e6e2a2111d4a`::moving from state init -> state preparing >Thread-286552::INFO::2014-01-16 16:24:41,344::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286552::INFO::2014-01-16 16:24:41,344::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292273', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222386', 'lastCheck': '6.8', 'valid': True}} >Thread-286552::DEBUG::2014-01-16 16:24:41,345::task::1168::TaskManager.Task::(prepare) Task=`0f2104e2-f63d-4724-a400-e6e2a2111d4a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292273', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222386', 'lastCheck': '6.8', 'valid': True}} >Thread-286552::DEBUG::2014-01-16 16:24:41,345::task::579::TaskManager.Task::(_updateState) Task=`0f2104e2-f63d-4724-a400-e6e2a2111d4a`::moving from state preparing -> state finished >Thread-286552::DEBUG::2014-01-16 16:24:41,345::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286552::DEBUG::2014-01-16 16:24:41,345::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286552::DEBUG::2014-01-16 16:24:41,345::task::974::TaskManager.Task::(_decref) Task=`0f2104e2-f63d-4724-a400-e6e2a2111d4a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:41,516::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:42,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:24:42,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:42,980::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:42,982::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:24:42,982::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:24:42,983::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:43,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:24:44,429::task::579::TaskManager.Task::(_updateState) Task=`260aa4ce-7ec7-44d9-854b-f505211b823b`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:24:44,429::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:24:44,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:24:44,430::task::1168::TaskManager.Task::(prepare) Task=`260aa4ce-7ec7-44d9-854b-f505211b823b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:24:44,430::task::579::TaskManager.Task::(_updateState) Task=`260aa4ce-7ec7-44d9-854b-f505211b823b`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:24:44,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:24:44,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:24:44,430::task::974::TaskManager.Task::(_decref) Task=`260aa4ce-7ec7-44d9-854b-f505211b823b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:44,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:44,552::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:24:44,577::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000257855 s, 15.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:44,985::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:45,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:46,521::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:24:46,875::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:24:46,891::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000284811 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:46,986::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:47,523::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:47,988::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:48,524::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:24:48,524::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:24:48,637::task::579::TaskManager.Task::(_updateState) Task=`61b5c7be-d487-46b8-8df2-d5b53d7bb396`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:24:48,638::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:24:48,638::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:24:48,638::task::1168::TaskManager.Task::(prepare) Task=`61b5c7be-d487-46b8-8df2-d5b53d7bb396`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:24:48,638::task::579::TaskManager.Task::(_updateState) Task=`61b5c7be-d487-46b8-8df2-d5b53d7bb396`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:24:48,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:24:48,639::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:24:48,639::task::974::TaskManager.Task::(_decref) Task=`61b5c7be-d487-46b8-8df2-d5b53d7bb396`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:48,989::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:49,526::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:50,527::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:50,990::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:51,528::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:52,530::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:52,991::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:24:52,993::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:53,531::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:24:53,531::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:24:53,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:54,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:24:54,533::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:24:54,583::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-48934::DEBUG::2014-01-16 16:24:54,602::task::579::TaskManager.Task::(_updateState) Task=`ee5a5ed1-bfd5-4dc1-8772-7e35e57a2bb7`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:24:54,608::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:24:54,614::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:24:54,617::task::1168::TaskManager.Task::(prepare) Task=`ee5a5ed1-bfd5-4dc1-8772-7e35e57a2bb7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:24:54,619::task::579::TaskManager.Task::(_updateState) Task=`ee5a5ed1-bfd5-4dc1-8772-7e35e57a2bb7`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:24:54,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:24:54,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:24:54,624::task::974::TaskManager.Task::(_decref) Task=`ee5a5ed1-bfd5-4dc1-8772-7e35e57a2bb7`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:24:54,627::task::579::TaskManager.Task::(_updateState) Task=`3ed9278a-39a7-45d2-a7ac-6d6b2495b7b5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:24:54,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-22::DEBUG::2014-01-16 16:24:54,630::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000201738 s, 20.3 MB/s\n'; <rc> = 0 >Thread-48934::INFO::2014-01-16 16:24:54,630::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:24:54,631::task::1168::TaskManager.Task::(prepare) Task=`3ed9278a-39a7-45d2-a7ac-6d6b2495b7b5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:24:54,632::task::579::TaskManager.Task::(_updateState) Task=`3ed9278a-39a7-45d2-a7ac-6d6b2495b7b5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:24:54,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:24:54,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:24:54,634::task::974::TaskManager.Task::(_decref) Task=`3ed9278a-39a7-45d2-a7ac-6d6b2495b7b5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:24:54,634::task::579::TaskManager.Task::(_updateState) Task=`03101e33-e555-4875-9a30-a498c1962450`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:24:54,635::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:24:54,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:24:54,635::task::1168::TaskManager.Task::(prepare) Task=`03101e33-e555-4875-9a30-a498c1962450`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:24:54,635::task::579::TaskManager.Task::(_updateState) Task=`03101e33-e555-4875-9a30-a498c1962450`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:24:54,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:24:54,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:24:54,636::task::974::TaskManager.Task::(_decref) Task=`03101e33-e555-4875-9a30-a498c1962450`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:24:54,994::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:24:55,466::task::579::TaskManager.Task::(_updateState) Task=`264a273d-061c-4930-b83f-a13913f46be0`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:24:55,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:24:55,467::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:24:55,467::task::1168::TaskManager.Task::(prepare) Task=`264a273d-061c-4930-b83f-a13913f46be0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:24:55,467::task::579::TaskManager.Task::(_updateState) Task=`264a273d-061c-4930-b83f-a13913f46be0`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:24:55,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:24:55,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:24:55,467::task::974::TaskManager.Task::(_decref) Task=`264a273d-061c-4930-b83f-a13913f46be0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:55,535::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:24:55,535::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:24:55,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:24:56,536::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:24:56,537::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:24:56,898::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:24:56,915::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274408 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:24:56,995::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286558::DEBUG::2014-01-16 16:24:57,217::task::579::TaskManager.Task::(_updateState) Task=`22f6d89a-55f7-4bb9-b281-9c8642fbbb82`::moving from state init -> state preparing >Thread-286558::INFO::2014-01-16 16:24:57,217::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286558::INFO::2014-01-16 16:24:57,217::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274408', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201738', 'lastCheck': '2.6', 'valid': True}} >Thread-286558::DEBUG::2014-01-16 16:24:57,218::task::1168::TaskManager.Task::(prepare) Task=`22f6d89a-55f7-4bb9-b281-9c8642fbbb82`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274408', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201738', 'lastCheck': '2.6', 'valid': True}} >Thread-286558::DEBUG::2014-01-16 16:24:57,218::task::579::TaskManager.Task::(_updateState) Task=`22f6d89a-55f7-4bb9-b281-9c8642fbbb82`::moving from state preparing -> state finished >Thread-286558::DEBUG::2014-01-16 16:24:57,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286558::DEBUG::2014-01-16 16:24:57,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286558::DEBUG::2014-01-16 16:24:57,218::task::974::TaskManager.Task::(_decref) Task=`22f6d89a-55f7-4bb9-b281-9c8642fbbb82`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:24:57,538::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:24:57,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:57,997::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:24:57,998::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:24:57,999::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:58,539::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:24:59,000::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:24:59,540::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:24:59,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:24:59,924::task::579::TaskManager.Task::(_updateState) Task=`7fe9b782-cd6f-4a21-8b54-b200242ee6b5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:24:59,924::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:24:59,924::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:24:59,924::task::1168::TaskManager.Task::(prepare) Task=`7fe9b782-cd6f-4a21-8b54-b200242ee6b5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:24:59,925::task::579::TaskManager.Task::(_updateState) Task=`7fe9b782-cd6f-4a21-8b54-b200242ee6b5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:24:59,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:24:59,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:24:59,925::task::974::TaskManager.Task::(_decref) Task=`7fe9b782-cd6f-4a21-8b54-b200242ee6b5`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:24:59,925::task::579::TaskManager.Task::(_updateState) Task=`40ffa961-d0ef-444e-a6da-7bfe82a35f0a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:24:59,925::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:24:59,926::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:24:59,926::task::1168::TaskManager.Task::(prepare) Task=`40ffa961-d0ef-444e-a6da-7bfe82a35f0a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:24:59,926::task::579::TaskManager.Task::(_updateState) Task=`40ffa961-d0ef-444e-a6da-7bfe82a35f0a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:24:59,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:24:59,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:24:59,926::task::974::TaskManager.Task::(_decref) Task=`40ffa961-d0ef-444e-a6da-7bfe82a35f0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:00,542::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:25:00,542::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:01,001::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:01,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:25:01,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:25:01,545::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:25:01,545::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:02,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:25:02,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:25:02,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:25:02,628::task::579::TaskManager.Task::(_updateState) Task=`60195412-1d56-4fd2-beea-8cdc78cd8b4c`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:25:02,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:25:02,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:25:02,629::task::1168::TaskManager.Task::(prepare) Task=`60195412-1d56-4fd2-beea-8cdc78cd8b4c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:25:02,629::task::579::TaskManager.Task::(_updateState) Task=`60195412-1d56-4fd2-beea-8cdc78cd8b4c`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:25:02,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:25:02,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:25:02,629::task::974::TaskManager.Task::(_decref) Task=`60195412-1d56-4fd2-beea-8cdc78cd8b4c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:03,002::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:03,003::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:03,547::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:25:03,548::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 16:25:04,365::task::579::TaskManager.Task::(_updateState) Task=`2a3f8087-7f53-4a09-a29d-227cb467e8ff`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 16:25:04,365::task::579::TaskManager.Task::(_updateState) Task=`53be1660-4cf4-44b2-a969-ec264f52af2e`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:25:04,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:25:04,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:25:04,367::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:25:04,367::task::1168::TaskManager.Task::(prepare) Task=`2a3f8087-7f53-4a09-a29d-227cb467e8ff`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 16:25:04,367::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:25:04,368::task::579::TaskManager.Task::(_updateState) Task=`2a3f8087-7f53-4a09-a29d-227cb467e8ff`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:25:04,368::task::1168::TaskManager.Task::(prepare) Task=`53be1660-4cf4-44b2-a969-ec264f52af2e`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:25:04,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:25:04,368::task::579::TaskManager.Task::(_updateState) Task=`53be1660-4cf4-44b2-a969-ec264f52af2e`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:25:04,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:25:04,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:25:04,369::task::974::TaskManager.Task::(_decref) Task=`2a3f8087-7f53-4a09-a29d-227cb467e8ff`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:25:04,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:25:04,370::task::974::TaskManager.Task::(_decref) Task=`53be1660-4cf4-44b2-a969-ec264f52af2e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:04,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:25:04,549::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:25:04,549::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:25:04,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:25:04,635::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:25:04,635::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:25:04,635::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:25:04,635::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:25:04,639::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:04,656::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00037607 s, 5.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:25:04,656::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00037607 s, 5.4 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:25:04,656::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:25:04,656::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:25:04,657::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:25:04,657::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:25:04,657::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:25:04,658::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:25:04,658::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:25:04,658::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:25:04,659::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:04,871::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:25:04,877::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:25:04,878::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:25:04,878::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:25:04,879::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:25:04,879::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:25:04,879::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:25:05,005::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:25:05,042::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:25:05,045::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:05,060::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000296579 s, 13.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:25:05,550::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:25:05,627::task::579::TaskManager.Task::(_updateState) Task=`83a7f1ec-19e5-40c5-8ae4-856cae148f24`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:25:05,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:25:05,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:25:05,629::task::1168::TaskManager.Task::(prepare) Task=`83a7f1ec-19e5-40c5-8ae4-856cae148f24`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:25:05,629::task::579::TaskManager.Task::(_updateState) Task=`83a7f1ec-19e5-40c5-8ae4-856cae148f24`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:25:05,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:25:05,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:25:05,630::task::974::TaskManager.Task::(_decref) Task=`83a7f1ec-19e5-40c5-8ae4-856cae148f24`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:25:05,630::task::579::TaskManager.Task::(_updateState) Task=`df07dec1-be4a-4f5c-a444-fa2ec534eecb`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:25:05,630::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:25:05,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:25:05,631::task::1168::TaskManager.Task::(prepare) Task=`df07dec1-be4a-4f5c-a444-fa2ec534eecb`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:25:05,631::task::579::TaskManager.Task::(_updateState) Task=`df07dec1-be4a-4f5c-a444-fa2ec534eecb`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:25:05,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:25:05,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:25:05,632::task::974::TaskManager.Task::(_decref) Task=`df07dec1-be4a-4f5c-a444-fa2ec534eecb`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:25:06,129::task::579::TaskManager.Task::(_updateState) Task=`3527a001-9b47-43d7-b5aa-b69949391f9f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:25:06,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:25:06,130::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:25:06,130::task::1168::TaskManager.Task::(prepare) Task=`3527a001-9b47-43d7-b5aa-b69949391f9f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:25:06,130::task::579::TaskManager.Task::(_updateState) Task=`3527a001-9b47-43d7-b5aa-b69949391f9f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:25:06,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:25:06,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:25:06,131::task::974::TaskManager.Task::(_decref) Task=`3527a001-9b47-43d7-b5aa-b69949391f9f`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:25:06,131::task::579::TaskManager.Task::(_updateState) Task=`99ab6c50-17e9-4ad4-a247-b6235bf257d5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:25:06,131::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:25:06,131::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:25:06,131::task::1168::TaskManager.Task::(prepare) Task=`99ab6c50-17e9-4ad4-a247-b6235bf257d5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:25:06,132::task::579::TaskManager.Task::(_updateState) Task=`99ab6c50-17e9-4ad4-a247-b6235bf257d5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:25:06,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:25:06,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:25:06,132::task::974::TaskManager.Task::(_decref) Task=`99ab6c50-17e9-4ad4-a247-b6235bf257d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:06,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:25:06,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:25:06,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:25:06,552::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:06,552::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:25:06,553::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:25:06,847::task::579::TaskManager.Task::(_updateState) Task=`898f743c-ed95-4250-8365-0d90eb727cf0`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:25:06,848::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:25:06,848::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:25:06,848::task::1168::TaskManager.Task::(prepare) Task=`898f743c-ed95-4250-8365-0d90eb727cf0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:25:06,848::task::579::TaskManager.Task::(_updateState) Task=`898f743c-ed95-4250-8365-0d90eb727cf0`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:25:06,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:25:06,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:25:06,849::task::974::TaskManager.Task::(_decref) Task=`898f743c-ed95-4250-8365-0d90eb727cf0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:25:06,926::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:25:06,944::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00028559 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:25:06,949::task::579::TaskManager.Task::(_updateState) Task=`25dae95a-cc83-4338-8658-65484b6b2422`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:25:06,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:25:06,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:25:06,950::task::1168::TaskManager.Task::(prepare) Task=`25dae95a-cc83-4338-8658-65484b6b2422`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:25:06,950::task::579::TaskManager.Task::(_updateState) Task=`25dae95a-cc83-4338-8658-65484b6b2422`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:25:06,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:25:06,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:25:06,950::task::974::TaskManager.Task::(_decref) Task=`25dae95a-cc83-4338-8658-65484b6b2422`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:07,007::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:07,555::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:08,009::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:25:08,022::task::579::TaskManager.Task::(_updateState) Task=`39df30f7-0db3-4510-931a-40d8c5340d38`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:25:08,022::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:25:08,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:25:08,023::task::1168::TaskManager.Task::(prepare) Task=`39df30f7-0db3-4510-931a-40d8c5340d38`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:25:08,023::task::579::TaskManager.Task::(_updateState) Task=`39df30f7-0db3-4510-931a-40d8c5340d38`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:25:08,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:25:08,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:25:08,024::task::974::TaskManager.Task::(_decref) Task=`39df30f7-0db3-4510-931a-40d8c5340d38`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:08,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:25:08,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:25:08,556::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:09,010::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:25:09,107::task::579::TaskManager.Task::(_updateState) Task=`635e3a82-a31f-43a6-83ee-ff274d46ed2a`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:25:09,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:25:09,108::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:25:09,108::task::1168::TaskManager.Task::(prepare) Task=`635e3a82-a31f-43a6-83ee-ff274d46ed2a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:25:09,108::task::579::TaskManager.Task::(_updateState) Task=`635e3a82-a31f-43a6-83ee-ff274d46ed2a`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:25:09,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:25:09,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:25:09,108::task::974::TaskManager.Task::(_decref) Task=`635e3a82-a31f-43a6-83ee-ff274d46ed2a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:09,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:25:09,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:25:09,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:10,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:25:10,559::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:25:10,559::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:25:10,559::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:11,011::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:11,559::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:25:12,141::task::579::TaskManager.Task::(_updateState) Task=`0cb08eea-8e29-4132-af49-5d8286b2c7bc`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:25:12,141::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:25:12,141::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:25:12,141::task::1168::TaskManager.Task::(prepare) Task=`0cb08eea-8e29-4132-af49-5d8286b2c7bc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:25:12,142::task::579::TaskManager.Task::(_updateState) Task=`0cb08eea-8e29-4132-af49-5d8286b2c7bc`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:25:12,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:25:12,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:25:12,142::task::974::TaskManager.Task::(_decref) Task=`0cb08eea-8e29-4132-af49-5d8286b2c7bc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:12,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:25:12,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286564::DEBUG::2014-01-16 16:25:12,971::task::579::TaskManager.Task::(_updateState) Task=`3180ec58-1a28-4ada-8a5f-80a61c9a2da0`::moving from state init -> state preparing >Thread-286564::INFO::2014-01-16 16:25:12,971::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286564::INFO::2014-01-16 16:25:12,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00028559', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296579', 'lastCheck': '7.9', 'valid': True}} >Thread-286564::DEBUG::2014-01-16 16:25:12,971::task::1168::TaskManager.Task::(prepare) Task=`3180ec58-1a28-4ada-8a5f-80a61c9a2da0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00028559', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296579', 'lastCheck': '7.9', 'valid': True}} >Thread-286564::DEBUG::2014-01-16 16:25:12,972::task::579::TaskManager.Task::(_updateState) Task=`3180ec58-1a28-4ada-8a5f-80a61c9a2da0`::moving from state preparing -> state finished >Thread-286564::DEBUG::2014-01-16 16:25:12,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286564::DEBUG::2014-01-16 16:25:12,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286564::DEBUG::2014-01-16 16:25:12,972::task::974::TaskManager.Task::(_decref) Task=`3180ec58-1a28-4ada-8a5f-80a61c9a2da0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:13,013::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:13,013::task::579::TaskManager.Task::(_updateState) Task=`42501679-6e87-4103-bc9f-c7d292cf70db`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:25:13,013::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:25:13,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:25:13,014::task::1168::TaskManager.Task::(prepare) Task=`42501679-6e87-4103-bc9f-c7d292cf70db`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:25:13,014::task::579::TaskManager.Task::(_updateState) Task=`42501679-6e87-4103-bc9f-c7d292cf70db`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:25:13,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:25:13,014::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:25:13,014::task::974::TaskManager.Task::(_decref) Task=`42501679-6e87-4103-bc9f-c7d292cf70db`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:13,016::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:25:13,016::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:25:13,018::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:13,019::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:13,020::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:13,562::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:14,563::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:15,021::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:25:15,066::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:15,082::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000238081 s, 17.2 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:25:15,510::task::579::TaskManager.Task::(_updateState) Task=`7aeab8bb-df25-4f48-bda9-7e428d4cae25`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:25:15,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:25:15,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:25:15,511::task::1168::TaskManager.Task::(prepare) Task=`7aeab8bb-df25-4f48-bda9-7e428d4cae25`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:25:15,511::task::579::TaskManager.Task::(_updateState) Task=`7aeab8bb-df25-4f48-bda9-7e428d4cae25`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:25:15,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:25:15,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:25:15,511::task::974::TaskManager.Task::(_decref) Task=`7aeab8bb-df25-4f48-bda9-7e428d4cae25`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:15,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:25:15,623::task::579::TaskManager.Task::(_updateState) Task=`3efc88fc-b82f-46ea-aaad-bc9c74a90bae`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:25:15,623::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:25:15,625::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:25:15,625::task::1168::TaskManager.Task::(prepare) Task=`3efc88fc-b82f-46ea-aaad-bc9c74a90bae`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:25:15,625::task::579::TaskManager.Task::(_updateState) Task=`3efc88fc-b82f-46ea-aaad-bc9c74a90bae`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:25:15,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:25:15,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:25:15,625::task::974::TaskManager.Task::(_decref) Task=`3efc88fc-b82f-46ea-aaad-bc9c74a90bae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:16,566::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:25:16,952::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:25:16,968::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276449 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:25:17,023::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:17,567::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:18,024::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:18,568::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:25:18,569::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:19,026::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:19,570::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:25:20,502::task::579::TaskManager.Task::(_updateState) Task=`58382c41-a0b9-43fe-98c9-4002bbf167ba`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:25:20,503::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:25:20,503::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:25:20,503::task::1168::TaskManager.Task::(prepare) Task=`58382c41-a0b9-43fe-98c9-4002bbf167ba`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:25:20,503::task::579::TaskManager.Task::(_updateState) Task=`58382c41-a0b9-43fe-98c9-4002bbf167ba`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:25:20,503::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:25:20,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:25:20,504::task::974::TaskManager.Task::(_decref) Task=`58382c41-a0b9-43fe-98c9-4002bbf167ba`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:25:20,504::task::579::TaskManager.Task::(_updateState) Task=`c8b598f6-88be-4071-a5a6-6bca3be6892e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:25:20,504::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:25:20,504::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:25:20,504::task::1168::TaskManager.Task::(prepare) Task=`c8b598f6-88be-4071-a5a6-6bca3be6892e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:25:20,505::task::579::TaskManager.Task::(_updateState) Task=`c8b598f6-88be-4071-a5a6-6bca3be6892e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:25:20,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:25:20,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:25:20,505::task::974::TaskManager.Task::(_decref) Task=`c8b598f6-88be-4071-a5a6-6bca3be6892e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:20,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:21,027::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:21,573::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:22,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:23,028::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:23,029::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:23,576::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:25:23,577::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:25:23,577::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:25:23,686::task::579::TaskManager.Task::(_updateState) Task=`c65bd4a1-5824-44fe-912f-a0ddcd277ede`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:25:23,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:25:23,687::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:25:23,687::task::1168::TaskManager.Task::(prepare) Task=`c65bd4a1-5824-44fe-912f-a0ddcd277ede`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:25:23,687::task::579::TaskManager.Task::(_updateState) Task=`c65bd4a1-5824-44fe-912f-a0ddcd277ede`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:25:23,687::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:25:23,687::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:25:23,687::task::974::TaskManager.Task::(_decref) Task=`c65bd4a1-5824-44fe-912f-a0ddcd277ede`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:25:24,041::task::579::TaskManager.Task::(_updateState) Task=`90ccff79-e50a-4e44-9d7c-2aff2f91a095`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:25:24,042::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:25:24,042::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:25:24,043::task::1168::TaskManager.Task::(prepare) Task=`90ccff79-e50a-4e44-9d7c-2aff2f91a095`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:25:24,043::task::579::TaskManager.Task::(_updateState) Task=`90ccff79-e50a-4e44-9d7c-2aff2f91a095`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:25:24,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:25:24,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:25:24,043::task::974::TaskManager.Task::(_decref) Task=`90ccff79-e50a-4e44-9d7c-2aff2f91a095`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:24,577::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:25:24,578::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:25,030::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:25:25,089::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:25,109::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000271341 s, 15.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:25:25,579::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:25:25,580::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:25:25,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:26,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:25:26,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:25:26,979::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:25:26,995::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000253887 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:25:27,031::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:25:27,171::task::579::TaskManager.Task::(_updateState) Task=`bfe19a8c-7494-448b-8eca-51abfed138b0`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:25:27,171::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:25:27,172::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:25:27,172::task::1168::TaskManager.Task::(prepare) Task=`bfe19a8c-7494-448b-8eca-51abfed138b0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:25:27,172::task::579::TaskManager.Task::(_updateState) Task=`bfe19a8c-7494-448b-8eca-51abfed138b0`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:25:27,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:25:27,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:25:27,172::task::974::TaskManager.Task::(_decref) Task=`bfe19a8c-7494-448b-8eca-51abfed138b0`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:25:27,193::task::579::TaskManager.Task::(_updateState) Task=`5fd8e91e-a6e0-4004-98b1-3251a2626dbf`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:25:27,193::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:25:27,193::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:25:27,194::task::1168::TaskManager.Task::(prepare) Task=`5fd8e91e-a6e0-4004-98b1-3251a2626dbf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:25:27,194::task::579::TaskManager.Task::(_updateState) Task=`5fd8e91e-a6e0-4004-98b1-3251a2626dbf`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:25:27,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:25:27,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:25:27,194::task::974::TaskManager.Task::(_decref) Task=`5fd8e91e-a6e0-4004-98b1-3251a2626dbf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:27,582::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:25:27,582::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:28,034::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:25:28,034::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:25:28,043::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:28,584::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286570::DEBUG::2014-01-16 16:25:28,841::task::579::TaskManager.Task::(_updateState) Task=`f4b836de-4d5b-44f0-9cbc-fa15b9299f42`::moving from state init -> state preparing >Thread-286570::INFO::2014-01-16 16:25:28,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286570::INFO::2014-01-16 16:25:28,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253887', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271341', 'lastCheck': '3.7', 'valid': True}} >Thread-286570::DEBUG::2014-01-16 16:25:28,841::task::1168::TaskManager.Task::(prepare) Task=`f4b836de-4d5b-44f0-9cbc-fa15b9299f42`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253887', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271341', 'lastCheck': '3.7', 'valid': True}} >Thread-286570::DEBUG::2014-01-16 16:25:28,842::task::579::TaskManager.Task::(_updateState) Task=`f4b836de-4d5b-44f0-9cbc-fa15b9299f42`::moving from state preparing -> state finished >Thread-286570::DEBUG::2014-01-16 16:25:28,842::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286570::DEBUG::2014-01-16 16:25:28,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286570::DEBUG::2014-01-16 16:25:28,842::task::974::TaskManager.Task::(_decref) Task=`f4b836de-4d5b-44f0-9cbc-fa15b9299f42`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:29,050::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:29,585::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:25:29,585::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:30,586::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:25:30,587::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:31,051::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:31,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:25:31,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:25:31,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:25:31,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:25:32,227::task::579::TaskManager.Task::(_updateState) Task=`b63951a2-8f9f-4c0f-b74d-e8977f6cc8a3`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:25:32,228::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:25:32,228::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:25:32,229::task::1168::TaskManager.Task::(prepare) Task=`b63951a2-8f9f-4c0f-b74d-e8977f6cc8a3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:25:32,229::task::579::TaskManager.Task::(_updateState) Task=`b63951a2-8f9f-4c0f-b74d-e8977f6cc8a3`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:25:32,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:25:32,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:25:32,229::task::974::TaskManager.Task::(_decref) Task=`b63951a2-8f9f-4c0f-b74d-e8977f6cc8a3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:32,589::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:25:32,590::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:25:32,590::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:33,053::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:33,054::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:33,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:25:33,591::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:34,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:25:34,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:25:34,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:25:34,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:25:34,878::task::579::TaskManager.Task::(_updateState) Task=`002feedb-7657-4731-a4cd-389d610b63a7`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:25:34,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:25:34,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:25:34,879::task::1168::TaskManager.Task::(prepare) Task=`002feedb-7657-4731-a4cd-389d610b63a7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:25:34,879::task::579::TaskManager.Task::(_updateState) Task=`002feedb-7657-4731-a4cd-389d610b63a7`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:25:34,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:25:34,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:25:34,879::task::974::TaskManager.Task::(_decref) Task=`002feedb-7657-4731-a4cd-389d610b63a7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:35,055::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:25:35,120::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:35,137::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000381575 s, 10.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:25:35,594::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:25:35,607::task::579::TaskManager.Task::(_updateState) Task=`c9607e13-c142-4d4b-b633-e54d5c9a2616`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:25:35,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:25:35,608::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:25:35,608::task::1168::TaskManager.Task::(prepare) Task=`c9607e13-c142-4d4b-b633-e54d5c9a2616`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:25:35,608::task::579::TaskManager.Task::(_updateState) Task=`c9607e13-c142-4d4b-b633-e54d5c9a2616`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:25:35,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:25:35,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:25:35,609::task::974::TaskManager.Task::(_decref) Task=`c9607e13-c142-4d4b-b633-e54d5c9a2616`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:25:35,720::task::579::TaskManager.Task::(_updateState) Task=`ac0be609-f67d-4dd9-9b1b-a1a674173e7b`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:25:35,721::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:25:35,721::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:25:35,721::task::1168::TaskManager.Task::(prepare) Task=`ac0be609-f67d-4dd9-9b1b-a1a674173e7b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:25:35,721::task::579::TaskManager.Task::(_updateState) Task=`ac0be609-f67d-4dd9-9b1b-a1a674173e7b`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:25:35,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:25:35,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:25:35,722::task::974::TaskManager.Task::(_decref) Task=`ac0be609-f67d-4dd9-9b1b-a1a674173e7b`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:25:35,747::task::579::TaskManager.Task::(_updateState) Task=`90481f5e-79a9-49e4-b341-1ab4c162cc0c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:25:35,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:25:35,748::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:25:35,748::task::1168::TaskManager.Task::(prepare) Task=`90481f5e-79a9-49e4-b341-1ab4c162cc0c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:25:35,748::task::579::TaskManager.Task::(_updateState) Task=`90481f5e-79a9-49e4-b341-1ab4c162cc0c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:25:35,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:25:35,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:25:35,749::task::974::TaskManager.Task::(_decref) Task=`90481f5e-79a9-49e4-b341-1ab4c162cc0c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:36,595::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >Thread-20952::DEBUG::2014-01-16 16:25:36,597::task::579::TaskManager.Task::(_updateState) Task=`f8c4bc42-7c52-42f8-9db9-5efe3faba7df`::moving from state init -> state preparing >VM Channels Listener::DEBUG::2014-01-16 16:25:36,598::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >Thread-20952::INFO::2014-01-16 16:25:36,599::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >VM Channels Listener::DEBUG::2014-01-16 16:25:36,599::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:25:36,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::INFO::2014-01-16 16:25:36,602::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:25:36,604::task::1168::TaskManager.Task::(prepare) Task=`f8c4bc42-7c52-42f8-9db9-5efe3faba7df`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >VM Channels Listener::DEBUG::2014-01-16 16:25:36,603::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >Thread-20952::DEBUG::2014-01-16 16:25:36,605::task::579::TaskManager.Task::(_updateState) Task=`f8c4bc42-7c52-42f8-9db9-5efe3faba7df`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:25:36,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:25:36,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:25:36,606::task::974::TaskManager.Task::(_decref) Task=`f8c4bc42-7c52-42f8-9db9-5efe3faba7df`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:36,607::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-12152::DEBUG::2014-01-16 16:25:36,902::task::579::TaskManager.Task::(_updateState) Task=`0cff4e14-84db-42e0-b7b5-4764ac810180`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:25:36,903::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:25:36,903::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:25:36,903::task::1168::TaskManager.Task::(prepare) Task=`0cff4e14-84db-42e0-b7b5-4764ac810180`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:25:36,903::task::579::TaskManager.Task::(_updateState) Task=`0cff4e14-84db-42e0-b7b5-4764ac810180`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:25:36,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:25:36,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:25:36,904::task::974::TaskManager.Task::(_decref) Task=`0cff4e14-84db-42e0-b7b5-4764ac810180`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:25:37,003::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:25:37,019::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292179 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:25:37,056::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:37,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:38,058::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:25:38,424::task::579::TaskManager.Task::(_updateState) Task=`f6abe131-6786-4bfe-8176-72341def0c2a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:25:38,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:25:38,425::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:25:38,425::task::1168::TaskManager.Task::(prepare) Task=`f6abe131-6786-4bfe-8176-72341def0c2a`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:25:38,425::task::579::TaskManager.Task::(_updateState) Task=`f6abe131-6786-4bfe-8176-72341def0c2a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:25:38,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:25:38,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:25:38,426::task::974::TaskManager.Task::(_decref) Task=`f6abe131-6786-4bfe-8176-72341def0c2a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:25:38,426::task::579::TaskManager.Task::(_updateState) Task=`bf51218c-6a00-49a4-a17d-ce8f78e55646`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:25:38,426::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:25:38,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:25:38,427::task::1168::TaskManager.Task::(prepare) Task=`bf51218c-6a00-49a4-a17d-ce8f78e55646`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:25:38,427::task::579::TaskManager.Task::(_updateState) Task=`bf51218c-6a00-49a4-a17d-ce8f78e55646`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:25:38,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:25:38,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:25:38,427::task::974::TaskManager.Task::(_decref) Task=`bf51218c-6a00-49a4-a17d-ce8f78e55646`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:25:38,428::task::579::TaskManager.Task::(_updateState) Task=`5df2112f-781a-4428-82c3-5d44a4fb0f53`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:25:38,428::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:25:38,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:25:38,428::task::1168::TaskManager.Task::(prepare) Task=`5df2112f-781a-4428-82c3-5d44a4fb0f53`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:25:38,428::task::579::TaskManager.Task::(_updateState) Task=`5df2112f-781a-4428-82c3-5d44a4fb0f53`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:25:38,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:25:38,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:25:38,429::task::974::TaskManager.Task::(_decref) Task=`5df2112f-781a-4428-82c3-5d44a4fb0f53`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:38,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:25:38,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:25:38,608::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:39,059::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:39,609::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:25:39,609::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:25:39,609::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:40,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:25:40,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:25:40,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:25:40,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:41,060::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:41,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:42,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:25:42,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:43,062::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:43,064::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:25:43,064::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:25:43,065::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:43,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:25:44,595::task::579::TaskManager.Task::(_updateState) Task=`1853823d-87ea-4cf4-81e3-e0f9bac9acb6`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:25:44,595::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:25:44,595::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:25:44,595::task::1168::TaskManager.Task::(prepare) Task=`1853823d-87ea-4cf4-81e3-e0f9bac9acb6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:25:44,596::task::579::TaskManager.Task::(_updateState) Task=`1853823d-87ea-4cf4-81e3-e0f9bac9acb6`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:25:44,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:25:44,596::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:25:44,596::task::974::TaskManager.Task::(_decref) Task=`1853823d-87ea-4cf4-81e3-e0f9bac9acb6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:44,615::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286576::DEBUG::2014-01-16 16:25:44,621::task::579::TaskManager.Task::(_updateState) Task=`b1276874-de2a-4895-9cdd-01ea00b38ab6`::moving from state init -> state preparing >Thread-286576::INFO::2014-01-16 16:25:44,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286576::INFO::2014-01-16 16:25:44,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292179', 'lastCheck': '7.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381575', 'lastCheck': '9.5', 'valid': True}} >Thread-286576::DEBUG::2014-01-16 16:25:44,622::task::1168::TaskManager.Task::(prepare) Task=`b1276874-de2a-4895-9cdd-01ea00b38ab6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292179', 'lastCheck': '7.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381575', 'lastCheck': '9.5', 'valid': True}} >Thread-286576::DEBUG::2014-01-16 16:25:44,622::task::579::TaskManager.Task::(_updateState) Task=`b1276874-de2a-4895-9cdd-01ea00b38ab6`::moving from state preparing -> state finished >Thread-286576::DEBUG::2014-01-16 16:25:44,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286576::DEBUG::2014-01-16 16:25:44,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286576::DEBUG::2014-01-16 16:25:44,622::task::974::TaskManager.Task::(_decref) Task=`b1276874-de2a-4895-9cdd-01ea00b38ab6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:45,067::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:25:45,142::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:45,161::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000190002 s, 21.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:25:45,617::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:46,618::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:25:47,027::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:25:47,044::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000270363 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:25:47,068::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:47,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:48,069::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:48,621::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:25:48,621::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:25:48,818::task::579::TaskManager.Task::(_updateState) Task=`6e42d5ff-7238-4f4e-a70b-4c13d62ad93b`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:25:48,819::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:25:48,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:25:48,819::task::1168::TaskManager.Task::(prepare) Task=`6e42d5ff-7238-4f4e-a70b-4c13d62ad93b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:25:48,819::task::579::TaskManager.Task::(_updateState) Task=`6e42d5ff-7238-4f4e-a70b-4c13d62ad93b`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:25:48,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:25:48,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:25:48,820::task::974::TaskManager.Task::(_decref) Task=`6e42d5ff-7238-4f4e-a70b-4c13d62ad93b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:25:49,071::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:49,622::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:50,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:51,072::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:51,625::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:52,626::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:53,073::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:25:53,074::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:53,626::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:25:53,627::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:25:53,627::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:25:54,628::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:25:54,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:55,075::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:25:55,166::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:25:55,186::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00128213 s, 3.2 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 16:25:55,237::task::579::TaskManager.Task::(_updateState) Task=`4bfeabef-9026-42df-80cf-b9f2652c01e8`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:25:55,238::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:25:55,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:25:55,238::task::1168::TaskManager.Task::(prepare) Task=`4bfeabef-9026-42df-80cf-b9f2652c01e8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:25:55,238::task::579::TaskManager.Task::(_updateState) Task=`4bfeabef-9026-42df-80cf-b9f2652c01e8`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:25:55,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:25:55,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:25:55,239::task::974::TaskManager.Task::(_decref) Task=`4bfeabef-9026-42df-80cf-b9f2652c01e8`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:25:55,239::task::579::TaskManager.Task::(_updateState) Task=`58830946-5e66-42ce-aabe-7ec886a6229b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:25:55,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:25:55,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:25:55,240::task::1168::TaskManager.Task::(prepare) Task=`58830946-5e66-42ce-aabe-7ec886a6229b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:25:55,240::task::579::TaskManager.Task::(_updateState) Task=`58830946-5e66-42ce-aabe-7ec886a6229b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:25:55,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:25:55,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:25:55,241::task::974::TaskManager.Task::(_decref) Task=`58830946-5e66-42ce-aabe-7ec886a6229b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:25:55,241::task::579::TaskManager.Task::(_updateState) Task=`8c1ef873-2d49-428d-94b9-8e0fa855cc38`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:25:55,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:25:55,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:25:55,242::task::1168::TaskManager.Task::(prepare) Task=`8c1ef873-2d49-428d-94b9-8e0fa855cc38`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:25:55,242::task::579::TaskManager.Task::(_updateState) Task=`8c1ef873-2d49-428d-94b9-8e0fa855cc38`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:25:55,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:25:55,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:25:55,242::task::974::TaskManager.Task::(_decref) Task=`8c1ef873-2d49-428d-94b9-8e0fa855cc38`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:55,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:25:55,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:25:55,629::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:25:55,655::task::579::TaskManager.Task::(_updateState) Task=`a6961939-3b32-4a8f-ae09-f4787ab0ed36`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:25:55,655::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:25:55,656::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:25:55,656::task::1168::TaskManager.Task::(prepare) Task=`a6961939-3b32-4a8f-ae09-f4787ab0ed36`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:25:55,656::task::579::TaskManager.Task::(_updateState) Task=`a6961939-3b32-4a8f-ae09-f4787ab0ed36`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:25:55,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:25:55,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:25:55,657::task::974::TaskManager.Task::(_decref) Task=`a6961939-3b32-4a8f-ae09-f4787ab0ed36`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:25:56,631::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:25:56,631::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:25:57,052::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:25:57,069::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308597 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:25:57,077::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:57,632::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:25:57,633::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:58,079::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:25:58,080::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:25:58,081::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:58,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:25:59,082::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:25:59,635::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:25:59,635::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:26:00,183::task::579::TaskManager.Task::(_updateState) Task=`e74c0eda-09f6-419a-ad5c-a8de9ce99819`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:26:00,183::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:26:00,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:26:00,184::task::1168::TaskManager.Task::(prepare) Task=`e74c0eda-09f6-419a-ad5c-a8de9ce99819`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:26:00,184::task::579::TaskManager.Task::(_updateState) Task=`e74c0eda-09f6-419a-ad5c-a8de9ce99819`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:26:00,184::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:26:00,184::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:26:00,184::task::974::TaskManager.Task::(_decref) Task=`e74c0eda-09f6-419a-ad5c-a8de9ce99819`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:26:00,185::task::579::TaskManager.Task::(_updateState) Task=`db7fe972-754c-465f-b84f-bfd2f088b7e6`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:26:00,185::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:26:00,185::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:26:00,185::task::1168::TaskManager.Task::(prepare) Task=`db7fe972-754c-465f-b84f-bfd2f088b7e6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:26:00,185::task::579::TaskManager.Task::(_updateState) Task=`db7fe972-754c-465f-b84f-bfd2f088b7e6`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:26:00,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:26:00,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:26:00,186::task::974::TaskManager.Task::(_decref) Task=`db7fe972-754c-465f-b84f-bfd2f088b7e6`::ref 0 aborting False >Thread-286582::DEBUG::2014-01-16 16:26:00,370::task::579::TaskManager.Task::(_updateState) Task=`2ccc1e3a-ad3d-4692-9dd7-32cf5611c5a2`::moving from state init -> state preparing >Thread-286582::INFO::2014-01-16 16:26:00,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286582::INFO::2014-01-16 16:26:00,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308597', 'lastCheck': '3.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128213', 'lastCheck': '5.2', 'valid': True}} >Thread-286582::DEBUG::2014-01-16 16:26:00,371::task::1168::TaskManager.Task::(prepare) Task=`2ccc1e3a-ad3d-4692-9dd7-32cf5611c5a2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308597', 'lastCheck': '3.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128213', 'lastCheck': '5.2', 'valid': True}} >Thread-286582::DEBUG::2014-01-16 16:26:00,371::task::579::TaskManager.Task::(_updateState) Task=`2ccc1e3a-ad3d-4692-9dd7-32cf5611c5a2`::moving from state preparing -> state finished >Thread-286582::DEBUG::2014-01-16 16:26:00,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286582::DEBUG::2014-01-16 16:26:00,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286582::DEBUG::2014-01-16 16:26:00,371::task::974::TaskManager.Task::(_decref) Task=`2ccc1e3a-ad3d-4692-9dd7-32cf5611c5a2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:00,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:26:00,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:01,083::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:01,638::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:26:01,638::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:26:01,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:26:01,639::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:02,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:26:02,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:26:02,640::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:26:02,807::task::579::TaskManager.Task::(_updateState) Task=`359386c9-b425-40c7-bc13-d359fbd819a1`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:26:02,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:26:02,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:26:02,808::task::1168::TaskManager.Task::(prepare) Task=`359386c9-b425-40c7-bc13-d359fbd819a1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:26:02,808::task::579::TaskManager.Task::(_updateState) Task=`359386c9-b425-40c7-bc13-d359fbd819a1`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:26:02,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:26:02,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:26:02,809::task::974::TaskManager.Task::(_decref) Task=`359386c9-b425-40c7-bc13-d359fbd819a1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:03,085::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:03,086::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:03,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:26:03,641::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:26:04,474::task::579::TaskManager.Task::(_updateState) Task=`02427b9e-7bc4-49b0-8fe6-cdf21d9ae342`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:26:04,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:26:04,474::task::579::TaskManager.Task::(_updateState) Task=`70233d11-a180-4eea-9444-83a117d83579`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:26:04,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:26:04,476::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 16:26:04,476::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:26:04,476::task::1168::TaskManager.Task::(prepare) Task=`70233d11-a180-4eea-9444-83a117d83579`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:26:04,476::task::1168::TaskManager.Task::(prepare) Task=`02427b9e-7bc4-49b0-8fe6-cdf21d9ae342`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:26:04,477::task::579::TaskManager.Task::(_updateState) Task=`70233d11-a180-4eea-9444-83a117d83579`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:26:04,477::task::579::TaskManager.Task::(_updateState) Task=`02427b9e-7bc4-49b0-8fe6-cdf21d9ae342`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:26:04,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:26:04,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:26:04,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:26:04,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:26:04,478::task::974::TaskManager.Task::(_decref) Task=`70233d11-a180-4eea-9444-83a117d83579`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:26:04,478::task::974::TaskManager.Task::(_decref) Task=`02427b9e-7bc4-49b0-8fe6-cdf21d9ae342`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:04,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:26:04,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:26:04,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:26:04,643::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:05,087::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:26:05,192::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:26:05,209::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218688 s, 18.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:05,643::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:26:05,734::task::579::TaskManager.Task::(_updateState) Task=`cfcc4621-0752-4e7f-9768-861448f5b9af`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:26:05,734::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:26:05,736::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:26:05,736::task::1168::TaskManager.Task::(prepare) Task=`cfcc4621-0752-4e7f-9768-861448f5b9af`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:26:05,736::task::579::TaskManager.Task::(_updateState) Task=`cfcc4621-0752-4e7f-9768-861448f5b9af`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:26:05,736::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:26:05,736::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:26:05,737::task::974::TaskManager.Task::(_decref) Task=`cfcc4621-0752-4e7f-9768-861448f5b9af`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:26:05,737::task::579::TaskManager.Task::(_updateState) Task=`70634b97-9c4b-424c-b72b-28fc65b4993a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:26:05,737::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:26:05,737::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:26:05,737::task::1168::TaskManager.Task::(prepare) Task=`70634b97-9c4b-424c-b72b-28fc65b4993a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:26:05,738::task::579::TaskManager.Task::(_updateState) Task=`70634b97-9c4b-424c-b72b-28fc65b4993a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:26:05,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:26:05,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:26:05,738::task::974::TaskManager.Task::(_decref) Task=`70634b97-9c4b-424c-b72b-28fc65b4993a`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:26:06,350::task::579::TaskManager.Task::(_updateState) Task=`ebe76b88-0d04-4ad1-94a2-8abaf551dcc5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:26:06,350::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:26:06,351::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:26:06,351::task::1168::TaskManager.Task::(prepare) Task=`ebe76b88-0d04-4ad1-94a2-8abaf551dcc5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:26:06,351::task::579::TaskManager.Task::(_updateState) Task=`ebe76b88-0d04-4ad1-94a2-8abaf551dcc5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:26:06,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:26:06,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:26:06,351::task::974::TaskManager.Task::(_decref) Task=`ebe76b88-0d04-4ad1-94a2-8abaf551dcc5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:26:06,352::task::579::TaskManager.Task::(_updateState) Task=`c23150d4-5d8e-474c-8500-849a6eb9f461`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:26:06,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:26:06,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:26:06,352::task::1168::TaskManager.Task::(prepare) Task=`c23150d4-5d8e-474c-8500-849a6eb9f461`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:26:06,352::task::579::TaskManager.Task::(_updateState) Task=`c23150d4-5d8e-474c-8500-849a6eb9f461`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:26:06,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:26:06,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:26:06,353::task::974::TaskManager.Task::(_decref) Task=`c23150d4-5d8e-474c-8500-849a6eb9f461`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:06,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:26:06,645::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:26:06,645::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:26:06,645::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:06,645::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:26:06,646::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-26403::DEBUG::2014-01-16 16:26:07,026::task::579::TaskManager.Task::(_updateState) Task=`528dcbab-283c-48d7-b274-0be3699c96db`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:26:07,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:26:07,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:26:07,027::task::1168::TaskManager.Task::(prepare) Task=`528dcbab-283c-48d7-b274-0be3699c96db`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:26:07,027::task::579::TaskManager.Task::(_updateState) Task=`528dcbab-283c-48d7-b274-0be3699c96db`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:26:07,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:26:07,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:26:07,028::task::974::TaskManager.Task::(_decref) Task=`528dcbab-283c-48d7-b274-0be3699c96db`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:26:07,071::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:26:07,075::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:26:07,077::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:26:07,082::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:26:07,083::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:26:07,083::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:26:07,083::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-189817::DEBUG::2014-01-16 16:26:07,088::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:26:07,089::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:26:07,108::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308228 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:26:07,112::task::579::TaskManager.Task::(_updateState) Task=`c036df9f-4fd6-4fda-8eaf-1ddfab1f9ecc`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:26:07,112::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:26:07,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:26:07,113::task::1168::TaskManager.Task::(prepare) Task=`c036df9f-4fd6-4fda-8eaf-1ddfab1f9ecc`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:26:07,113::task::579::TaskManager.Task::(_updateState) Task=`c036df9f-4fd6-4fda-8eaf-1ddfab1f9ecc`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:26:07,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:26:07,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:26:07,113::task::974::TaskManager.Task::(_decref) Task=`c036df9f-4fd6-4fda-8eaf-1ddfab1f9ecc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:07,648::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:08,090::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:26:08,210::task::579::TaskManager.Task::(_updateState) Task=`e3a08ea2-2f80-432f-92e9-9d299568b051`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:26:08,211::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:26:08,211::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:26:08,211::task::1168::TaskManager.Task::(prepare) Task=`e3a08ea2-2f80-432f-92e9-9d299568b051`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:26:08,212::task::579::TaskManager.Task::(_updateState) Task=`e3a08ea2-2f80-432f-92e9-9d299568b051`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:26:08,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:26:08,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:26:08,212::task::974::TaskManager.Task::(_decref) Task=`e3a08ea2-2f80-432f-92e9-9d299568b051`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:08,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:26:08,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:26:08,649::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:09,092::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:26:09,284::task::579::TaskManager.Task::(_updateState) Task=`6e9c31a5-481e-4b1c-a1d2-87d03eadf43f`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:26:09,284::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:26:09,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:26:09,285::task::1168::TaskManager.Task::(prepare) Task=`6e9c31a5-481e-4b1c-a1d2-87d03eadf43f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:26:09,285::task::579::TaskManager.Task::(_updateState) Task=`6e9c31a5-481e-4b1c-a1d2-87d03eadf43f`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:26:09,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:26:09,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:26:09,285::task::974::TaskManager.Task::(_decref) Task=`6e9c31a5-481e-4b1c-a1d2-87d03eadf43f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:09,650::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:26:09,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:26:09,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:10,652::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:26:10,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:26:10,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:26:10,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:11,093::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:11,654::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:26:12,316::task::579::TaskManager.Task::(_updateState) Task=`2ac8a1e6-02d9-4664-a487-498936be3458`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:26:12,317::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:26:12,317::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:26:12,317::task::1168::TaskManager.Task::(prepare) Task=`2ac8a1e6-02d9-4664-a487-498936be3458`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:26:12,317::task::579::TaskManager.Task::(_updateState) Task=`2ac8a1e6-02d9-4664-a487-498936be3458`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:26:12,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:26:12,317::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:26:12,318::task::974::TaskManager.Task::(_decref) Task=`2ac8a1e6-02d9-4664-a487-498936be3458`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:12,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:26:12,656::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:13,094::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:13,095::task::579::TaskManager.Task::(_updateState) Task=`b1dd6139-245d-4fbc-87da-bd1856e8a47a`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:26:13,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:26:13,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:26:13,096::task::1168::TaskManager.Task::(prepare) Task=`b1dd6139-245d-4fbc-87da-bd1856e8a47a`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:26:13,096::task::579::TaskManager.Task::(_updateState) Task=`b1dd6139-245d-4fbc-87da-bd1856e8a47a`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:26:13,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:26:13,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:26:13,096::task::974::TaskManager.Task::(_decref) Task=`b1dd6139-245d-4fbc-87da-bd1856e8a47a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:13,098::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:26:13,098::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:26:13,099::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:13,101::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:13,102::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:13,656::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:14,658::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:15,103::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:26:15,215::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:26:15,232::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000308054 s, 13.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:15,659::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:26:15,699::task::579::TaskManager.Task::(_updateState) Task=`906411eb-df2c-47eb-9828-a3821fd04c02`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:26:15,699::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:26:15,699::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:26:15,699::task::1168::TaskManager.Task::(prepare) Task=`906411eb-df2c-47eb-9828-a3821fd04c02`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:26:15,700::task::579::TaskManager.Task::(_updateState) Task=`906411eb-df2c-47eb-9828-a3821fd04c02`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:26:15,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:26:15,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:26:15,700::task::974::TaskManager.Task::(_decref) Task=`906411eb-df2c-47eb-9828-a3821fd04c02`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:26:15,712::task::579::TaskManager.Task::(_updateState) Task=`060e74f4-315d-452c-80f1-a422f263fa3a`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:26:15,712::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:26:15,714::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:26:15,714::task::1168::TaskManager.Task::(prepare) Task=`060e74f4-315d-452c-80f1-a422f263fa3a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:26:15,714::task::579::TaskManager.Task::(_updateState) Task=`060e74f4-315d-452c-80f1-a422f263fa3a`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:26:15,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:26:15,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:26:15,714::task::974::TaskManager.Task::(_decref) Task=`060e74f4-315d-452c-80f1-a422f263fa3a`::ref 0 aborting False >Thread-286589::DEBUG::2014-01-16 16:26:16,371::task::579::TaskManager.Task::(_updateState) Task=`e244c86a-69df-4795-b02a-1f00f03ffe64`::moving from state init -> state preparing >Thread-286589::INFO::2014-01-16 16:26:16,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286589::INFO::2014-01-16 16:26:16,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308228', 'lastCheck': '9.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308054', 'lastCheck': '1.1', 'valid': True}} >Thread-286589::DEBUG::2014-01-16 16:26:16,371::task::1168::TaskManager.Task::(prepare) Task=`e244c86a-69df-4795-b02a-1f00f03ffe64`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308228', 'lastCheck': '9.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308054', 'lastCheck': '1.1', 'valid': True}} >Thread-286589::DEBUG::2014-01-16 16:26:16,372::task::579::TaskManager.Task::(_updateState) Task=`e244c86a-69df-4795-b02a-1f00f03ffe64`::moving from state preparing -> state finished >Thread-286589::DEBUG::2014-01-16 16:26:16,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286589::DEBUG::2014-01-16 16:26:16,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286589::DEBUG::2014-01-16 16:26:16,372::task::974::TaskManager.Task::(_decref) Task=`e244c86a-69df-4795-b02a-1f00f03ffe64`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:16,660::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:17,104::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:26:17,117::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:26:17,133::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000324501 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:17,661::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:18,106::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:18,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:26:18,662::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:19,109::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:19,663::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:20,664::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:26:20,873::task::579::TaskManager.Task::(_updateState) Task=`4c4cdf19-0ced-470a-bfaa-e80710955c5a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:26:20,874::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:26:20,874::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:26:20,874::task::1168::TaskManager.Task::(prepare) Task=`4c4cdf19-0ced-470a-bfaa-e80710955c5a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:26:20,874::task::579::TaskManager.Task::(_updateState) Task=`4c4cdf19-0ced-470a-bfaa-e80710955c5a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:26:20,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:26:20,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:26:20,875::task::974::TaskManager.Task::(_decref) Task=`4c4cdf19-0ced-470a-bfaa-e80710955c5a`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:26:20,875::task::579::TaskManager.Task::(_updateState) Task=`6cafd208-067d-42d6-82f5-1d6947edc389`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:26:20,876::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:26:20,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:26:20,876::task::1168::TaskManager.Task::(prepare) Task=`6cafd208-067d-42d6-82f5-1d6947edc389`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:26:20,876::task::579::TaskManager.Task::(_updateState) Task=`6cafd208-067d-42d6-82f5-1d6947edc389`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:26:20,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:26:20,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:26:20,876::task::974::TaskManager.Task::(_decref) Task=`6cafd208-067d-42d6-82f5-1d6947edc389`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:21,110::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:21,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:22,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:23,111::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:23,112::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:23,667::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:26:23,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:26:23,668::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:26:23,865::task::579::TaskManager.Task::(_updateState) Task=`d3a8a685-8e78-494f-97e5-8a4893d4e325`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:26:23,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:26:23,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:26:23,866::task::1168::TaskManager.Task::(prepare) Task=`d3a8a685-8e78-494f-97e5-8a4893d4e325`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:26:23,866::task::579::TaskManager.Task::(_updateState) Task=`d3a8a685-8e78-494f-97e5-8a4893d4e325`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:26:23,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:26:23,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:26:23,866::task::974::TaskManager.Task::(_decref) Task=`d3a8a685-8e78-494f-97e5-8a4893d4e325`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:26:24,109::task::579::TaskManager.Task::(_updateState) Task=`58e48bc9-7464-4c97-b5b5-3e8a2a801c55`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:26:24,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:26:24,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:26:24,110::task::1168::TaskManager.Task::(prepare) Task=`58e48bc9-7464-4c97-b5b5-3e8a2a801c55`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:26:24,110::task::579::TaskManager.Task::(_updateState) Task=`58e48bc9-7464-4c97-b5b5-3e8a2a801c55`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:26:24,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:26:24,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:26:24,111::task::974::TaskManager.Task::(_decref) Task=`58e48bc9-7464-4c97-b5b5-3e8a2a801c55`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:24,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:26:24,668::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:25,114::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:26:25,236::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:26:25,253::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00025337 s, 16.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:25,670::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:26:25,670::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:26:25,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:26,671::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:26:26,672::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:27,115::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:26:27,142::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:26:27,158::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000283356 s, 1.3 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:26:27,345::task::579::TaskManager.Task::(_updateState) Task=`697d6129-2681-49e2-a762-e8d4df0d2873`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:26:27,346::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:26:27,346::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:26:27,346::task::1168::TaskManager.Task::(prepare) Task=`697d6129-2681-49e2-a762-e8d4df0d2873`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:26:27,346::task::579::TaskManager.Task::(_updateState) Task=`697d6129-2681-49e2-a762-e8d4df0d2873`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:26:27,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:26:27,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:26:27,347::task::974::TaskManager.Task::(_decref) Task=`697d6129-2681-49e2-a762-e8d4df0d2873`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:26:27,359::task::579::TaskManager.Task::(_updateState) Task=`bb57fed6-4418-40d6-8186-44522d8da504`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:26:27,359::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:26:27,360::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:26:27,360::task::1168::TaskManager.Task::(prepare) Task=`bb57fed6-4418-40d6-8186-44522d8da504`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:26:27,360::task::579::TaskManager.Task::(_updateState) Task=`bb57fed6-4418-40d6-8186-44522d8da504`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:26:27,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:26:27,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:26:27,361::task::974::TaskManager.Task::(_decref) Task=`bb57fed6-4418-40d6-8186-44522d8da504`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:27,673::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:26:27,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:28,118::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:26:28,119::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:26:28,120::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:28,674::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:29,122::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:29,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:26:29,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:30,677::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:26:30,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:31,123::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:31,678::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:26:31,678::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:26:31,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:26:31,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286595::DEBUG::2014-01-16 16:26:32,175::task::579::TaskManager.Task::(_updateState) Task=`f59b676c-78c7-4f6a-ac60-ba01190fe3aa`::moving from state init -> state preparing >Thread-286595::INFO::2014-01-16 16:26:32,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286595::INFO::2014-01-16 16:26:32,176::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283356', 'lastCheck': '5.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025337', 'lastCheck': '6.9', 'valid': True}} >Thread-286595::DEBUG::2014-01-16 16:26:32,176::task::1168::TaskManager.Task::(prepare) Task=`f59b676c-78c7-4f6a-ac60-ba01190fe3aa`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283356', 'lastCheck': '5.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025337', 'lastCheck': '6.9', 'valid': True}} >Thread-286595::DEBUG::2014-01-16 16:26:32,176::task::579::TaskManager.Task::(_updateState) Task=`f59b676c-78c7-4f6a-ac60-ba01190fe3aa`::moving from state preparing -> state finished >Thread-286595::DEBUG::2014-01-16 16:26:32,176::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286595::DEBUG::2014-01-16 16:26:32,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286595::DEBUG::2014-01-16 16:26:32,176::task::974::TaskManager.Task::(_decref) Task=`f59b676c-78c7-4f6a-ac60-ba01190fe3aa`::ref 0 aborting False >Thread-251420::DEBUG::2014-01-16 16:26:32,400::task::579::TaskManager.Task::(_updateState) Task=`50499f3a-4817-45f1-8d6d-209f8e763691`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:26:32,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:26:32,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:26:32,400::task::1168::TaskManager.Task::(prepare) Task=`50499f3a-4817-45f1-8d6d-209f8e763691`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:26:32,400::task::579::TaskManager.Task::(_updateState) Task=`50499f3a-4817-45f1-8d6d-209f8e763691`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:26:32,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:26:32,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:26:32,401::task::974::TaskManager.Task::(_decref) Task=`50499f3a-4817-45f1-8d6d-209f8e763691`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:32,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:26:32,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:26:32,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:33,125::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:33,126::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:33,681::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:26:33,682::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:34,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:26:34,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:26:34,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:26:34,683::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:26:35,042::task::579::TaskManager.Task::(_updateState) Task=`b3b0ed83-40f0-4338-904f-e2d9581c11a7`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:26:35,042::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:26:35,043::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:26:35,043::task::1168::TaskManager.Task::(prepare) Task=`b3b0ed83-40f0-4338-904f-e2d9581c11a7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:26:35,043::task::579::TaskManager.Task::(_updateState) Task=`b3b0ed83-40f0-4338-904f-e2d9581c11a7`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:26:35,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:26:35,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:26:35,044::task::974::TaskManager.Task::(_decref) Task=`b3b0ed83-40f0-4338-904f-e2d9581c11a7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:35,127::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:26:35,258::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:26:35,274::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000322859 s, 12.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:35,685::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:26:35,780::task::579::TaskManager.Task::(_updateState) Task=`30c64b70-8db4-4631-86b4-517d57a80098`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:26:35,780::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:26:35,781::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:26:35,781::task::1168::TaskManager.Task::(prepare) Task=`30c64b70-8db4-4631-86b4-517d57a80098`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:26:35,781::task::579::TaskManager.Task::(_updateState) Task=`30c64b70-8db4-4631-86b4-517d57a80098`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:26:35,781::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:26:35,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:26:35,782::task::974::TaskManager.Task::(_decref) Task=`30c64b70-8db4-4631-86b4-517d57a80098`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:26:35,881::task::579::TaskManager.Task::(_updateState) Task=`a7c699e1-9615-4636-a0fc-a6d0d3c9464a`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:26:35,881::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:26:35,882::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:26:35,882::task::1168::TaskManager.Task::(prepare) Task=`a7c699e1-9615-4636-a0fc-a6d0d3c9464a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:26:35,882::task::579::TaskManager.Task::(_updateState) Task=`a7c699e1-9615-4636-a0fc-a6d0d3c9464a`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:26:35,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:26:35,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:26:35,882::task::974::TaskManager.Task::(_decref) Task=`a7c699e1-9615-4636-a0fc-a6d0d3c9464a`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:26:35,925::task::579::TaskManager.Task::(_updateState) Task=`ca3d0585-4961-4d88-9f6d-4103d72ce49a`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:26:35,925::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:26:35,925::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:26:35,926::task::1168::TaskManager.Task::(prepare) Task=`ca3d0585-4961-4d88-9f6d-4103d72ce49a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:26:35,926::task::579::TaskManager.Task::(_updateState) Task=`ca3d0585-4961-4d88-9f6d-4103d72ce49a`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:26:35,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:26:35,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:26:35,926::task::974::TaskManager.Task::(_decref) Task=`ca3d0585-4961-4d88-9f6d-4103d72ce49a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:36,685::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:26:36,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:26:36,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:26:36,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:36,687::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:26:36,687::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20952::DEBUG::2014-01-16 16:26:36,764::task::579::TaskManager.Task::(_updateState) Task=`0ef6d39c-cb74-4fc3-aa19-bb661a4f0c99`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:26:36,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:26:36,765::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:26:36,765::task::1168::TaskManager.Task::(prepare) Task=`0ef6d39c-cb74-4fc3-aa19-bb661a4f0c99`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:26:36,765::task::579::TaskManager.Task::(_updateState) Task=`0ef6d39c-cb74-4fc3-aa19-bb661a4f0c99`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:26:36,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:26:36,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:26:36,765::task::974::TaskManager.Task::(_decref) Task=`0ef6d39c-cb74-4fc3-aa19-bb661a4f0c99`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:26:37,063::task::579::TaskManager.Task::(_updateState) Task=`9e9418dd-b1f7-4264-a8fe-f64109940cad`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:26:37,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:26:37,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:26:37,064::task::1168::TaskManager.Task::(prepare) Task=`9e9418dd-b1f7-4264-a8fe-f64109940cad`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:26:37,064::task::579::TaskManager.Task::(_updateState) Task=`9e9418dd-b1f7-4264-a8fe-f64109940cad`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:26:37,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:26:37,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:26:37,064::task::974::TaskManager.Task::(_decref) Task=`9e9418dd-b1f7-4264-a8fe-f64109940cad`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:37,129::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:26:37,166::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:26:37,183::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273672 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:37,688::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:38,130::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:38,689::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:26:38,689::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:26:38,690::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:26:38,697::task::579::TaskManager.Task::(_updateState) Task=`65d957c2-84fa-4593-bca0-c779e2f3e8a1`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:26:38,697::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:26:38,698::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:26:38,698::task::1168::TaskManager.Task::(prepare) Task=`65d957c2-84fa-4593-bca0-c779e2f3e8a1`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:26:38,698::task::579::TaskManager.Task::(_updateState) Task=`65d957c2-84fa-4593-bca0-c779e2f3e8a1`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:26:38,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:26:38,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:26:38,698::task::974::TaskManager.Task::(_decref) Task=`65d957c2-84fa-4593-bca0-c779e2f3e8a1`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:26:38,699::task::579::TaskManager.Task::(_updateState) Task=`4bb309e4-f519-4d91-8aa9-3d9c275f510c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:26:38,699::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:26:38,699::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:26:38,699::task::1168::TaskManager.Task::(prepare) Task=`4bb309e4-f519-4d91-8aa9-3d9c275f510c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:26:38,699::task::579::TaskManager.Task::(_updateState) Task=`4bb309e4-f519-4d91-8aa9-3d9c275f510c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:26:38,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:26:38,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:26:38,700::task::974::TaskManager.Task::(_decref) Task=`4bb309e4-f519-4d91-8aa9-3d9c275f510c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:26:38,700::task::579::TaskManager.Task::(_updateState) Task=`652f79c5-b4aa-476a-8bb3-5f3a15d9b774`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:26:38,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:26:38,701::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:26:38,701::task::1168::TaskManager.Task::(prepare) Task=`652f79c5-b4aa-476a-8bb3-5f3a15d9b774`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:26:38,701::task::579::TaskManager.Task::(_updateState) Task=`652f79c5-b4aa-476a-8bb3-5f3a15d9b774`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:26:38,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:26:38,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:26:38,701::task::974::TaskManager.Task::(_decref) Task=`652f79c5-b4aa-476a-8bb3-5f3a15d9b774`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:39,132::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:39,691::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:26:39,691::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:26:39,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:40,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:26:40,693::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:26:40,693::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:26:40,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:41,133::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:41,694::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:42,695::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:26:42,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:43,135::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:43,137::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:26:43,137::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:26:43,138::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:43,697::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:44,698::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:26:44,758::task::579::TaskManager.Task::(_updateState) Task=`377aed7a-b536-4626-85bd-7c4ce0e14b6a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:26:44,758::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:26:44,758::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:26:44,759::task::1168::TaskManager.Task::(prepare) Task=`377aed7a-b536-4626-85bd-7c4ce0e14b6a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:26:44,759::task::579::TaskManager.Task::(_updateState) Task=`377aed7a-b536-4626-85bd-7c4ce0e14b6a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:26:44,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:26:44,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:26:44,759::task::974::TaskManager.Task::(_decref) Task=`377aed7a-b536-4626-85bd-7c4ce0e14b6a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:45,139::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:26:45,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:26:45,297::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000249573 s, 16.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:45,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:46,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:47,141::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:26:47,190::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:26:47,206::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291249 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:47,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286601::DEBUG::2014-01-16 16:26:48,008::task::579::TaskManager.Task::(_updateState) Task=`308c2734-6f08-4929-88b7-c21ce10ecbe0`::moving from state init -> state preparing >Thread-286601::INFO::2014-01-16 16:26:48,008::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286601::INFO::2014-01-16 16:26:48,008::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291249', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249573', 'lastCheck': '2.7', 'valid': True}} >Thread-286601::DEBUG::2014-01-16 16:26:48,009::task::1168::TaskManager.Task::(prepare) Task=`308c2734-6f08-4929-88b7-c21ce10ecbe0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291249', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249573', 'lastCheck': '2.7', 'valid': True}} >Thread-286601::DEBUG::2014-01-16 16:26:48,009::task::579::TaskManager.Task::(_updateState) Task=`308c2734-6f08-4929-88b7-c21ce10ecbe0`::moving from state preparing -> state finished >Thread-286601::DEBUG::2014-01-16 16:26:48,009::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286601::DEBUG::2014-01-16 16:26:48,009::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286601::DEBUG::2014-01-16 16:26:48,009::task::974::TaskManager.Task::(_decref) Task=`308c2734-6f08-4929-88b7-c21ce10ecbe0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:48,143::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:48,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:26:48,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:26:48,999::task::579::TaskManager.Task::(_updateState) Task=`d3b88721-d472-422d-9ba5-2c5054e353f2`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:26:48,999::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:26:49,000::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:26:49,000::task::1168::TaskManager.Task::(prepare) Task=`d3b88721-d472-422d-9ba5-2c5054e353f2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:26:49,000::task::579::TaskManager.Task::(_updateState) Task=`d3b88721-d472-422d-9ba5-2c5054e353f2`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:26:49,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:26:49,000::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:26:49,000::task::974::TaskManager.Task::(_decref) Task=`d3b88721-d472-422d-9ba5-2c5054e353f2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:26:49,144::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:49,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:50,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:51,146::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:51,707::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:52,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:53,148::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:26:53,149::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:53,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:26:53,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:26:53,709::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:26:54,710::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:26:54,711::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:55,150::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:26:55,302::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:26:55,319::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000206202 s, 19.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:55,712::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:26:55,712::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:26:55,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:26:55,815::task::579::TaskManager.Task::(_updateState) Task=`d62438a8-c714-42a2-906d-6e9a65ba1917`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:26:55,815::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:26:55,816::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:26:55,816::task::1168::TaskManager.Task::(prepare) Task=`d62438a8-c714-42a2-906d-6e9a65ba1917`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:26:55,816::task::579::TaskManager.Task::(_updateState) Task=`d62438a8-c714-42a2-906d-6e9a65ba1917`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:26:55,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:26:55,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:26:55,817::task::974::TaskManager.Task::(_decref) Task=`d62438a8-c714-42a2-906d-6e9a65ba1917`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:26:55,817::task::579::TaskManager.Task::(_updateState) Task=`fde66aeb-6128-4cac-9721-c7e7d6037b90`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:26:55,817::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:26:55,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:26:55,818::task::1168::TaskManager.Task::(prepare) Task=`fde66aeb-6128-4cac-9721-c7e7d6037b90`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:26:55,818::task::579::TaskManager.Task::(_updateState) Task=`fde66aeb-6128-4cac-9721-c7e7d6037b90`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:26:55,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:26:55,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:26:55,818::task::974::TaskManager.Task::(_decref) Task=`fde66aeb-6128-4cac-9721-c7e7d6037b90`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:26:55,819::task::579::TaskManager.Task::(_updateState) Task=`e5820ba0-5457-40d6-94a6-9a3ed174e060`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:26:55,819::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:26:55,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:26:55,819::task::1168::TaskManager.Task::(prepare) Task=`e5820ba0-5457-40d6-94a6-9a3ed174e060`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:26:55,819::task::579::TaskManager.Task::(_updateState) Task=`e5820ba0-5457-40d6-94a6-9a3ed174e060`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:26:55,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:26:55,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:26:55,820::task::974::TaskManager.Task::(_decref) Task=`e5820ba0-5457-40d6-94a6-9a3ed174e060`::ref 0 aborting False >Thread-84941::DEBUG::2014-01-16 16:26:55,826::task::579::TaskManager.Task::(_updateState) Task=`f72917c4-99ee-432e-a2e9-3798f4992532`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:26:55,826::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:26:55,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:26:55,827::task::1168::TaskManager.Task::(prepare) Task=`f72917c4-99ee-432e-a2e9-3798f4992532`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:26:55,827::task::579::TaskManager.Task::(_updateState) Task=`f72917c4-99ee-432e-a2e9-3798f4992532`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:26:55,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:26:55,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:26:55,827::task::974::TaskManager.Task::(_decref) Task=`f72917c4-99ee-432e-a2e9-3798f4992532`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:26:56,713::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:26:56,714::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:57,152::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:26:57,214::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:26:57,231::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000333081 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:26:57,715::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:26:57,716::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:58,154::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:26:58,155::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:26:58,156::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:58,717::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:26:59,157::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:26:59,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:26:59,718::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:27:00,414::task::579::TaskManager.Task::(_updateState) Task=`86b604b0-b388-4afd-86f8-fd69e07aa10b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:27:00,414::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:27:00,415::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:27:00,415::task::1168::TaskManager.Task::(prepare) Task=`86b604b0-b388-4afd-86f8-fd69e07aa10b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:27:00,415::task::579::TaskManager.Task::(_updateState) Task=`86b604b0-b388-4afd-86f8-fd69e07aa10b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:27:00,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:27:00,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:27:00,415::task::974::TaskManager.Task::(_decref) Task=`86b604b0-b388-4afd-86f8-fd69e07aa10b`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:27:00,416::task::579::TaskManager.Task::(_updateState) Task=`0e7785c4-4425-4ae8-a0e5-91c90cc78839`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:27:00,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:27:00,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:27:00,416::task::1168::TaskManager.Task::(prepare) Task=`0e7785c4-4425-4ae8-a0e5-91c90cc78839`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:27:00,416::task::579::TaskManager.Task::(_updateState) Task=`0e7785c4-4425-4ae8-a0e5-91c90cc78839`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:27:00,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:27:00,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:27:00,417::task::974::TaskManager.Task::(_decref) Task=`0e7785c4-4425-4ae8-a0e5-91c90cc78839`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:00,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:27:00,720::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:01,159::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:01,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:27:01,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:27:01,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:27:01,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:02,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:27:02,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:27:02,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:27:02,979::task::579::TaskManager.Task::(_updateState) Task=`156a2dc0-f22a-4743-812e-b6677393d435`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:27:02,979::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:27:02,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:27:02,979::task::1168::TaskManager.Task::(prepare) Task=`156a2dc0-f22a-4743-812e-b6677393d435`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:27:02,980::task::579::TaskManager.Task::(_updateState) Task=`156a2dc0-f22a-4743-812e-b6677393d435`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:27:02,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:27:02,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:27:02,980::task::974::TaskManager.Task::(_decref) Task=`156a2dc0-f22a-4743-812e-b6677393d435`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:27:03,160::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:03,161::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:03,724::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:27:03,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286607::DEBUG::2014-01-16 16:27:03,836::task::579::TaskManager.Task::(_updateState) Task=`4d49b3c4-643f-4205-9a58-d799bb9e091a`::moving from state init -> state preparing >Thread-286607::INFO::2014-01-16 16:27:03,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286607::INFO::2014-01-16 16:27:03,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333081', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000206202', 'lastCheck': '8.5', 'valid': True}} >Thread-286607::DEBUG::2014-01-16 16:27:03,837::task::1168::TaskManager.Task::(prepare) Task=`4d49b3c4-643f-4205-9a58-d799bb9e091a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333081', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000206202', 'lastCheck': '8.5', 'valid': True}} >Thread-286607::DEBUG::2014-01-16 16:27:03,837::task::579::TaskManager.Task::(_updateState) Task=`4d49b3c4-643f-4205-9a58-d799bb9e091a`::moving from state preparing -> state finished >Thread-286607::DEBUG::2014-01-16 16:27:03,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286607::DEBUG::2014-01-16 16:27:03,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286607::DEBUG::2014-01-16 16:27:03,838::task::974::TaskManager.Task::(_decref) Task=`4d49b3c4-643f-4205-9a58-d799bb9e091a`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:27:04,555::task::579::TaskManager.Task::(_updateState) Task=`cd69122d-cbd5-47a9-a683-17de5d291fe6`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:27:04,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:27:04,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:27:04,555::task::1168::TaskManager.Task::(prepare) Task=`cd69122d-cbd5-47a9-a683-17de5d291fe6`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:27:04,555::task::579::TaskManager.Task::(_updateState) Task=`cd69122d-cbd5-47a9-a683-17de5d291fe6`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:27:04,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:27:04,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:27:04,556::task::974::TaskManager.Task::(_decref) Task=`cd69122d-cbd5-47a9-a683-17de5d291fe6`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:27:04,557::task::579::TaskManager.Task::(_updateState) Task=`3fe8adb6-2791-4e94-9e9e-8bde9d1aef47`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:27:04,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:27:04,558::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:27:04,558::task::1168::TaskManager.Task::(prepare) Task=`3fe8adb6-2791-4e94-9e9e-8bde9d1aef47`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:27:04,558::task::579::TaskManager.Task::(_updateState) Task=`3fe8adb6-2791-4e94-9e9e-8bde9d1aef47`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:27:04,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:27:04,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:27:04,558::task::974::TaskManager.Task::(_decref) Task=`3fe8adb6-2791-4e94-9e9e-8bde9d1aef47`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:04,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:27:04,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:27:04,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:27:04,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:05,162::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:27:05,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:27:05,340::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00025383 s, 16.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:05,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:27:05,839::task::579::TaskManager.Task::(_updateState) Task=`792c8196-c6f4-4096-a4d3-01f2a4092eba`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:27:05,839::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:27:05,839::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:27:05,840::task::1168::TaskManager.Task::(prepare) Task=`792c8196-c6f4-4096-a4d3-01f2a4092eba`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:27:05,840::task::579::TaskManager.Task::(_updateState) Task=`792c8196-c6f4-4096-a4d3-01f2a4092eba`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:27:05,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:27:05,840::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:27:05,840::task::974::TaskManager.Task::(_decref) Task=`792c8196-c6f4-4096-a4d3-01f2a4092eba`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:27:05,841::task::579::TaskManager.Task::(_updateState) Task=`a779cbb4-cb7d-4232-8ad8-6d2c0d3ec2e9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:27:05,841::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:27:05,841::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:27:05,841::task::1168::TaskManager.Task::(prepare) Task=`a779cbb4-cb7d-4232-8ad8-6d2c0d3ec2e9`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:27:05,841::task::579::TaskManager.Task::(_updateState) Task=`a779cbb4-cb7d-4232-8ad8-6d2c0d3ec2e9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:27:05,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:27:05,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:27:05,842::task::974::TaskManager.Task::(_decref) Task=`a779cbb4-cb7d-4232-8ad8-6d2c0d3ec2e9`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:27:06,581::task::579::TaskManager.Task::(_updateState) Task=`fbf50a15-1e98-4af6-9070-7aab624e8871`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:27:06,582::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:27:06,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:27:06,582::task::1168::TaskManager.Task::(prepare) Task=`fbf50a15-1e98-4af6-9070-7aab624e8871`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:27:06,582::task::579::TaskManager.Task::(_updateState) Task=`fbf50a15-1e98-4af6-9070-7aab624e8871`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:27:06,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:27:06,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:27:06,583::task::974::TaskManager.Task::(_decref) Task=`fbf50a15-1e98-4af6-9070-7aab624e8871`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:27:06,583::task::579::TaskManager.Task::(_updateState) Task=`352ece7e-a459-42be-94b9-bf717cc46510`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:27:06,583::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:27:06,583::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:27:06,584::task::1168::TaskManager.Task::(prepare) Task=`352ece7e-a459-42be-94b9-bf717cc46510`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:27:06,584::task::579::TaskManager.Task::(_updateState) Task=`352ece7e-a459-42be-94b9-bf717cc46510`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:27:06,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:27:06,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:27:06,584::task::974::TaskManager.Task::(_decref) Task=`352ece7e-a459-42be-94b9-bf717cc46510`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:06,727::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:27:06,727::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:27:06,727::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:27:06,727::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:06,728::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:27:06,728::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:27:07,164::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:27:07,192::task::579::TaskManager.Task::(_updateState) Task=`edd8834d-8256-40ca-9380-98ecc0a6f8c0`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:27:07,192::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:27:07,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:27:07,192::task::1168::TaskManager.Task::(prepare) Task=`edd8834d-8256-40ca-9380-98ecc0a6f8c0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:27:07,192::task::579::TaskManager.Task::(_updateState) Task=`edd8834d-8256-40ca-9380-98ecc0a6f8c0`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:27:07,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:27:07,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:27:07,193::task::974::TaskManager.Task::(_decref) Task=`edd8834d-8256-40ca-9380-98ecc0a6f8c0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:27:07,240::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:27:07,256::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000313007 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:27:07,260::task::579::TaskManager.Task::(_updateState) Task=`9acf1b45-41cb-4783-a328-d250e9859a05`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:27:07,262::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:27:07,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:27:07,264::task::1168::TaskManager.Task::(prepare) Task=`9acf1b45-41cb-4783-a328-d250e9859a05`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:27:07,264::task::579::TaskManager.Task::(_updateState) Task=`9acf1b45-41cb-4783-a328-d250e9859a05`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:27:07,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:27:07,264::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:27:07,264::task::974::TaskManager.Task::(_decref) Task=`9acf1b45-41cb-4783-a328-d250e9859a05`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:07,729::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:08,166::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:27:08,390::task::579::TaskManager.Task::(_updateState) Task=`59950526-5e2a-46e8-9525-c6da89e82c97`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:27:08,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:27:08,390::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:27:08,390::task::1168::TaskManager.Task::(prepare) Task=`59950526-5e2a-46e8-9525-c6da89e82c97`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:27:08,391::task::579::TaskManager.Task::(_updateState) Task=`59950526-5e2a-46e8-9525-c6da89e82c97`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:27:08,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:27:08,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:27:08,391::task::974::TaskManager.Task::(_decref) Task=`59950526-5e2a-46e8-9525-c6da89e82c97`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:08,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:27:08,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:27:08,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:09,169::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:27:09,448::task::579::TaskManager.Task::(_updateState) Task=`cebac862-798f-431c-be58-a1076968fce6`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:27:09,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:27:09,449::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:27:09,449::task::1168::TaskManager.Task::(prepare) Task=`cebac862-798f-431c-be58-a1076968fce6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:27:09,449::task::579::TaskManager.Task::(_updateState) Task=`cebac862-798f-431c-be58-a1076968fce6`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:27:09,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:27:09,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:27:09,450::task::974::TaskManager.Task::(_decref) Task=`cebac862-798f-431c-be58-a1076968fce6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:09,732::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:27:09,733::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:27:09,733::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:10,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:27:10,735::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:27:10,735::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:27:10,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:11,170::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:11,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:27:12,492::task::579::TaskManager.Task::(_updateState) Task=`84055534-160b-4422-a122-7ff5c615c9f8`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:27:12,493::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:27:12,493::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:27:12,493::task::1168::TaskManager.Task::(prepare) Task=`84055534-160b-4422-a122-7ff5c615c9f8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:27:12,494::task::579::TaskManager.Task::(_updateState) Task=`84055534-160b-4422-a122-7ff5c615c9f8`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:27:12,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:27:12,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:27:12,494::task::974::TaskManager.Task::(_decref) Task=`84055534-160b-4422-a122-7ff5c615c9f8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:12,738::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:27:12,738::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:13,172::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:13,173::task::579::TaskManager.Task::(_updateState) Task=`bbeebba4-ff52-420e-9bd2-f13da76b0c7c`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:27:13,173::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:27:13,173::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:27:13,173::task::1168::TaskManager.Task::(prepare) Task=`bbeebba4-ff52-420e-9bd2-f13da76b0c7c`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:27:13,173::task::579::TaskManager.Task::(_updateState) Task=`bbeebba4-ff52-420e-9bd2-f13da76b0c7c`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:27:13,174::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:27:13,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:27:13,174::task::974::TaskManager.Task::(_decref) Task=`bbeebba4-ff52-420e-9bd2-f13da76b0c7c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:27:13,176::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:27:13,176::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:27:13,178::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:13,181::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:13,182::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:13,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:14,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:15,184::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:27:15,346::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:27:15,362::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000270449 s, 15.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:15,741::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:27:15,802::task::579::TaskManager.Task::(_updateState) Task=`1f9df009-2e51-40a3-bf33-5e58581aaf3f`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:27:15,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:27:15,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:27:15,804::task::1168::TaskManager.Task::(prepare) Task=`1f9df009-2e51-40a3-bf33-5e58581aaf3f`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:27:15,804::task::579::TaskManager.Task::(_updateState) Task=`1f9df009-2e51-40a3-bf33-5e58581aaf3f`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:27:15,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:27:15,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:27:15,805::task::974::TaskManager.Task::(_decref) Task=`1f9df009-2e51-40a3-bf33-5e58581aaf3f`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:27:15,877::task::579::TaskManager.Task::(_updateState) Task=`9ecc80c7-fef5-4c70-ba82-f615cc9f7638`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:27:15,877::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:27:15,877::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:27:15,877::task::1168::TaskManager.Task::(prepare) Task=`9ecc80c7-fef5-4c70-ba82-f615cc9f7638`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:27:15,878::task::579::TaskManager.Task::(_updateState) Task=`9ecc80c7-fef5-4c70-ba82-f615cc9f7638`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:27:15,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:27:15,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:27:15,878::task::974::TaskManager.Task::(_decref) Task=`9ecc80c7-fef5-4c70-ba82-f615cc9f7638`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:16,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:17,185::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:27:17,268::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:27:17,284::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000334657 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:17,743::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:18,187::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:18,744::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:27:18,744::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:19,189::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:19,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286613::DEBUG::2014-01-16 16:27:19,838::task::579::TaskManager.Task::(_updateState) Task=`8fe51449-17f3-4c12-97d7-30e52820529d`::moving from state init -> state preparing >Thread-286613::INFO::2014-01-16 16:27:19,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286613::INFO::2014-01-16 16:27:19,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334657', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270449', 'lastCheck': '4.5', 'valid': True}} >Thread-286613::DEBUG::2014-01-16 16:27:19,838::task::1168::TaskManager.Task::(prepare) Task=`8fe51449-17f3-4c12-97d7-30e52820529d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334657', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270449', 'lastCheck': '4.5', 'valid': True}} >Thread-286613::DEBUG::2014-01-16 16:27:19,839::task::579::TaskManager.Task::(_updateState) Task=`8fe51449-17f3-4c12-97d7-30e52820529d`::moving from state preparing -> state finished >Thread-286613::DEBUG::2014-01-16 16:27:19,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286613::DEBUG::2014-01-16 16:27:19,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286613::DEBUG::2014-01-16 16:27:19,839::task::974::TaskManager.Task::(_decref) Task=`8fe51449-17f3-4c12-97d7-30e52820529d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:20,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:21,190::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:27:21,265::task::579::TaskManager.Task::(_updateState) Task=`da39b36f-9648-4e44-83a7-aadeef873f0b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:27:21,265::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:27:21,265::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:27:21,266::task::1168::TaskManager.Task::(prepare) Task=`da39b36f-9648-4e44-83a7-aadeef873f0b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:27:21,266::task::579::TaskManager.Task::(_updateState) Task=`da39b36f-9648-4e44-83a7-aadeef873f0b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:27:21,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:27:21,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:27:21,266::task::974::TaskManager.Task::(_decref) Task=`da39b36f-9648-4e44-83a7-aadeef873f0b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:27:21,266::task::579::TaskManager.Task::(_updateState) Task=`9b33383e-1a8e-4553-b861-f9d9ef16902a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:27:21,266::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:27:21,267::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:27:21,267::task::1168::TaskManager.Task::(prepare) Task=`9b33383e-1a8e-4553-b861-f9d9ef16902a`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:27:21,267::task::579::TaskManager.Task::(_updateState) Task=`9b33383e-1a8e-4553-b861-f9d9ef16902a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:27:21,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:27:21,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:27:21,267::task::974::TaskManager.Task::(_decref) Task=`9b33383e-1a8e-4553-b861-f9d9ef16902a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:21,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:22,748::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:23,191::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:23,192::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:23,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:27:23,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:27:23,750::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:27:24,031::task::579::TaskManager.Task::(_updateState) Task=`e9cd5e32-54fc-4ef8-aea7-0059d5a52366`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:27:24,032::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:27:24,032::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:27:24,032::task::1168::TaskManager.Task::(prepare) Task=`e9cd5e32-54fc-4ef8-aea7-0059d5a52366`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:27:24,033::task::579::TaskManager.Task::(_updateState) Task=`e9cd5e32-54fc-4ef8-aea7-0059d5a52366`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:27:24,033::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:27:24,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:27:24,033::task::974::TaskManager.Task::(_decref) Task=`e9cd5e32-54fc-4ef8-aea7-0059d5a52366`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:27:24,176::task::579::TaskManager.Task::(_updateState) Task=`d2bdc5b2-97ea-4a62-9c1f-a03a6061cc64`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:27:24,176::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:27:24,177::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:27:24,177::task::1168::TaskManager.Task::(prepare) Task=`d2bdc5b2-97ea-4a62-9c1f-a03a6061cc64`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:27:24,177::task::579::TaskManager.Task::(_updateState) Task=`d2bdc5b2-97ea-4a62-9c1f-a03a6061cc64`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:27:24,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:27:24,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:27:24,177::task::974::TaskManager.Task::(_decref) Task=`d2bdc5b2-97ea-4a62-9c1f-a03a6061cc64`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:24,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:27:24,751::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:25,194::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:27:25,367::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:27:25,385::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000255644 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:25,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:27:25,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:27:25,753::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:26,754::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:27:26,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:27,195::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:27:27,293::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:27:27,309::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026607 s, 1.4 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:27:27,529::task::579::TaskManager.Task::(_updateState) Task=`08fe6c99-7c22-499c-b94e-42577d610889`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:27:27,529::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:27:27,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:27:27,530::task::1168::TaskManager.Task::(prepare) Task=`08fe6c99-7c22-499c-b94e-42577d610889`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:27:27,530::task::579::TaskManager.Task::(_updateState) Task=`08fe6c99-7c22-499c-b94e-42577d610889`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:27:27,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:27:27,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:27:27,530::task::974::TaskManager.Task::(_decref) Task=`08fe6c99-7c22-499c-b94e-42577d610889`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:27:27,554::task::579::TaskManager.Task::(_updateState) Task=`6ee4f424-0a76-4b6d-8e0c-337a4b75fed8`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:27:27,554::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:27:27,554::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:27:27,554::task::1168::TaskManager.Task::(prepare) Task=`6ee4f424-0a76-4b6d-8e0c-337a4b75fed8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:27:27,554::task::579::TaskManager.Task::(_updateState) Task=`6ee4f424-0a76-4b6d-8e0c-337a4b75fed8`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:27:27,555::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:27:27,555::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:27:27,555::task::974::TaskManager.Task::(_decref) Task=`6ee4f424-0a76-4b6d-8e0c-337a4b75fed8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:27,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:27:27,755::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:28,197::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:27:28,198::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:27:28,199::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:28,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:29,200::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:29,758::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:27:29,758::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:30,759::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:27:30,760::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:31,201::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:31,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:27:31,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:27:31,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:27:31,762::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:27:32,576::task::579::TaskManager.Task::(_updateState) Task=`99952281-9a3a-455e-9844-331694eb8f8c`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:27:32,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:27:32,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:27:32,577::task::1168::TaskManager.Task::(prepare) Task=`99952281-9a3a-455e-9844-331694eb8f8c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:27:32,577::task::579::TaskManager.Task::(_updateState) Task=`99952281-9a3a-455e-9844-331694eb8f8c`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:27:32,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:27:32,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:27:32,578::task::974::TaskManager.Task::(_decref) Task=`99952281-9a3a-455e-9844-331694eb8f8c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:32,763::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:27:32,763::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:27:32,763::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:33,202::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:33,204::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:33,765::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:27:33,765::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:34,766::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:27:34,767::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:27:34,767::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:27:34,767::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:27:35,203::task::579::TaskManager.Task::(_updateState) Task=`a0112906-e922-4b8f-b2b3-ca2e8906fa8f`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:27:35,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:27:35,204::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:27:35,204::task::1168::TaskManager.Task::(prepare) Task=`a0112906-e922-4b8f-b2b3-ca2e8906fa8f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:27:35,205::task::579::TaskManager.Task::(_updateState) Task=`a0112906-e922-4b8f-b2b3-ca2e8906fa8f`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:27:35,205::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:27:35,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:27:35,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:27:35,205::task::974::TaskManager.Task::(_decref) Task=`a0112906-e922-4b8f-b2b3-ca2e8906fa8f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:27:35,391::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:27:35,408::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000290913 s, 14.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:35,768::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286619::DEBUG::2014-01-16 16:27:35,843::task::579::TaskManager.Task::(_updateState) Task=`5684b75b-64bc-47ae-ac34-2829307b3281`::moving from state init -> state preparing >Thread-286619::INFO::2014-01-16 16:27:35,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286619::INFO::2014-01-16 16:27:35,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026607', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290913', 'lastCheck': '0.4', 'valid': True}} >Thread-286619::DEBUG::2014-01-16 16:27:35,844::task::1168::TaskManager.Task::(prepare) Task=`5684b75b-64bc-47ae-ac34-2829307b3281`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026607', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290913', 'lastCheck': '0.4', 'valid': True}} >Thread-286619::DEBUG::2014-01-16 16:27:35,844::task::579::TaskManager.Task::(_updateState) Task=`5684b75b-64bc-47ae-ac34-2829307b3281`::moving from state preparing -> state finished >Thread-286619::DEBUG::2014-01-16 16:27:35,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286619::DEBUG::2014-01-16 16:27:35,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286619::DEBUG::2014-01-16 16:27:35,845::task::974::TaskManager.Task::(_decref) Task=`5684b75b-64bc-47ae-ac34-2829307b3281`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:27:35,960::task::579::TaskManager.Task::(_updateState) Task=`9845993e-5d0b-4116-adc7-2564d21bbb98`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:27:35,961::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:27:35,962::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:27:35,962::task::1168::TaskManager.Task::(prepare) Task=`9845993e-5d0b-4116-adc7-2564d21bbb98`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:27:35,963::task::579::TaskManager.Task::(_updateState) Task=`9845993e-5d0b-4116-adc7-2564d21bbb98`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:27:35,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:27:35,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:27:35,964::task::974::TaskManager.Task::(_decref) Task=`9845993e-5d0b-4116-adc7-2564d21bbb98`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:27:36,038::task::579::TaskManager.Task::(_updateState) Task=`3834738d-3cd9-4e79-92d4-9c1ea208d451`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:27:36,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:27:36,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:27:36,038::task::1168::TaskManager.Task::(prepare) Task=`3834738d-3cd9-4e79-92d4-9c1ea208d451`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:27:36,038::task::579::TaskManager.Task::(_updateState) Task=`3834738d-3cd9-4e79-92d4-9c1ea208d451`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:27:36,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:27:36,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:27:36,039::task::974::TaskManager.Task::(_decref) Task=`3834738d-3cd9-4e79-92d4-9c1ea208d451`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:27:36,090::task::579::TaskManager.Task::(_updateState) Task=`a13e2273-a2ae-4ace-908d-235f059d5dbe`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:27:36,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:27:36,090::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:27:36,091::task::1168::TaskManager.Task::(prepare) Task=`a13e2273-a2ae-4ace-908d-235f059d5dbe`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:27:36,091::task::579::TaskManager.Task::(_updateState) Task=`a13e2273-a2ae-4ace-908d-235f059d5dbe`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:27:36,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:27:36,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:27:36,092::task::974::TaskManager.Task::(_decref) Task=`a13e2273-a2ae-4ace-908d-235f059d5dbe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:36,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:27:36,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:27:36,770::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:27:36,770::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:36,770::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:27:36,770::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20952::DEBUG::2014-01-16 16:27:36,924::task::579::TaskManager.Task::(_updateState) Task=`ccb60755-cf33-4949-b8ef-7aec7872c5da`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:27:36,925::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:27:36,925::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:27:36,925::task::1168::TaskManager.Task::(prepare) Task=`ccb60755-cf33-4949-b8ef-7aec7872c5da`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:27:36,925::task::579::TaskManager.Task::(_updateState) Task=`ccb60755-cf33-4949-b8ef-7aec7872c5da`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:27:36,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:27:36,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:27:36,926::task::974::TaskManager.Task::(_decref) Task=`ccb60755-cf33-4949-b8ef-7aec7872c5da`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:27:37,206::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:27:37,229::task::579::TaskManager.Task::(_updateState) Task=`f0933044-7e2f-4831-9d36-455457ae6355`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:27:37,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:27:37,229::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:27:37,230::task::1168::TaskManager.Task::(prepare) Task=`f0933044-7e2f-4831-9d36-455457ae6355`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:27:37,230::task::579::TaskManager.Task::(_updateState) Task=`f0933044-7e2f-4831-9d36-455457ae6355`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:27:37,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:27:37,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:27:37,230::task::974::TaskManager.Task::(_decref) Task=`f0933044-7e2f-4831-9d36-455457ae6355`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:27:37,317::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:27:37,336::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000252751 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:37,772::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:38,207::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:38,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:27:38,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:27:38,773::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:27:38,974::task::579::TaskManager.Task::(_updateState) Task=`d94250f6-c5aa-4f49-b286-51edfc3fad35`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:27:38,975::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:27:38,975::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:27:38,975::task::1168::TaskManager.Task::(prepare) Task=`d94250f6-c5aa-4f49-b286-51edfc3fad35`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:27:38,976::task::579::TaskManager.Task::(_updateState) Task=`d94250f6-c5aa-4f49-b286-51edfc3fad35`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:27:38,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:27:38,976::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:27:38,976::task::974::TaskManager.Task::(_decref) Task=`d94250f6-c5aa-4f49-b286-51edfc3fad35`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:27:38,976::task::579::TaskManager.Task::(_updateState) Task=`15644c22-0c46-421a-8e5b-9229ca40b27c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:27:38,977::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:27:38,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:27:38,977::task::1168::TaskManager.Task::(prepare) Task=`15644c22-0c46-421a-8e5b-9229ca40b27c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:27:38,977::task::579::TaskManager.Task::(_updateState) Task=`15644c22-0c46-421a-8e5b-9229ca40b27c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:27:38,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:27:38,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:27:38,978::task::974::TaskManager.Task::(_decref) Task=`15644c22-0c46-421a-8e5b-9229ca40b27c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:27:38,978::task::579::TaskManager.Task::(_updateState) Task=`87051b92-3cd3-4e2b-bf29-ddec6f72cf2c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:27:38,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:27:38,978::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:27:38,978::task::1168::TaskManager.Task::(prepare) Task=`87051b92-3cd3-4e2b-bf29-ddec6f72cf2c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:27:38,979::task::579::TaskManager.Task::(_updateState) Task=`87051b92-3cd3-4e2b-bf29-ddec6f72cf2c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:27:38,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:27:38,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:27:38,979::task::974::TaskManager.Task::(_decref) Task=`87051b92-3cd3-4e2b-bf29-ddec6f72cf2c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:27:39,209::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:39,774::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:27:39,774::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:27:39,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:40,776::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:27:40,776::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:27:40,776::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:27:40,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:41,210::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:41,778::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:42,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:27:42,779::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:43,211::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:43,213::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:27:43,213::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:27:43,215::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:43,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:44,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:27:44,932::task::579::TaskManager.Task::(_updateState) Task=`e71cf33d-a8c2-46d3-8731-dce20baa81e8`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:27:44,932::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:27:44,932::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:27:44,933::task::1168::TaskManager.Task::(prepare) Task=`e71cf33d-a8c2-46d3-8731-dce20baa81e8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:27:44,933::task::579::TaskManager.Task::(_updateState) Task=`e71cf33d-a8c2-46d3-8731-dce20baa81e8`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:27:44,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:27:44,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:27:44,933::task::974::TaskManager.Task::(_decref) Task=`e71cf33d-a8c2-46d3-8731-dce20baa81e8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:27:45,216::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:27:45,413::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:27:45,429::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000231054 s, 17.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:45,783::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:46,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:47,217::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:27:47,343::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:27:47,359::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000248841 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:47,785::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:48,219::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:48,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:27:48,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:27:49,178::task::579::TaskManager.Task::(_updateState) Task=`b0e6eecd-3adc-4652-8767-a40c38589710`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:27:49,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:27:49,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:27:49,179::task::1168::TaskManager.Task::(prepare) Task=`b0e6eecd-3adc-4652-8767-a40c38589710`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:27:49,179::task::579::TaskManager.Task::(_updateState) Task=`b0e6eecd-3adc-4652-8767-a40c38589710`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:27:49,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:27:49,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:27:49,179::task::974::TaskManager.Task::(_decref) Task=`b0e6eecd-3adc-4652-8767-a40c38589710`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:27:49,220::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:49,788::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:50,789::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:51,221::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:51,790::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286625::DEBUG::2014-01-16 16:27:51,909::task::579::TaskManager.Task::(_updateState) Task=`446f871c-0b61-4810-8946-71ebb4762d3d`::moving from state init -> state preparing >Thread-286625::INFO::2014-01-16 16:27:51,909::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286625::INFO::2014-01-16 16:27:51,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000248841', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231054', 'lastCheck': '6.5', 'valid': True}} >Thread-286625::DEBUG::2014-01-16 16:27:51,910::task::1168::TaskManager.Task::(prepare) Task=`446f871c-0b61-4810-8946-71ebb4762d3d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000248841', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231054', 'lastCheck': '6.5', 'valid': True}} >Thread-286625::DEBUG::2014-01-16 16:27:51,910::task::579::TaskManager.Task::(_updateState) Task=`446f871c-0b61-4810-8946-71ebb4762d3d`::moving from state preparing -> state finished >Thread-286625::DEBUG::2014-01-16 16:27:51,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286625::DEBUG::2014-01-16 16:27:51,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286625::DEBUG::2014-01-16 16:27:51,910::task::974::TaskManager.Task::(_decref) Task=`446f871c-0b61-4810-8946-71ebb4762d3d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:52,792::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:53,222::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:27:53,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:53,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:27:53,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:27:53,793::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:27:54,795::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:27:54,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:55,225::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:27:55,436::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:27:55,453::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267427 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:55,795::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:27:55,796::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:27:55,796::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:27:56,024::task::579::TaskManager.Task::(_updateState) Task=`141dbfd8-be88-4af4-9de7-9e7877d5b02e`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:27:56,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:27:56,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:27:56,025::task::1168::TaskManager.Task::(prepare) Task=`141dbfd8-be88-4af4-9de7-9e7877d5b02e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:27:56,025::task::579::TaskManager.Task::(_updateState) Task=`141dbfd8-be88-4af4-9de7-9e7877d5b02e`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:27:56,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:27:56,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:27:56,025::task::974::TaskManager.Task::(_decref) Task=`141dbfd8-be88-4af4-9de7-9e7877d5b02e`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:27:56,400::task::579::TaskManager.Task::(_updateState) Task=`6eb28d6e-7ea4-4858-aff0-33be75bd0218`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:27:56,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:27:56,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:27:56,400::task::1168::TaskManager.Task::(prepare) Task=`6eb28d6e-7ea4-4858-aff0-33be75bd0218`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:27:56,401::task::579::TaskManager.Task::(_updateState) Task=`6eb28d6e-7ea4-4858-aff0-33be75bd0218`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:27:56,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:27:56,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:27:56,401::task::974::TaskManager.Task::(_decref) Task=`6eb28d6e-7ea4-4858-aff0-33be75bd0218`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:27:56,401::task::579::TaskManager.Task::(_updateState) Task=`b4e0b9fa-c12a-487c-a2a0-ced05b2de5c6`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:27:56,402::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:27:56,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:27:56,402::task::1168::TaskManager.Task::(prepare) Task=`b4e0b9fa-c12a-487c-a2a0-ced05b2de5c6`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:27:56,402::task::579::TaskManager.Task::(_updateState) Task=`b4e0b9fa-c12a-487c-a2a0-ced05b2de5c6`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:27:56,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:27:56,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:27:56,403::task::974::TaskManager.Task::(_decref) Task=`b4e0b9fa-c12a-487c-a2a0-ced05b2de5c6`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:27:56,403::task::579::TaskManager.Task::(_updateState) Task=`fcc7f74d-0f9c-4897-9c69-01d8a64e53fd`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:27:56,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:27:56,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:27:56,404::task::1168::TaskManager.Task::(prepare) Task=`fcc7f74d-0f9c-4897-9c69-01d8a64e53fd`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:27:56,404::task::579::TaskManager.Task::(_updateState) Task=`fcc7f74d-0f9c-4897-9c69-01d8a64e53fd`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:27:56,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:27:56,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:27:56,405::task::974::TaskManager.Task::(_decref) Task=`fcc7f74d-0f9c-4897-9c69-01d8a64e53fd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:27:56,797::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:27:56,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:57,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:27:57,367::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:27:57,384::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000280018 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:27:57,799::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:27:57,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:58,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:27:58,229::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:27:58,230::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:58,801::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:27:59,231::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:27:59,802::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:27:59,802::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:28:00,651::task::579::TaskManager.Task::(_updateState) Task=`f1f01e23-764c-4d17-a56e-a77981444f9c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:28:00,652::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:28:00,652::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:28:00,652::task::1168::TaskManager.Task::(prepare) Task=`f1f01e23-764c-4d17-a56e-a77981444f9c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:28:00,652::task::579::TaskManager.Task::(_updateState) Task=`f1f01e23-764c-4d17-a56e-a77981444f9c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:28:00,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:28:00,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:28:00,653::task::974::TaskManager.Task::(_decref) Task=`f1f01e23-764c-4d17-a56e-a77981444f9c`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:28:00,653::task::579::TaskManager.Task::(_updateState) Task=`f2295973-74d0-4df7-9f8d-97614c137834`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:28:00,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:28:00,654::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:28:00,654::task::1168::TaskManager.Task::(prepare) Task=`f2295973-74d0-4df7-9f8d-97614c137834`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:28:00,654::task::579::TaskManager.Task::(_updateState) Task=`f2295973-74d0-4df7-9f8d-97614c137834`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:28:00,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:28:00,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:28:00,654::task::974::TaskManager.Task::(_decref) Task=`f2295973-74d0-4df7-9f8d-97614c137834`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:00,802::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:28:00,803::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:01,233::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:01,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:28:01,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:28:01,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:28:01,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:02,806::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:28:02,806::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:28:02,806::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:28:03,149::task::579::TaskManager.Task::(_updateState) Task=`3c1e5b96-fb15-441f-ac5f-1c5acf6a5bc0`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:28:03,149::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:28:03,149::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:28:03,149::task::1168::TaskManager.Task::(prepare) Task=`3c1e5b96-fb15-441f-ac5f-1c5acf6a5bc0`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:28:03,149::task::579::TaskManager.Task::(_updateState) Task=`3c1e5b96-fb15-441f-ac5f-1c5acf6a5bc0`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:28:03,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:28:03,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:28:03,150::task::974::TaskManager.Task::(_decref) Task=`3c1e5b96-fb15-441f-ac5f-1c5acf6a5bc0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:28:03,234::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:03,235::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:03,807::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:28:03,807::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:28:04,637::task::579::TaskManager.Task::(_updateState) Task=`0efa2168-6d37-4843-98f3-be40974d8846`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:28:04,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:28:04,637::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:28:04,637::task::1168::TaskManager.Task::(prepare) Task=`0efa2168-6d37-4843-98f3-be40974d8846`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:28:04,638::task::579::TaskManager.Task::(_updateState) Task=`0efa2168-6d37-4843-98f3-be40974d8846`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:28:04,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:28:04,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:28:04,638::task::974::TaskManager.Task::(_decref) Task=`0efa2168-6d37-4843-98f3-be40974d8846`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:28:04,640::task::579::TaskManager.Task::(_updateState) Task=`488f749d-2498-4adf-b2d5-8f414b0f16dc`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:28:04,640::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:28:04,640::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:28:04,641::task::1168::TaskManager.Task::(prepare) Task=`488f749d-2498-4adf-b2d5-8f414b0f16dc`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:28:04,641::task::579::TaskManager.Task::(_updateState) Task=`488f749d-2498-4adf-b2d5-8f414b0f16dc`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:28:04,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:28:04,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:28:04,641::task::974::TaskManager.Task::(_decref) Task=`488f749d-2498-4adf-b2d5-8f414b0f16dc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:04,808::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:28:04,808::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:28:04,808::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:28:04,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:05,236::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:28:05,458::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:28:05,474::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000232958 s, 17.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:05,810::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:28:05,929::task::579::TaskManager.Task::(_updateState) Task=`8cc93264-d587-4bfe-af50-f7e76c9ab17a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:28:05,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:28:05,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:28:05,931::task::1168::TaskManager.Task::(prepare) Task=`8cc93264-d587-4bfe-af50-f7e76c9ab17a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:28:05,931::task::579::TaskManager.Task::(_updateState) Task=`8cc93264-d587-4bfe-af50-f7e76c9ab17a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:28:05,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:28:05,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:28:05,931::task::974::TaskManager.Task::(_decref) Task=`8cc93264-d587-4bfe-af50-f7e76c9ab17a`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:28:05,932::task::579::TaskManager.Task::(_updateState) Task=`2f9415e4-0625-426e-9533-e5467a6c6708`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:28:05,932::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:28:05,932::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:28:05,932::task::1168::TaskManager.Task::(prepare) Task=`2f9415e4-0625-426e-9533-e5467a6c6708`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:28:05,932::task::579::TaskManager.Task::(_updateState) Task=`2f9415e4-0625-426e-9533-e5467a6c6708`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:28:05,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:28:05,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:28:05,933::task::974::TaskManager.Task::(_decref) Task=`2f9415e4-0625-426e-9533-e5467a6c6708`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:28:06,793::task::579::TaskManager.Task::(_updateState) Task=`5af8f7f7-ce48-48e9-bff9-f39e2a721b4c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:28:06,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:28:06,793::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:28:06,793::task::1168::TaskManager.Task::(prepare) Task=`5af8f7f7-ce48-48e9-bff9-f39e2a721b4c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:28:06,793::task::579::TaskManager.Task::(_updateState) Task=`5af8f7f7-ce48-48e9-bff9-f39e2a721b4c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:28:06,794::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:28:06,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:28:06,794::task::974::TaskManager.Task::(_decref) Task=`5af8f7f7-ce48-48e9-bff9-f39e2a721b4c`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:28:06,794::task::579::TaskManager.Task::(_updateState) Task=`80396104-495c-459c-a2f3-252444ec60a9`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:28:06,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:28:06,795::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:28:06,795::task::1168::TaskManager.Task::(prepare) Task=`80396104-495c-459c-a2f3-252444ec60a9`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:28:06,795::task::579::TaskManager.Task::(_updateState) Task=`80396104-495c-459c-a2f3-252444ec60a9`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:28:06,795::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:28:06,795::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:28:06,795::task::974::TaskManager.Task::(_decref) Task=`80396104-495c-459c-a2f3-252444ec60a9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:06,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:28:06,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:28:06,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:28:06,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:06,812::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:28:06,813::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:28:07,238::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:28:07,359::task::579::TaskManager.Task::(_updateState) Task=`5b9a2a7d-1c6d-478a-b994-bc294e5b1eca`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:28:07,359::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:28:07,359::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:28:07,359::task::1168::TaskManager.Task::(prepare) Task=`5b9a2a7d-1c6d-478a-b994-bc294e5b1eca`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:28:07,360::task::579::TaskManager.Task::(_updateState) Task=`5b9a2a7d-1c6d-478a-b994-bc294e5b1eca`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:28:07,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:28:07,360::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:28:07,360::task::974::TaskManager.Task::(_decref) Task=`5b9a2a7d-1c6d-478a-b994-bc294e5b1eca`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:28:07,392::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:28:07,409::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000256522 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:28:07,413::task::579::TaskManager.Task::(_updateState) Task=`b3858c70-a544-4341-b02b-4272e362c61e`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:28:07,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:28:07,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:28:07,416::task::1168::TaskManager.Task::(prepare) Task=`b3858c70-a544-4341-b02b-4272e362c61e`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:28:07,417::task::579::TaskManager.Task::(_updateState) Task=`b3858c70-a544-4341-b02b-4272e362c61e`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:28:07,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:28:07,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:28:07,417::task::974::TaskManager.Task::(_decref) Task=`b3858c70-a544-4341-b02b-4272e362c61e`::ref 0 aborting False >Thread-286631::DEBUG::2014-01-16 16:28:07,715::task::579::TaskManager.Task::(_updateState) Task=`604d23b5-497e-41f9-b5a0-eefbd09cd4f4`::moving from state init -> state preparing >Thread-286631::INFO::2014-01-16 16:28:07,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286631::INFO::2014-01-16 16:28:07,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256522', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232958', 'lastCheck': '2.2', 'valid': True}} >Thread-286631::DEBUG::2014-01-16 16:28:07,716::task::1168::TaskManager.Task::(prepare) Task=`604d23b5-497e-41f9-b5a0-eefbd09cd4f4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256522', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232958', 'lastCheck': '2.2', 'valid': True}} >Thread-286631::DEBUG::2014-01-16 16:28:07,716::task::579::TaskManager.Task::(_updateState) Task=`604d23b5-497e-41f9-b5a0-eefbd09cd4f4`::moving from state preparing -> state finished >Thread-286631::DEBUG::2014-01-16 16:28:07,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286631::DEBUG::2014-01-16 16:28:07,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286631::DEBUG::2014-01-16 16:28:07,716::task::974::TaskManager.Task::(_decref) Task=`604d23b5-497e-41f9-b5a0-eefbd09cd4f4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:07,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:08,239::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:28:08,555::task::579::TaskManager.Task::(_updateState) Task=`677b0692-b302-424f-831a-c37448877771`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:28:08,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:28:08,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:28:08,556::task::1168::TaskManager.Task::(prepare) Task=`677b0692-b302-424f-831a-c37448877771`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:28:08,557::task::579::TaskManager.Task::(_updateState) Task=`677b0692-b302-424f-831a-c37448877771`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:28:08,557::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:28:08,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:28:08,558::task::974::TaskManager.Task::(_decref) Task=`677b0692-b302-424f-831a-c37448877771`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:08,816::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:28:08,816::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:28:08,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:09,241::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:28:09,616::task::579::TaskManager.Task::(_updateState) Task=`062619dc-aa31-42bf-a0f3-0db1e847f279`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:28:09,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:28:09,617::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:28:09,617::task::1168::TaskManager.Task::(prepare) Task=`062619dc-aa31-42bf-a0f3-0db1e847f279`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:28:09,617::task::579::TaskManager.Task::(_updateState) Task=`062619dc-aa31-42bf-a0f3-0db1e847f279`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:28:09,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:28:09,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:28:09,618::task::974::TaskManager.Task::(_decref) Task=`062619dc-aa31-42bf-a0f3-0db1e847f279`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:09,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:28:09,818::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:28:09,818::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:10,819::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:28:10,819::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:28:10,819::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:28:10,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:11,242::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:11,821::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:28:12,676::task::579::TaskManager.Task::(_updateState) Task=`92dbed1b-1f3d-43d2-8d55-926cbaab9372`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:28:12,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:28:12,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:28:12,677::task::1168::TaskManager.Task::(prepare) Task=`92dbed1b-1f3d-43d2-8d55-926cbaab9372`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:28:12,677::task::579::TaskManager.Task::(_updateState) Task=`92dbed1b-1f3d-43d2-8d55-926cbaab9372`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:28:12,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:28:12,678::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:28:12,678::task::974::TaskManager.Task::(_decref) Task=`92dbed1b-1f3d-43d2-8d55-926cbaab9372`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:12,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:28:12,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:13,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:13,243::task::579::TaskManager.Task::(_updateState) Task=`be2675cf-30c1-451c-aef9-6f7bd5de5b6a`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:28:13,244::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:28:13,244::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:28:13,244::task::1168::TaskManager.Task::(prepare) Task=`be2675cf-30c1-451c-aef9-6f7bd5de5b6a`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:28:13,244::task::579::TaskManager.Task::(_updateState) Task=`be2675cf-30c1-451c-aef9-6f7bd5de5b6a`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:28:13,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:28:13,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:28:13,245::task::974::TaskManager.Task::(_decref) Task=`be2675cf-30c1-451c-aef9-6f7bd5de5b6a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:28:13,246::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:28:13,247::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:28:13,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:13,250::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:13,251::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:13,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:14,825::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:15,252::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:28:15,480::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:28:15,497::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000242286 s, 16.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:15,825::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:28:15,882::task::579::TaskManager.Task::(_updateState) Task=`b25531ae-3303-4de9-87c4-1729151bbbb5`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:28:15,882::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:28:15,883::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:28:15,883::task::1168::TaskManager.Task::(prepare) Task=`b25531ae-3303-4de9-87c4-1729151bbbb5`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:28:15,883::task::579::TaskManager.Task::(_updateState) Task=`b25531ae-3303-4de9-87c4-1729151bbbb5`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:28:15,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:28:15,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:28:15,883::task::974::TaskManager.Task::(_decref) Task=`b25531ae-3303-4de9-87c4-1729151bbbb5`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:28:16,056::task::579::TaskManager.Task::(_updateState) Task=`678e07e3-2af2-474c-b3ae-2eaf5de80a6c`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:28:16,057::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:28:16,057::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:28:16,057::task::1168::TaskManager.Task::(prepare) Task=`678e07e3-2af2-474c-b3ae-2eaf5de80a6c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:28:16,057::task::579::TaskManager.Task::(_updateState) Task=`678e07e3-2af2-474c-b3ae-2eaf5de80a6c`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:28:16,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:28:16,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:28:16,058::task::974::TaskManager.Task::(_decref) Task=`678e07e3-2af2-474c-b3ae-2eaf5de80a6c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:16,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:17,254::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:28:17,421::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:28:17,438::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0003041 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:17,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:18,255::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:18,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:28:18,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:19,256::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:19,830::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:20,832::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:21,258::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:28:21,629::task::579::TaskManager.Task::(_updateState) Task=`441c2ee5-a78a-453d-b334-d014e3e2488b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:28:21,629::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:28:21,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:28:21,629::task::1168::TaskManager.Task::(prepare) Task=`441c2ee5-a78a-453d-b334-d014e3e2488b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:28:21,630::task::579::TaskManager.Task::(_updateState) Task=`441c2ee5-a78a-453d-b334-d014e3e2488b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:28:21,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:28:21,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:28:21,630::task::974::TaskManager.Task::(_decref) Task=`441c2ee5-a78a-453d-b334-d014e3e2488b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:28:21,630::task::579::TaskManager.Task::(_updateState) Task=`14add1a8-0057-43a0-bd86-daf13f2895a5`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:28:21,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:28:21,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:28:21,631::task::1168::TaskManager.Task::(prepare) Task=`14add1a8-0057-43a0-bd86-daf13f2895a5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:28:21,631::task::579::TaskManager.Task::(_updateState) Task=`14add1a8-0057-43a0-bd86-daf13f2895a5`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:28:21,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:28:21,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:28:21,632::task::974::TaskManager.Task::(_decref) Task=`14add1a8-0057-43a0-bd86-daf13f2895a5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:21,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:22,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:23,259::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:23,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:23,836::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:28:23,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:28:23,837::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286637::DEBUG::2014-01-16 16:28:24,011::task::579::TaskManager.Task::(_updateState) Task=`3faae460-8a87-454d-8d7c-81b39620f4b9`::moving from state init -> state preparing >Thread-286637::INFO::2014-01-16 16:28:24,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286637::INFO::2014-01-16 16:28:24,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0003041', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000242286', 'lastCheck': '8.5', 'valid': True}} >Thread-286637::DEBUG::2014-01-16 16:28:24,012::task::1168::TaskManager.Task::(prepare) Task=`3faae460-8a87-454d-8d7c-81b39620f4b9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0003041', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000242286', 'lastCheck': '8.5', 'valid': True}} >Thread-286637::DEBUG::2014-01-16 16:28:24,012::task::579::TaskManager.Task::(_updateState) Task=`3faae460-8a87-454d-8d7c-81b39620f4b9`::moving from state preparing -> state finished >Thread-286637::DEBUG::2014-01-16 16:28:24,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286637::DEBUG::2014-01-16 16:28:24,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286637::DEBUG::2014-01-16 16:28:24,013::task::974::TaskManager.Task::(_decref) Task=`3faae460-8a87-454d-8d7c-81b39620f4b9`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:28:24,200::task::579::TaskManager.Task::(_updateState) Task=`7f39cd58-b627-477a-a691-6b68226e5f68`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:28:24,201::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:28:24,201::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:28:24,202::task::1168::TaskManager.Task::(prepare) Task=`7f39cd58-b627-477a-a691-6b68226e5f68`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:28:24,202::task::579::TaskManager.Task::(_updateState) Task=`7f39cd58-b627-477a-a691-6b68226e5f68`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:28:24,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:28:24,203::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:28:24,203::task::974::TaskManager.Task::(_decref) Task=`7f39cd58-b627-477a-a691-6b68226e5f68`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:28:24,241::task::579::TaskManager.Task::(_updateState) Task=`7cdae21a-551e-45ac-a245-be8bf625dc48`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:28:24,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:28:24,242::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:28:24,242::task::1168::TaskManager.Task::(prepare) Task=`7cdae21a-551e-45ac-a245-be8bf625dc48`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:28:24,243::task::579::TaskManager.Task::(_updateState) Task=`7cdae21a-551e-45ac-a245-be8bf625dc48`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:28:24,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:28:24,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:28:24,243::task::974::TaskManager.Task::(_decref) Task=`7cdae21a-551e-45ac-a245-be8bf625dc48`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:24,838::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:28:24,838::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:25,261::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:28:25,503::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:28:25,522::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000242122 s, 16.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:25,840::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:28:25,840::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:28:25,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:26,842::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:28:26,842::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:27,263::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:28:27,448::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:28:27,465::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000371079 s, 984 kB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:28:27,717::task::579::TaskManager.Task::(_updateState) Task=`e5be0bc5-5d5f-4104-97ba-6f0b60795b20`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:28:27,718::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:28:27,718::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:28:27,718::task::1168::TaskManager.Task::(prepare) Task=`e5be0bc5-5d5f-4104-97ba-6f0b60795b20`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:28:27,719::task::579::TaskManager.Task::(_updateState) Task=`e5be0bc5-5d5f-4104-97ba-6f0b60795b20`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:28:27,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:28:27,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:28:27,719::task::974::TaskManager.Task::(_decref) Task=`e5be0bc5-5d5f-4104-97ba-6f0b60795b20`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:28:27,729::task::579::TaskManager.Task::(_updateState) Task=`b83d0e23-7d69-4a64-a577-3f1c122ed5a1`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:28:27,729::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:28:27,729::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:28:27,729::task::1168::TaskManager.Task::(prepare) Task=`b83d0e23-7d69-4a64-a577-3f1c122ed5a1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:28:27,730::task::579::TaskManager.Task::(_updateState) Task=`b83d0e23-7d69-4a64-a577-3f1c122ed5a1`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:28:27,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:28:27,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:28:27,730::task::974::TaskManager.Task::(_decref) Task=`b83d0e23-7d69-4a64-a577-3f1c122ed5a1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:27,842::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:28:27,843::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:28,265::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:28:28,265::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:28:28,273::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:28,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:29,274::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:29,845::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:28:29,845::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:30,847::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:28:30,847::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:31,276::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:31,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:28:31,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:28:31,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:28:31,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:28:32,751::task::579::TaskManager.Task::(_updateState) Task=`8e095bd2-e614-4361-aad9-dabbe741bf95`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:28:32,758::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:28:32,758::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:28:32,759::task::1168::TaskManager.Task::(prepare) Task=`8e095bd2-e614-4361-aad9-dabbe741bf95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:28:32,759::task::579::TaskManager.Task::(_updateState) Task=`8e095bd2-e614-4361-aad9-dabbe741bf95`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:28:32,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:28:32,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:28:32,759::task::974::TaskManager.Task::(_decref) Task=`8e095bd2-e614-4361-aad9-dabbe741bf95`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:32,849::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:28:32,850::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:28:32,850::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:33,277::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:33,278::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:33,851::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:28:33,852::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:34,852::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:28:34,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:28:34,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:28:34,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:35,279::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:28:35,358::task::579::TaskManager.Task::(_updateState) Task=`962be917-1af3-4532-ad5a-d8b73db1ba20`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:28:35,358::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:28:35,359::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:28:35,359::task::1168::TaskManager.Task::(prepare) Task=`962be917-1af3-4532-ad5a-d8b73db1ba20`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:28:35,359::task::579::TaskManager.Task::(_updateState) Task=`962be917-1af3-4532-ad5a-d8b73db1ba20`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:28:35,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:28:35,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:28:35,359::task::974::TaskManager.Task::(_decref) Task=`962be917-1af3-4532-ad5a-d8b73db1ba20`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:28:35,528::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:28:35,544::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000279274 s, 14.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:35,854::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:28:36,133::task::579::TaskManager.Task::(_updateState) Task=`2b20a060-5eba-4994-9015-fd081bc25ef1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:28:36,134::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:28:36,135::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:28:36,135::task::1168::TaskManager.Task::(prepare) Task=`2b20a060-5eba-4994-9015-fd081bc25ef1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:28:36,136::task::579::TaskManager.Task::(_updateState) Task=`2b20a060-5eba-4994-9015-fd081bc25ef1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:28:36,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:28:36,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:28:36,136::task::974::TaskManager.Task::(_decref) Task=`2b20a060-5eba-4994-9015-fd081bc25ef1`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:28:36,197::task::579::TaskManager.Task::(_updateState) Task=`04e6d570-e3dc-4838-b91c-3e1dccaa98b9`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:28:36,197::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:28:36,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:28:36,198::task::1168::TaskManager.Task::(prepare) Task=`04e6d570-e3dc-4838-b91c-3e1dccaa98b9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:28:36,198::task::579::TaskManager.Task::(_updateState) Task=`04e6d570-e3dc-4838-b91c-3e1dccaa98b9`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:28:36,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:28:36,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:28:36,199::task::974::TaskManager.Task::(_decref) Task=`04e6d570-e3dc-4838-b91c-3e1dccaa98b9`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:28:36,257::task::579::TaskManager.Task::(_updateState) Task=`1b7db215-ec7f-49f1-ae3c-4ef5c13a5a5c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:28:36,257::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:28:36,257::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:28:36,257::task::1168::TaskManager.Task::(prepare) Task=`1b7db215-ec7f-49f1-ae3c-4ef5c13a5a5c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:28:36,258::task::579::TaskManager.Task::(_updateState) Task=`1b7db215-ec7f-49f1-ae3c-4ef5c13a5a5c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:28:36,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:28:36,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:28:36,258::task::974::TaskManager.Task::(_decref) Task=`1b7db215-ec7f-49f1-ae3c-4ef5c13a5a5c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:36,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:28:36,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:28:36,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:28:36,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:36,856::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:28:36,857::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20952::DEBUG::2014-01-16 16:28:37,099::task::579::TaskManager.Task::(_updateState) Task=`cb2e5dfb-956d-4e01-a354-6a2d055ff8ed`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:28:37,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:28:37,100::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:28:37,100::task::1168::TaskManager.Task::(prepare) Task=`cb2e5dfb-956d-4e01-a354-6a2d055ff8ed`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:28:37,100::task::579::TaskManager.Task::(_updateState) Task=`cb2e5dfb-956d-4e01-a354-6a2d055ff8ed`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:28:37,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:28:37,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:28:37,100::task::974::TaskManager.Task::(_decref) Task=`cb2e5dfb-956d-4e01-a354-6a2d055ff8ed`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:28:37,280::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:28:37,391::task::579::TaskManager.Task::(_updateState) Task=`ad7a842d-c370-4f77-9548-724f1f8bded3`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:28:37,391::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:28:37,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:28:37,392::task::1168::TaskManager.Task::(prepare) Task=`ad7a842d-c370-4f77-9548-724f1f8bded3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:28:37,392::task::579::TaskManager.Task::(_updateState) Task=`ad7a842d-c370-4f77-9548-724f1f8bded3`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:28:37,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:28:37,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:28:37,392::task::974::TaskManager.Task::(_decref) Task=`ad7a842d-c370-4f77-9548-724f1f8bded3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:28:37,472::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:28:37,489::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273522 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:37,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:38,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:38,860::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:28:38,860::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:28:38,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:28:39,248::task::579::TaskManager.Task::(_updateState) Task=`164a66ec-fe6d-4ab5-8042-4f4d356c50ce`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:28:39,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:28:39,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:28:39,249::task::1168::TaskManager.Task::(prepare) Task=`164a66ec-fe6d-4ab5-8042-4f4d356c50ce`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:28:39,250::task::579::TaskManager.Task::(_updateState) Task=`164a66ec-fe6d-4ab5-8042-4f4d356c50ce`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:28:39,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:28:39,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:28:39,250::task::974::TaskManager.Task::(_decref) Task=`164a66ec-fe6d-4ab5-8042-4f4d356c50ce`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:28:39,250::task::579::TaskManager.Task::(_updateState) Task=`ff5366b6-299b-4573-98b6-55fd6f2a24bd`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:28:39,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:28:39,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:28:39,251::task::1168::TaskManager.Task::(prepare) Task=`ff5366b6-299b-4573-98b6-55fd6f2a24bd`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:28:39,251::task::579::TaskManager.Task::(_updateState) Task=`ff5366b6-299b-4573-98b6-55fd6f2a24bd`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:28:39,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:28:39,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:28:39,252::task::974::TaskManager.Task::(_decref) Task=`ff5366b6-299b-4573-98b6-55fd6f2a24bd`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:28:39,252::task::579::TaskManager.Task::(_updateState) Task=`81cc054a-6e9b-4201-a7f3-90c8a0ad7842`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:28:39,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:28:39,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:28:39,253::task::1168::TaskManager.Task::(prepare) Task=`81cc054a-6e9b-4201-a7f3-90c8a0ad7842`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:28:39,253::task::579::TaskManager.Task::(_updateState) Task=`81cc054a-6e9b-4201-a7f3-90c8a0ad7842`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:28:39,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:28:39,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:28:39,253::task::974::TaskManager.Task::(_decref) Task=`81cc054a-6e9b-4201-a7f3-90c8a0ad7842`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:28:39,284::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:39,861::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:28:39,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:28:39,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286643::DEBUG::2014-01-16 16:28:40,474::task::579::TaskManager.Task::(_updateState) Task=`0d608d23-d55b-43d6-b2b2-1ac3100b9bf8`::moving from state init -> state preparing >Thread-286643::INFO::2014-01-16 16:28:40,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286643::INFO::2014-01-16 16:28:40,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273522', 'lastCheck': '3.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279274', 'lastCheck': '4.9', 'valid': True}} >Thread-286643::DEBUG::2014-01-16 16:28:40,475::task::1168::TaskManager.Task::(prepare) Task=`0d608d23-d55b-43d6-b2b2-1ac3100b9bf8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273522', 'lastCheck': '3.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279274', 'lastCheck': '4.9', 'valid': True}} >Thread-286643::DEBUG::2014-01-16 16:28:40,475::task::579::TaskManager.Task::(_updateState) Task=`0d608d23-d55b-43d6-b2b2-1ac3100b9bf8`::moving from state preparing -> state finished >Thread-286643::DEBUG::2014-01-16 16:28:40,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286643::DEBUG::2014-01-16 16:28:40,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286643::DEBUG::2014-01-16 16:28:40,475::task::974::TaskManager.Task::(_decref) Task=`0d608d23-d55b-43d6-b2b2-1ac3100b9bf8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:40,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:28:40,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:28:40,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:28:40,863::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:41,285::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:41,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:42,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:28:42,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:43,287::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:43,289::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:28:43,289::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:28:43,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:43,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:44,867::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:28:45,096::task::579::TaskManager.Task::(_updateState) Task=`6107228a-d946-4a31-a5f7-a30e9c94e5ad`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:28:45,097::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:28:45,097::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:28:45,097::task::1168::TaskManager.Task::(prepare) Task=`6107228a-d946-4a31-a5f7-a30e9c94e5ad`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:28:45,097::task::579::TaskManager.Task::(_updateState) Task=`6107228a-d946-4a31-a5f7-a30e9c94e5ad`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:28:45,097::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:28:45,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:28:45,098::task::974::TaskManager.Task::(_decref) Task=`6107228a-d946-4a31-a5f7-a30e9c94e5ad`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:28:45,291::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:28:45,550::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:28:45,569::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000203065 s, 20.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:45,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:46,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:47,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:28:47,498::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:28:47,514::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289537 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:47,871::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:48,295::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:48,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:28:48,872::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:49,296::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:28:49,357::task::579::TaskManager.Task::(_updateState) Task=`dbbdb684-6f2f-450f-a690-f4e89b58b893`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:28:49,357::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:28:49,357::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:28:49,357::task::1168::TaskManager.Task::(prepare) Task=`dbbdb684-6f2f-450f-a690-f4e89b58b893`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:28:49,358::task::579::TaskManager.Task::(_updateState) Task=`dbbdb684-6f2f-450f-a690-f4e89b58b893`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:28:49,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:28:49,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:28:49,358::task::974::TaskManager.Task::(_decref) Task=`dbbdb684-6f2f-450f-a690-f4e89b58b893`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:49,873::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:50,875::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:51,298::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:51,876::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:52,877::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:53,299::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:28:53,300::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:53,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:28:53,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:28:53,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:28:54,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:28:54,880::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:55,302::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:28:55,574::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:28:55,590::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000282484 s, 14.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:55,880::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:28:55,881::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:28:55,881::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:28:56,192::task::579::TaskManager.Task::(_updateState) Task=`95a2abd7-d8cb-48a7-8be3-22a3849bb783`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:28:56,192::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:28:56,193::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:28:56,193::task::1168::TaskManager.Task::(prepare) Task=`95a2abd7-d8cb-48a7-8be3-22a3849bb783`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:28:56,193::task::579::TaskManager.Task::(_updateState) Task=`95a2abd7-d8cb-48a7-8be3-22a3849bb783`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:28:56,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:28:56,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:28:56,194::task::974::TaskManager.Task::(_decref) Task=`95a2abd7-d8cb-48a7-8be3-22a3849bb783`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:28:56,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:28:56,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:28:56,972::task::579::TaskManager.Task::(_updateState) Task=`7984a474-1286-4686-816e-f9b7b379080e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:28:56,973::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:28:56,973::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:28:56,973::task::1168::TaskManager.Task::(prepare) Task=`7984a474-1286-4686-816e-f9b7b379080e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:28:56,975::task::579::TaskManager.Task::(_updateState) Task=`7984a474-1286-4686-816e-f9b7b379080e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:28:56,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:28:56,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:28:56,979::task::974::TaskManager.Task::(_decref) Task=`7984a474-1286-4686-816e-f9b7b379080e`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:28:56,980::task::579::TaskManager.Task::(_updateState) Task=`f8a7c668-d66e-4c28-bd62-a326850f36af`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:28:56,982::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:28:56,983::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:28:56,983::task::1168::TaskManager.Task::(prepare) Task=`f8a7c668-d66e-4c28-bd62-a326850f36af`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:28:56,983::task::579::TaskManager.Task::(_updateState) Task=`f8a7c668-d66e-4c28-bd62-a326850f36af`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:28:56,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:28:56,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:28:56,984::task::974::TaskManager.Task::(_decref) Task=`f8a7c668-d66e-4c28-bd62-a326850f36af`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:28:56,984::task::579::TaskManager.Task::(_updateState) Task=`e22be264-7a0d-42b5-8550-0f9084e1a653`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:28:56,985::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:28:56,985::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:28:56,985::task::1168::TaskManager.Task::(prepare) Task=`e22be264-7a0d-42b5-8550-0f9084e1a653`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:28:56,985::task::579::TaskManager.Task::(_updateState) Task=`e22be264-7a0d-42b5-8550-0f9084e1a653`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:28:56,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:28:56,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:28:56,986::task::974::TaskManager.Task::(_decref) Task=`e22be264-7a0d-42b5-8550-0f9084e1a653`::ref 0 aborting False >Thread-286649::DEBUG::2014-01-16 16:28:57,112::task::579::TaskManager.Task::(_updateState) Task=`2ca6859d-d9a9-43e8-b76d-b5a6b2a2d895`::moving from state init -> state preparing >Thread-286649::INFO::2014-01-16 16:28:57,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286649::INFO::2014-01-16 16:28:57,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289537', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282484', 'lastCheck': '1.5', 'valid': True}} >Thread-286649::DEBUG::2014-01-16 16:28:57,113::task::1168::TaskManager.Task::(prepare) Task=`2ca6859d-d9a9-43e8-b76d-b5a6b2a2d895`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289537', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282484', 'lastCheck': '1.5', 'valid': True}} >Thread-286649::DEBUG::2014-01-16 16:28:57,113::task::579::TaskManager.Task::(_updateState) Task=`2ca6859d-d9a9-43e8-b76d-b5a6b2a2d895`::moving from state preparing -> state finished >Thread-286649::DEBUG::2014-01-16 16:28:57,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286649::DEBUG::2014-01-16 16:28:57,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286649::DEBUG::2014-01-16 16:28:57,114::task::974::TaskManager.Task::(_decref) Task=`2ca6859d-d9a9-43e8-b76d-b5a6b2a2d895`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:28:57,303::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:28:57,523::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:28:57,542::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000306294 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:28:57,883::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:28:57,883::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:58,306::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:28:58,306::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:28:58,307::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:58,884::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:28:59,309::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:28:59,886::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:28:59,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:29:00,881::task::579::TaskManager.Task::(_updateState) Task=`e1db7bf1-84a4-423e-8f25-e3be8d6bb6ed`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:29:00,881::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:29:00,882::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:29:00,882::task::1168::TaskManager.Task::(prepare) Task=`e1db7bf1-84a4-423e-8f25-e3be8d6bb6ed`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:29:00,882::task::579::TaskManager.Task::(_updateState) Task=`e1db7bf1-84a4-423e-8f25-e3be8d6bb6ed`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:29:00,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:29:00,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:29:00,882::task::974::TaskManager.Task::(_decref) Task=`e1db7bf1-84a4-423e-8f25-e3be8d6bb6ed`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:29:00,883::task::579::TaskManager.Task::(_updateState) Task=`83539354-d9b4-4b22-9fef-53d5145a44d9`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:29:00,883::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:29:00,883::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:29:00,883::task::1168::TaskManager.Task::(prepare) Task=`83539354-d9b4-4b22-9fef-53d5145a44d9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:29:00,883::task::579::TaskManager.Task::(_updateState) Task=`83539354-d9b4-4b22-9fef-53d5145a44d9`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:29:00,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:29:00,884::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:29:00,884::task::974::TaskManager.Task::(_decref) Task=`83539354-d9b4-4b22-9fef-53d5145a44d9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:00,887::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:29:00,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:01,310::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:01,888::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:29:01,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:29:01,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:29:01,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:02,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:29:02,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:29:02,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:03,311::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:03,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:29:03,325::task::579::TaskManager.Task::(_updateState) Task=`ed54a934-336b-4f7e-aa13-f814224efc09`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:29:03,325::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:29:03,326::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:29:03,326::task::1168::TaskManager.Task::(prepare) Task=`ed54a934-336b-4f7e-aa13-f814224efc09`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:29:03,326::task::579::TaskManager.Task::(_updateState) Task=`ed54a934-336b-4f7e-aa13-f814224efc09`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:29:03,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:29:03,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:29:03,326::task::974::TaskManager.Task::(_decref) Task=`ed54a934-336b-4f7e-aa13-f814224efc09`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:03,892::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:29:03,892::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:29:04,713::task::579::TaskManager.Task::(_updateState) Task=`668205c1-2816-4765-85d7-fe0a6fe3bcc3`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:29:04,713::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:29:04,714::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:29:04,714::task::1168::TaskManager.Task::(prepare) Task=`668205c1-2816-4765-85d7-fe0a6fe3bcc3`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:29:04,715::task::579::TaskManager.Task::(_updateState) Task=`668205c1-2816-4765-85d7-fe0a6fe3bcc3`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:29:04,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:29:04,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:29:04,715::task::974::TaskManager.Task::(_decref) Task=`668205c1-2816-4765-85d7-fe0a6fe3bcc3`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:29:04,721::task::579::TaskManager.Task::(_updateState) Task=`07c044d0-c7c7-447a-a6aa-04a42e4a482c`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:29:04,721::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:29:04,722::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:29:04,722::task::1168::TaskManager.Task::(prepare) Task=`07c044d0-c7c7-447a-a6aa-04a42e4a482c`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:29:04,722::task::579::TaskManager.Task::(_updateState) Task=`07c044d0-c7c7-447a-a6aa-04a42e4a482c`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:29:04,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:29:04,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:29:04,723::task::974::TaskManager.Task::(_decref) Task=`07c044d0-c7c7-447a-a6aa-04a42e4a482c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:04,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:29:04,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:29:04,894::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:29:04,894::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:05,314::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:29:05,596::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:29:05,613::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000222786 s, 18.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:05,895::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:29:06,022::task::579::TaskManager.Task::(_updateState) Task=`40c7523d-a9e9-4821-b111-1e588e6065b6`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:29:06,022::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:29:06,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:29:06,023::task::1168::TaskManager.Task::(prepare) Task=`40c7523d-a9e9-4821-b111-1e588e6065b6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:29:06,023::task::579::TaskManager.Task::(_updateState) Task=`40c7523d-a9e9-4821-b111-1e588e6065b6`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:29:06,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:29:06,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:29:06,024::task::974::TaskManager.Task::(_decref) Task=`40c7523d-a9e9-4821-b111-1e588e6065b6`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:29:06,024::task::579::TaskManager.Task::(_updateState) Task=`55ef555d-db21-44f3-81f7-8e11adddfdfb`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:29:06,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:29:06,024::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:29:06,024::task::1168::TaskManager.Task::(prepare) Task=`55ef555d-db21-44f3-81f7-8e11adddfdfb`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:29:06,025::task::579::TaskManager.Task::(_updateState) Task=`55ef555d-db21-44f3-81f7-8e11adddfdfb`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:29:06,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:29:06,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:29:06,025::task::974::TaskManager.Task::(_decref) Task=`55ef555d-db21-44f3-81f7-8e11adddfdfb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:06,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:29:06,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:29:06,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:29:06,896::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:06,896::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:29:06,897::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-17110::DEBUG::2014-01-16 16:29:07,018::task::579::TaskManager.Task::(_updateState) Task=`14f478c5-43a9-4d37-b2b4-99ea60f35a0f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:29:07,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:29:07,019::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:29:07,019::task::1168::TaskManager.Task::(prepare) Task=`14f478c5-43a9-4d37-b2b4-99ea60f35a0f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:29:07,019::task::579::TaskManager.Task::(_updateState) Task=`14f478c5-43a9-4d37-b2b4-99ea60f35a0f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:29:07,019::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:29:07,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:29:07,020::task::974::TaskManager.Task::(_decref) Task=`14f478c5-43a9-4d37-b2b4-99ea60f35a0f`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:29:07,020::task::579::TaskManager.Task::(_updateState) Task=`384110f7-ace9-49fd-afcc-1a8b0a6e711a`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:29:07,020::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:29:07,021::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:29:07,021::task::1168::TaskManager.Task::(prepare) Task=`384110f7-ace9-49fd-afcc-1a8b0a6e711a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:29:07,021::task::579::TaskManager.Task::(_updateState) Task=`384110f7-ace9-49fd-afcc-1a8b0a6e711a`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:29:07,021::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:29:07,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:29:07,021::task::974::TaskManager.Task::(_decref) Task=`384110f7-ace9-49fd-afcc-1a8b0a6e711a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:29:07,316::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:29:07,524::task::579::TaskManager.Task::(_updateState) Task=`6007e8f2-874e-4872-8a4a-93de2246b6c6`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:29:07,524::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:29:07,525::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:29:07,525::task::1168::TaskManager.Task::(prepare) Task=`6007e8f2-874e-4872-8a4a-93de2246b6c6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:29:07,525::task::579::TaskManager.Task::(_updateState) Task=`6007e8f2-874e-4872-8a4a-93de2246b6c6`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:29:07,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:29:07,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:29:07,525::task::974::TaskManager.Task::(_decref) Task=`6007e8f2-874e-4872-8a4a-93de2246b6c6`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:29:07,551::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:29:07,569::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029212 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:29:07,572::task::579::TaskManager.Task::(_updateState) Task=`cb714713-cd7f-447a-a57d-9ec8ac161fe8`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:29:07,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:29:07,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:29:07,578::task::1168::TaskManager.Task::(prepare) Task=`cb714713-cd7f-447a-a57d-9ec8ac161fe8`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:29:07,579::task::579::TaskManager.Task::(_updateState) Task=`cb714713-cd7f-447a-a57d-9ec8ac161fe8`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:29:07,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:29:07,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:29:07,580::task::974::TaskManager.Task::(_decref) Task=`cb714713-cd7f-447a-a57d-9ec8ac161fe8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:07,898::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:08,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:29:08,743::task::579::TaskManager.Task::(_updateState) Task=`f9d7a37e-fc9b-4465-8985-b4a17bc4c638`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:29:08,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:29:08,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:29:08,744::task::1168::TaskManager.Task::(prepare) Task=`f9d7a37e-fc9b-4465-8985-b4a17bc4c638`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:29:08,744::task::579::TaskManager.Task::(_updateState) Task=`f9d7a37e-fc9b-4465-8985-b4a17bc4c638`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:29:08,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:29:08,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:29:08,744::task::974::TaskManager.Task::(_decref) Task=`f9d7a37e-fc9b-4465-8985-b4a17bc4c638`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:08,899::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:29:08,900::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:29:08,900::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:09,318::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:29:09,802::task::579::TaskManager.Task::(_updateState) Task=`788e267d-1ef7-48ea-a1f6-b0844f718fc0`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:29:09,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:29:09,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:29:09,803::task::1168::TaskManager.Task::(prepare) Task=`788e267d-1ef7-48ea-a1f6-b0844f718fc0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:29:09,803::task::579::TaskManager.Task::(_updateState) Task=`788e267d-1ef7-48ea-a1f6-b0844f718fc0`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:29:09,803::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:29:09,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:29:09,804::task::974::TaskManager.Task::(_decref) Task=`788e267d-1ef7-48ea-a1f6-b0844f718fc0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:09,901::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:29:09,901::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:29:09,902::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:10,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:29:10,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:29:10,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:29:10,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:11,320::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:11,905::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:29:12,860::task::579::TaskManager.Task::(_updateState) Task=`0ea0fae4-0f2f-460c-b5ca-437fb4a7fafc`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:29:12,861::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:29:12,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:29:12,861::task::1168::TaskManager.Task::(prepare) Task=`0ea0fae4-0f2f-460c-b5ca-437fb4a7fafc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:29:12,861::task::579::TaskManager.Task::(_updateState) Task=`0ea0fae4-0f2f-460c-b5ca-437fb4a7fafc`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:29:12,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:29:12,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:29:12,862::task::974::TaskManager.Task::(_decref) Task=`0ea0fae4-0f2f-460c-b5ca-437fb4a7fafc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:12,906::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:29:12,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:13,321::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:13,322::task::579::TaskManager.Task::(_updateState) Task=`f4f57e71-625c-458a-88ca-8be2e53ebf02`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:29:13,322::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:29:13,322::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:29:13,322::task::1168::TaskManager.Task::(prepare) Task=`f4f57e71-625c-458a-88ca-8be2e53ebf02`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:29:13,323::task::579::TaskManager.Task::(_updateState) Task=`f4f57e71-625c-458a-88ca-8be2e53ebf02`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:29:13,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:29:13,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:29:13,323::task::974::TaskManager.Task::(_decref) Task=`f4f57e71-625c-458a-88ca-8be2e53ebf02`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:29:13,326::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:29:13,326::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:29:13,328::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:13,330::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:13,331::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286655::DEBUG::2014-01-16 16:29:13,749::task::579::TaskManager.Task::(_updateState) Task=`dd2ea220-d1c8-4e5e-8505-b71cb3cb65ee`::moving from state init -> state preparing >Thread-286655::INFO::2014-01-16 16:29:13,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286655::INFO::2014-01-16 16:29:13,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029212', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222786', 'lastCheck': '8.1', 'valid': True}} >Thread-286655::DEBUG::2014-01-16 16:29:13,750::task::1168::TaskManager.Task::(prepare) Task=`dd2ea220-d1c8-4e5e-8505-b71cb3cb65ee`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029212', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222786', 'lastCheck': '8.1', 'valid': True}} >Thread-286655::DEBUG::2014-01-16 16:29:13,750::task::579::TaskManager.Task::(_updateState) Task=`dd2ea220-d1c8-4e5e-8505-b71cb3cb65ee`::moving from state preparing -> state finished >Thread-286655::DEBUG::2014-01-16 16:29:13,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286655::DEBUG::2014-01-16 16:29:13,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286655::DEBUG::2014-01-16 16:29:13,751::task::974::TaskManager.Task::(_decref) Task=`dd2ea220-d1c8-4e5e-8505-b71cb3cb65ee`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:13,907::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:14,909::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:15,332::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:29:15,618::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:29:15,635::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00025327 s, 16.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:15,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:29:15,960::task::579::TaskManager.Task::(_updateState) Task=`44387b28-bd4e-4608-b6a8-1ee605b6b256`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:29:15,961::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:29:15,961::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:29:15,961::task::1168::TaskManager.Task::(prepare) Task=`44387b28-bd4e-4608-b6a8-1ee605b6b256`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:29:15,961::task::579::TaskManager.Task::(_updateState) Task=`44387b28-bd4e-4608-b6a8-1ee605b6b256`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:29:15,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:29:15,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:29:15,962::task::974::TaskManager.Task::(_decref) Task=`44387b28-bd4e-4608-b6a8-1ee605b6b256`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:29:16,229::task::579::TaskManager.Task::(_updateState) Task=`07ff4354-80b2-454e-86e3-45eb0cfc7823`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:29:16,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:29:16,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:29:16,230::task::1168::TaskManager.Task::(prepare) Task=`07ff4354-80b2-454e-86e3-45eb0cfc7823`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:29:16,230::task::579::TaskManager.Task::(_updateState) Task=`07ff4354-80b2-454e-86e3-45eb0cfc7823`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:29:16,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:29:16,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:29:16,231::task::974::TaskManager.Task::(_decref) Task=`07ff4354-80b2-454e-86e3-45eb0cfc7823`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:16,911::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:17,334::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:29:17,585::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:29:17,603::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000867441 s, 421 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:17,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:18,335::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:18,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:29:18,913::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:19,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:19,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:20,915::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:21,338::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:21,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:29:22,013::task::579::TaskManager.Task::(_updateState) Task=`11e32ec3-2eff-4755-9bf9-ff1f2ac1fc10`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:29:22,014::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:29:22,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:29:22,014::task::1168::TaskManager.Task::(prepare) Task=`11e32ec3-2eff-4755-9bf9-ff1f2ac1fc10`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:29:22,014::task::579::TaskManager.Task::(_updateState) Task=`11e32ec3-2eff-4755-9bf9-ff1f2ac1fc10`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:29:22,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:29:22,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:29:22,015::task::974::TaskManager.Task::(_decref) Task=`11e32ec3-2eff-4755-9bf9-ff1f2ac1fc10`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:29:22,015::task::579::TaskManager.Task::(_updateState) Task=`d0c4f224-deed-497c-b167-0f830e600721`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:29:22,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:29:22,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:29:22,016::task::1168::TaskManager.Task::(prepare) Task=`d0c4f224-deed-497c-b167-0f830e600721`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:29:22,016::task::579::TaskManager.Task::(_updateState) Task=`d0c4f224-deed-497c-b167-0f830e600721`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:29:22,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:29:22,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:29:22,016::task::974::TaskManager.Task::(_decref) Task=`d0c4f224-deed-497c-b167-0f830e600721`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:22,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:23,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:23,340::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:23,919::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:29:23,919::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:29:23,919::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:29:24,306::task::579::TaskManager.Task::(_updateState) Task=`b3c1b4cc-f035-4f42-a1a8-e290e0bf958b`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:29:24,307::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:29:24,307::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:29:24,307::task::1168::TaskManager.Task::(prepare) Task=`b3c1b4cc-f035-4f42-a1a8-e290e0bf958b`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:29:24,307::task::579::TaskManager.Task::(_updateState) Task=`b3c1b4cc-f035-4f42-a1a8-e290e0bf958b`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:29:24,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:29:24,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:29:24,308::task::974::TaskManager.Task::(_decref) Task=`b3c1b4cc-f035-4f42-a1a8-e290e0bf958b`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:29:24,391::task::579::TaskManager.Task::(_updateState) Task=`30079ea4-2120-4fe4-8289-2ff3860df97f`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:29:24,391::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:29:24,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:29:24,391::task::1168::TaskManager.Task::(prepare) Task=`30079ea4-2120-4fe4-8289-2ff3860df97f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:29:24,391::task::579::TaskManager.Task::(_updateState) Task=`30079ea4-2120-4fe4-8289-2ff3860df97f`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:29:24,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:29:24,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:29:24,392::task::974::TaskManager.Task::(_decref) Task=`30079ea4-2120-4fe4-8289-2ff3860df97f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:24,921::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:29:24,921::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:25,341::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:29:25,641::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:29:25,659::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107059 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:25,922::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:29:25,922::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:29:25,923::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:26,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:29:26,924::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:27,343::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:29:27,612::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:29:27,630::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258449 s, 1.4 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:29:27,893::task::579::TaskManager.Task::(_updateState) Task=`2889f181-14b2-45ec-902c-263c3e715c67`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:29:27,893::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:29:27,893::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:29:27,893::task::1168::TaskManager.Task::(prepare) Task=`2889f181-14b2-45ec-902c-263c3e715c67`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:29:27,894::task::579::TaskManager.Task::(_updateState) Task=`2889f181-14b2-45ec-902c-263c3e715c67`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:29:27,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:29:27,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:29:27,894::task::974::TaskManager.Task::(_decref) Task=`2889f181-14b2-45ec-902c-263c3e715c67`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:29:27,901::task::579::TaskManager.Task::(_updateState) Task=`b0b67b4a-c284-4d36-8582-4d57072e6a83`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:29:27,902::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:29:27,902::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:29:27,902::task::1168::TaskManager.Task::(prepare) Task=`b0b67b4a-c284-4d36-8582-4d57072e6a83`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:29:27,902::task::579::TaskManager.Task::(_updateState) Task=`b0b67b4a-c284-4d36-8582-4d57072e6a83`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:29:27,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:29:27,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:29:27,903::task::974::TaskManager.Task::(_decref) Task=`b0b67b4a-c284-4d36-8582-4d57072e6a83`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:27,925::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:29:27,925::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:28,345::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:29:28,346::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:29:28,347::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:28,926::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:29,348::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:29,927::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:29:29,928::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286661::DEBUG::2014-01-16 16:29:30,100::task::579::TaskManager.Task::(_updateState) Task=`502963bc-ed48-4c38-8bb9-b529c19cd1b1`::moving from state init -> state preparing >Thread-286661::INFO::2014-01-16 16:29:30,100::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286661::INFO::2014-01-16 16:29:30,100::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258449', 'lastCheck': '2.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107059', 'lastCheck': '4.4', 'valid': True}} >Thread-286661::DEBUG::2014-01-16 16:29:30,100::task::1168::TaskManager.Task::(prepare) Task=`502963bc-ed48-4c38-8bb9-b529c19cd1b1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258449', 'lastCheck': '2.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107059', 'lastCheck': '4.4', 'valid': True}} >Thread-286661::DEBUG::2014-01-16 16:29:30,100::task::579::TaskManager.Task::(_updateState) Task=`502963bc-ed48-4c38-8bb9-b529c19cd1b1`::moving from state preparing -> state finished >Thread-286661::DEBUG::2014-01-16 16:29:30,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286661::DEBUG::2014-01-16 16:29:30,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286661::DEBUG::2014-01-16 16:29:30,101::task::974::TaskManager.Task::(_decref) Task=`502963bc-ed48-4c38-8bb9-b529c19cd1b1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:30,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:29:30,929::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:31,350::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:31,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:29:31,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:29:31,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:29:31,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:29:32,926::task::579::TaskManager.Task::(_updateState) Task=`69155310-3b80-4126-844a-77e660950c9e`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:29:32,926::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:29:32,927::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:29:32,927::task::1168::TaskManager.Task::(prepare) Task=`69155310-3b80-4126-844a-77e660950c9e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:29:32,927::task::579::TaskManager.Task::(_updateState) Task=`69155310-3b80-4126-844a-77e660950c9e`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:29:32,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:29:32,927::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:29:32,927::task::974::TaskManager.Task::(_decref) Task=`69155310-3b80-4126-844a-77e660950c9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:32,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:29:32,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:29:32,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:33,351::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:33,352::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:33,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:29:33,934::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:34,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:29:34,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:29:34,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:29:34,936::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:35,353::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:29:35,525::task::579::TaskManager.Task::(_updateState) Task=`3e8804f2-0946-4297-844b-b186dc1357ba`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:29:35,526::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:29:35,526::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:29:35,526::task::1168::TaskManager.Task::(prepare) Task=`3e8804f2-0946-4297-844b-b186dc1357ba`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:29:35,526::task::579::TaskManager.Task::(_updateState) Task=`3e8804f2-0946-4297-844b-b186dc1357ba`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:29:35,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:29:35,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:29:35,527::task::974::TaskManager.Task::(_decref) Task=`3e8804f2-0946-4297-844b-b186dc1357ba`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:29:35,664::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:29:35,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000285207 s, 14.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:35,937::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:29:36,295::task::579::TaskManager.Task::(_updateState) Task=`424a56ad-07c1-4c8f-9f71-a83314e4abd1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:29:36,296::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:29:36,296::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:29:36,296::task::1168::TaskManager.Task::(prepare) Task=`424a56ad-07c1-4c8f-9f71-a83314e4abd1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:29:36,296::task::579::TaskManager.Task::(_updateState) Task=`424a56ad-07c1-4c8f-9f71-a83314e4abd1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:29:36,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:29:36,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:29:36,297::task::974::TaskManager.Task::(_decref) Task=`424a56ad-07c1-4c8f-9f71-a83314e4abd1`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:29:36,351::task::579::TaskManager.Task::(_updateState) Task=`40a011cd-b89f-4389-a922-52c60707f4e0`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:29:36,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:29:36,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:29:36,352::task::1168::TaskManager.Task::(prepare) Task=`40a011cd-b89f-4389-a922-52c60707f4e0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:29:36,352::task::579::TaskManager.Task::(_updateState) Task=`40a011cd-b89f-4389-a922-52c60707f4e0`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:29:36,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:29:36,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:29:36,353::task::974::TaskManager.Task::(_decref) Task=`40a011cd-b89f-4389-a922-52c60707f4e0`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:29:36,421::task::579::TaskManager.Task::(_updateState) Task=`3f2daf61-74a5-4f60-b7d9-2f289ca63a65`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:29:36,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:29:36,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:29:36,422::task::1168::TaskManager.Task::(prepare) Task=`3f2daf61-74a5-4f60-b7d9-2f289ca63a65`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:29:36,422::task::579::TaskManager.Task::(_updateState) Task=`3f2daf61-74a5-4f60-b7d9-2f289ca63a65`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:29:36,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:29:36,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:29:36,423::task::974::TaskManager.Task::(_decref) Task=`3f2daf61-74a5-4f60-b7d9-2f289ca63a65`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:36,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:29:36,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:29:36,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:29:36,939::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:36,939::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:29:36,940::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20952::DEBUG::2014-01-16 16:29:37,260::task::579::TaskManager.Task::(_updateState) Task=`112bc384-44f3-45be-b363-aaf019264772`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:29:37,260::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:29:37,260::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:29:37,260::task::1168::TaskManager.Task::(prepare) Task=`112bc384-44f3-45be-b363-aaf019264772`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:29:37,260::task::579::TaskManager.Task::(_updateState) Task=`112bc384-44f3-45be-b363-aaf019264772`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:29:37,261::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:29:37,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:29:37,261::task::974::TaskManager.Task::(_decref) Task=`112bc384-44f3-45be-b363-aaf019264772`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:29:37,355::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:29:37,548::task::579::TaskManager.Task::(_updateState) Task=`6f66d610-22ca-4c06-ab93-a07a1b0433ac`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:29:37,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:29:37,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:29:37,549::task::1168::TaskManager.Task::(prepare) Task=`6f66d610-22ca-4c06-ab93-a07a1b0433ac`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:29:37,549::task::579::TaskManager.Task::(_updateState) Task=`6f66d610-22ca-4c06-ab93-a07a1b0433ac`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:29:37,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:29:37,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:29:37,550::task::974::TaskManager.Task::(_decref) Task=`6f66d610-22ca-4c06-ab93-a07a1b0433ac`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:29:37,638::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:29:37,654::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002667 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:37,941::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:38,356::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:38,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:29:38,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:29:38,942::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:39,357::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:29:39,530::task::579::TaskManager.Task::(_updateState) Task=`2b7c9a30-e21e-498e-9600-c080972c463e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:29:39,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:29:39,531::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:29:39,531::task::1168::TaskManager.Task::(prepare) Task=`2b7c9a30-e21e-498e-9600-c080972c463e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:29:39,531::task::579::TaskManager.Task::(_updateState) Task=`2b7c9a30-e21e-498e-9600-c080972c463e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:29:39,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:29:39,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:29:39,532::task::974::TaskManager.Task::(_decref) Task=`2b7c9a30-e21e-498e-9600-c080972c463e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:29:39,532::task::579::TaskManager.Task::(_updateState) Task=`35c12bce-03e1-48f1-ba0b-8dc872e1fcda`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:29:39,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:29:39,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:29:39,533::task::1168::TaskManager.Task::(prepare) Task=`35c12bce-03e1-48f1-ba0b-8dc872e1fcda`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:29:39,533::task::579::TaskManager.Task::(_updateState) Task=`35c12bce-03e1-48f1-ba0b-8dc872e1fcda`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:29:39,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:29:39,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:29:39,533::task::974::TaskManager.Task::(_decref) Task=`35c12bce-03e1-48f1-ba0b-8dc872e1fcda`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:29:39,534::task::579::TaskManager.Task::(_updateState) Task=`59e69406-3901-4330-97f7-0cbee3a83929`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:29:39,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:29:39,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:29:39,534::task::1168::TaskManager.Task::(prepare) Task=`59e69406-3901-4330-97f7-0cbee3a83929`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:29:39,534::task::579::TaskManager.Task::(_updateState) Task=`59e69406-3901-4330-97f7-0cbee3a83929`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:29:39,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:29:39,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:29:39,535::task::974::TaskManager.Task::(_decref) Task=`59e69406-3901-4330-97f7-0cbee3a83929`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:39,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:29:39,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:29:39,943::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:40,944::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:29:40,945::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:29:40,945::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:29:40,945::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:41,359::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:41,946::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:42,947::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:29:42,948::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:43,360::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:43,362::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:29:43,362::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:29:43,364::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:43,948::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:44,949::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:29:45,260::task::579::TaskManager.Task::(_updateState) Task=`5623761f-4675-4070-b6f2-da4e9fe61f69`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:29:45,261::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:29:45,261::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:29:45,261::task::1168::TaskManager.Task::(prepare) Task=`5623761f-4675-4070-b6f2-da4e9fe61f69`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:29:45,261::task::579::TaskManager.Task::(_updateState) Task=`5623761f-4675-4070-b6f2-da4e9fe61f69`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:29:45,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:29:45,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:29:45,262::task::974::TaskManager.Task::(_decref) Task=`5623761f-4675-4070-b6f2-da4e9fe61f69`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:29:45,365::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:29:45,686::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:29:45,703::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000255326 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:45,950::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286667::DEBUG::2014-01-16 16:29:46,469::task::579::TaskManager.Task::(_updateState) Task=`2c9f764b-3965-4d25-96c5-8b249888cf67`::moving from state init -> state preparing >Thread-286667::INFO::2014-01-16 16:29:46,469::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286667::INFO::2014-01-16 16:29:46,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002667', 'lastCheck': '8.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255326', 'lastCheck': '0.8', 'valid': True}} >Thread-286667::DEBUG::2014-01-16 16:29:46,470::task::1168::TaskManager.Task::(prepare) Task=`2c9f764b-3965-4d25-96c5-8b249888cf67`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002667', 'lastCheck': '8.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255326', 'lastCheck': '0.8', 'valid': True}} >Thread-286667::DEBUG::2014-01-16 16:29:46,470::task::579::TaskManager.Task::(_updateState) Task=`2c9f764b-3965-4d25-96c5-8b249888cf67`::moving from state preparing -> state finished >Thread-286667::DEBUG::2014-01-16 16:29:46,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286667::DEBUG::2014-01-16 16:29:46,471::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286667::DEBUG::2014-01-16 16:29:46,471::task::974::TaskManager.Task::(_decref) Task=`2c9f764b-3965-4d25-96c5-8b249888cf67`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:46,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:47,367::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:29:47,662::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:29:47,678::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291314 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:47,952::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:48,368::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:48,954::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:29:48,954::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:49,370::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:29:49,540::task::579::TaskManager.Task::(_updateState) Task=`8fc3997f-8469-489d-901d-449a4c53dd4b`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:29:49,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:29:49,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:29:49,541::task::1168::TaskManager.Task::(prepare) Task=`8fc3997f-8469-489d-901d-449a4c53dd4b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:29:49,541::task::579::TaskManager.Task::(_updateState) Task=`8fc3997f-8469-489d-901d-449a4c53dd4b`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:29:49,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:29:49,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:29:49,542::task::974::TaskManager.Task::(_decref) Task=`8fc3997f-8469-489d-901d-449a4c53dd4b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:49,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:50,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:51,371::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:51,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:52,958::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:53,373::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:29:53,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:53,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:29:53,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:29:53,960::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:29:54,960::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:29:54,960::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:55,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:29:55,708::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:29:55,725::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000222158 s, 18.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:55,961::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:29:55,961::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:29:55,961::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:29:56,363::task::579::TaskManager.Task::(_updateState) Task=`b4e9f5a2-dd92-40bf-91ab-a49eaa7b403b`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:29:56,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:29:56,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:29:56,365::task::1168::TaskManager.Task::(prepare) Task=`b4e9f5a2-dd92-40bf-91ab-a49eaa7b403b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:29:56,365::task::579::TaskManager.Task::(_updateState) Task=`b4e9f5a2-dd92-40bf-91ab-a49eaa7b403b`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:29:56,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:29:56,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:29:56,366::task::974::TaskManager.Task::(_decref) Task=`b4e9f5a2-dd92-40bf-91ab-a49eaa7b403b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:29:56,963::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:29:56,963::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:57,377::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:29:57,578::task::579::TaskManager.Task::(_updateState) Task=`573aa6cc-befe-4321-a710-0837e4a11d0b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:29:57,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:29:57,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:29:57,579::task::1168::TaskManager.Task::(prepare) Task=`573aa6cc-befe-4321-a710-0837e4a11d0b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:29:57,579::task::579::TaskManager.Task::(_updateState) Task=`573aa6cc-befe-4321-a710-0837e4a11d0b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:29:57,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:29:57,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:29:57,579::task::974::TaskManager.Task::(_decref) Task=`573aa6cc-befe-4321-a710-0837e4a11d0b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:29:57,579::task::579::TaskManager.Task::(_updateState) Task=`c64c557c-2605-4f54-98f5-23d2dabab1c1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:29:57,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:29:57,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:29:57,580::task::1168::TaskManager.Task::(prepare) Task=`c64c557c-2605-4f54-98f5-23d2dabab1c1`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:29:57,580::task::579::TaskManager.Task::(_updateState) Task=`c64c557c-2605-4f54-98f5-23d2dabab1c1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:29:57,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:29:57,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:29:57,581::task::974::TaskManager.Task::(_decref) Task=`c64c557c-2605-4f54-98f5-23d2dabab1c1`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:29:57,581::task::579::TaskManager.Task::(_updateState) Task=`2dd842b9-9328-4767-84e6-ed8f73e0a79a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:29:57,581::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:29:57,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:29:57,581::task::1168::TaskManager.Task::(prepare) Task=`2dd842b9-9328-4767-84e6-ed8f73e0a79a`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:29:57,582::task::579::TaskManager.Task::(_updateState) Task=`2dd842b9-9328-4767-84e6-ed8f73e0a79a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:29:57,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:29:57,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:29:57,582::task::974::TaskManager.Task::(_decref) Task=`2dd842b9-9328-4767-84e6-ed8f73e0a79a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:29:57,688::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:29:57,707::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000277934 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:29:57,964::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:29:57,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:58,379::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:29:58,380::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:29:58,381::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:58,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:29:59,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:29:59,967::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:29:59,967::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:00,969::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:30:00,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:30:01,103::task::579::TaskManager.Task::(_updateState) Task=`85cfbe17-2468-4add-90d1-ddaad9e7498c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:30:01,103::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:30:01,104::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:30:01,104::task::1168::TaskManager.Task::(prepare) Task=`85cfbe17-2468-4add-90d1-ddaad9e7498c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:30:01,104::task::579::TaskManager.Task::(_updateState) Task=`85cfbe17-2468-4add-90d1-ddaad9e7498c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:30:01,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:30:01,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:30:01,104::task::974::TaskManager.Task::(_decref) Task=`85cfbe17-2468-4add-90d1-ddaad9e7498c`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:30:01,105::task::579::TaskManager.Task::(_updateState) Task=`da7f23f2-9e84-498c-b2e5-a067b42b1dbe`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:30:01,105::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:30:01,105::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:30:01,105::task::1168::TaskManager.Task::(prepare) Task=`da7f23f2-9e84-498c-b2e5-a067b42b1dbe`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:30:01,105::task::579::TaskManager.Task::(_updateState) Task=`da7f23f2-9e84-498c-b2e5-a067b42b1dbe`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:30:01,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:30:01,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:30:01,106::task::974::TaskManager.Task::(_decref) Task=`da7f23f2-9e84-498c-b2e5-a067b42b1dbe`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:01,385::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:01,970::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:30:01,970::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:30:01,971::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:30:01,971::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:02,972::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:30:02,972::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:30:02,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286673::DEBUG::2014-01-16 16:30:03,356::task::579::TaskManager.Task::(_updateState) Task=`52c61ae5-cad8-4211-af1b-96abc32108cd`::moving from state init -> state preparing >Thread-286673::INFO::2014-01-16 16:30:03,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286673::INFO::2014-01-16 16:30:03,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277934', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222158', 'lastCheck': '7.6', 'valid': True}} >Thread-286673::DEBUG::2014-01-16 16:30:03,357::task::1168::TaskManager.Task::(prepare) Task=`52c61ae5-cad8-4211-af1b-96abc32108cd`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277934', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222158', 'lastCheck': '7.6', 'valid': True}} >Thread-286673::DEBUG::2014-01-16 16:30:03,357::task::579::TaskManager.Task::(_updateState) Task=`52c61ae5-cad8-4211-af1b-96abc32108cd`::moving from state preparing -> state finished >Thread-286673::DEBUG::2014-01-16 16:30:03,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286673::DEBUG::2014-01-16 16:30:03,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286673::DEBUG::2014-01-16 16:30:03,357::task::974::TaskManager.Task::(_decref) Task=`52c61ae5-cad8-4211-af1b-96abc32108cd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:03,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:03,389::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:30:03,495::task::579::TaskManager.Task::(_updateState) Task=`08f4c97b-571e-426d-845a-868d61db068f`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:30:03,495::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:30:03,496::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:30:03,496::task::1168::TaskManager.Task::(prepare) Task=`08f4c97b-571e-426d-845a-868d61db068f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:30:03,496::task::579::TaskManager.Task::(_updateState) Task=`08f4c97b-571e-426d-845a-868d61db068f`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:30:03,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:30:03,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:30:03,496::task::974::TaskManager.Task::(_decref) Task=`08f4c97b-571e-426d-845a-868d61db068f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:03,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:30:03,974::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:30:04,784::task::579::TaskManager.Task::(_updateState) Task=`e7a64fbb-2eb9-4deb-8be3-9997a059edb7`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:30:04,784::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:30:04,785::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:30:04,785::task::1168::TaskManager.Task::(prepare) Task=`e7a64fbb-2eb9-4deb-8be3-9997a059edb7`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:30:04,785::task::579::TaskManager.Task::(_updateState) Task=`e7a64fbb-2eb9-4deb-8be3-9997a059edb7`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:30:04,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:30:04,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:30:04,786::task::974::TaskManager.Task::(_decref) Task=`e7a64fbb-2eb9-4deb-8be3-9997a059edb7`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:30:04,790::task::579::TaskManager.Task::(_updateState) Task=`2dbae0e4-d062-45a7-8105-1faf3df6fcd5`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:30:04,791::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:30:04,791::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:30:04,791::task::1168::TaskManager.Task::(prepare) Task=`2dbae0e4-d062-45a7-8105-1faf3df6fcd5`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:30:04,791::task::579::TaskManager.Task::(_updateState) Task=`2dbae0e4-d062-45a7-8105-1faf3df6fcd5`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:30:04,792::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:30:04,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:30:04,792::task::974::TaskManager.Task::(_decref) Task=`2dbae0e4-d062-45a7-8105-1faf3df6fcd5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:04,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:30:04,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:30:04,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:30:04,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:05,390::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:30:05,728::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:30:05,728::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:30:05,729::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:30:05,729::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:30:05,733::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:05,754::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000251425 s, 8.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:30:05,754::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000251425 s, 8.1 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:30:05,754::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:30:05,754::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:30:05,755::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:30:05,755::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:30:05,755::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:30:05,756::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:30:05,756::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:30:05,756::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:30:05,757::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:30:05,978::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:30:05,990::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:30:05,991::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:30:05,992::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:30:05,993::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:30:05,993::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:30:05,993::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:30:05,994::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-16399::DEBUG::2014-01-16 16:30:06,117::task::579::TaskManager.Task::(_updateState) Task=`d87a535c-83f2-4b65-b951-7be75e85172c`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:30:06,117::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:30:06,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:30:06,118::task::1168::TaskManager.Task::(prepare) Task=`d87a535c-83f2-4b65-b951-7be75e85172c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:30:06,119::task::579::TaskManager.Task::(_updateState) Task=`d87a535c-83f2-4b65-b951-7be75e85172c`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:30:06,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:30:06,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:30:06,119::task::974::TaskManager.Task::(_decref) Task=`d87a535c-83f2-4b65-b951-7be75e85172c`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:30:06,119::task::579::TaskManager.Task::(_updateState) Task=`5e5d146c-1df8-4f6c-ad47-478e1cbda969`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:30:06,120::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:30:06,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:30:06,120::task::1168::TaskManager.Task::(prepare) Task=`5e5d146c-1df8-4f6c-ad47-478e1cbda969`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:30:06,120::task::579::TaskManager.Task::(_updateState) Task=`5e5d146c-1df8-4f6c-ad47-478e1cbda969`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:30:06,120::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:30:06,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:30:06,121::task::974::TaskManager.Task::(_decref) Task=`5e5d146c-1df8-4f6c-ad47-478e1cbda969`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:30:06,162::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:30:06,165::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:06,182::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210421 s, 19.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:06,980::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:30:06,985::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:30:06,986::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:30:06,986::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:06,986::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:30:06,987::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-17110::DEBUG::2014-01-16 16:30:07,241::task::579::TaskManager.Task::(_updateState) Task=`202799ab-bedd-4810-afec-8daaca324327`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:30:07,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:30:07,242::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:30:07,242::task::1168::TaskManager.Task::(prepare) Task=`202799ab-bedd-4810-afec-8daaca324327`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:30:07,242::task::579::TaskManager.Task::(_updateState) Task=`202799ab-bedd-4810-afec-8daaca324327`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:30:07,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:30:07,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:30:07,243::task::974::TaskManager.Task::(_decref) Task=`202799ab-bedd-4810-afec-8daaca324327`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:30:07,243::task::579::TaskManager.Task::(_updateState) Task=`aa955fd4-8629-4adc-9758-7d79813bf8e1`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:30:07,243::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:30:07,243::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:30:07,243::task::1168::TaskManager.Task::(prepare) Task=`aa955fd4-8629-4adc-9758-7d79813bf8e1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:30:07,243::task::579::TaskManager.Task::(_updateState) Task=`aa955fd4-8629-4adc-9758-7d79813bf8e1`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:30:07,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:30:07,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:30:07,244::task::974::TaskManager.Task::(_decref) Task=`aa955fd4-8629-4adc-9758-7d79813bf8e1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:07,392::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:30:07,718::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:30:07,734::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286684 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:30:07,745::task::579::TaskManager.Task::(_updateState) Task=`e63451b8-03f9-4e82-bfd8-22adfdf47d48`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:30:07,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:30:07,747::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-26403::DEBUG::2014-01-16 16:30:07,747::task::579::TaskManager.Task::(_updateState) Task=`6827907c-c232-47a0-bc5b-1d37c66298f8`::moving from state init -> state preparing >Thread-17177::DEBUG::2014-01-16 16:30:07,748::task::1168::TaskManager.Task::(prepare) Task=`e63451b8-03f9-4e82-bfd8-22adfdf47d48`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-26403::INFO::2014-01-16 16:30:07,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-17177::DEBUG::2014-01-16 16:30:07,749::task::579::TaskManager.Task::(_updateState) Task=`e63451b8-03f9-4e82-bfd8-22adfdf47d48`::moving from state preparing -> state finished >Thread-26403::INFO::2014-01-16 16:30:07,750::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-17177::DEBUG::2014-01-16 16:30:07,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:30:07,751::task::1168::TaskManager.Task::(prepare) Task=`6827907c-c232-47a0-bc5b-1d37c66298f8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-17177::DEBUG::2014-01-16 16:30:07,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:30:07,752::task::579::TaskManager.Task::(_updateState) Task=`6827907c-c232-47a0-bc5b-1d37c66298f8`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:30:07,753::task::974::TaskManager.Task::(_decref) Task=`e63451b8-03f9-4e82-bfd8-22adfdf47d48`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:30:07,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:30:07,754::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:30:07,754::task::974::TaskManager.Task::(_decref) Task=`6827907c-c232-47a0-bc5b-1d37c66298f8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:07,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:08,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:30:08,913::task::579::TaskManager.Task::(_updateState) Task=`4edb076e-0aaa-4f79-b100-3aa8c5207a92`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:30:08,914::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:30:08,914::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:30:08,914::task::1168::TaskManager.Task::(prepare) Task=`4edb076e-0aaa-4f79-b100-3aa8c5207a92`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:30:08,914::task::579::TaskManager.Task::(_updateState) Task=`4edb076e-0aaa-4f79-b100-3aa8c5207a92`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:30:08,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:30:08,915::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:30:08,915::task::974::TaskManager.Task::(_decref) Task=`4edb076e-0aaa-4f79-b100-3aa8c5207a92`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:08,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:30:08,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:30:08,990::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:09,395::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:30:09,979::task::579::TaskManager.Task::(_updateState) Task=`541c4c38-25bc-4612-9ea1-c55eb7b87c20`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:30:09,980::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:30:09,980::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:30:09,980::task::1168::TaskManager.Task::(prepare) Task=`541c4c38-25bc-4612-9ea1-c55eb7b87c20`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:30:09,980::task::579::TaskManager.Task::(_updateState) Task=`541c4c38-25bc-4612-9ea1-c55eb7b87c20`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:30:09,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:30:09,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:30:09,981::task::974::TaskManager.Task::(_decref) Task=`541c4c38-25bc-4612-9ea1-c55eb7b87c20`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:09,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:30:09,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:30:09,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:10,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:30:10,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:30:10,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:30:10,994::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:11,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:11,995::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:12,996::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:30:12,997::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:30:13,040::task::579::TaskManager.Task::(_updateState) Task=`8caa7a5d-847f-4494-89e0-50f7c7595ded`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:30:13,040::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:30:13,040::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:30:13,041::task::1168::TaskManager.Task::(prepare) Task=`8caa7a5d-847f-4494-89e0-50f7c7595ded`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:30:13,041::task::579::TaskManager.Task::(_updateState) Task=`8caa7a5d-847f-4494-89e0-50f7c7595ded`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:30:13,041::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:30:13,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:30:13,041::task::974::TaskManager.Task::(_decref) Task=`8caa7a5d-847f-4494-89e0-50f7c7595ded`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:13,399::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:13,399::task::579::TaskManager.Task::(_updateState) Task=`bc907617-64dd-43b9-a4b1-7524194e7dca`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:30:13,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:30:13,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:30:13,400::task::1168::TaskManager.Task::(prepare) Task=`bc907617-64dd-43b9-a4b1-7524194e7dca`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:30:13,400::task::579::TaskManager.Task::(_updateState) Task=`bc907617-64dd-43b9-a4b1-7524194e7dca`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:30:13,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:30:13,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:30:13,401::task::974::TaskManager.Task::(_decref) Task=`bc907617-64dd-43b9-a4b1-7524194e7dca`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:13,402::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:30:13,403::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:30:13,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:13,407::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:13,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:13,998::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:14,999::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:15,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:16,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:30:16,048::task::579::TaskManager.Task::(_updateState) Task=`29bb317e-1911-4031-a3d9-1b5d49ed161a`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:30:16,049::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:30:16,050::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:30:16,050::task::1168::TaskManager.Task::(prepare) Task=`29bb317e-1911-4031-a3d9-1b5d49ed161a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:30:16,050::task::579::TaskManager.Task::(_updateState) Task=`29bb317e-1911-4031-a3d9-1b5d49ed161a`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:30:16,050::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:30:16,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:30:16,051::task::974::TaskManager.Task::(_decref) Task=`29bb317e-1911-4031-a3d9-1b5d49ed161a`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:30:16,188::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:16,207::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000233125 s, 17.6 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:30:16,421::task::579::TaskManager.Task::(_updateState) Task=`1275b878-3939-43b7-bc55-f6e29ec83d33`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:30:16,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:30:16,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:30:16,422::task::1168::TaskManager.Task::(prepare) Task=`1275b878-3939-43b7-bc55-f6e29ec83d33`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:30:16,422::task::579::TaskManager.Task::(_updateState) Task=`1275b878-3939-43b7-bc55-f6e29ec83d33`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:30:16,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:30:16,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:30:16,423::task::974::TaskManager.Task::(_decref) Task=`1275b878-3939-43b7-bc55-f6e29ec83d33`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:17,001::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:17,413::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:30:17,743::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:30:17,759::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000389014 s, 938 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:18,003::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:18,415::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:19,004::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:30:19,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:19,416::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286679::DEBUG::2014-01-16 16:30:19,694::task::579::TaskManager.Task::(_updateState) Task=`c70402dc-f9be-4087-9720-3a924748dc12`::moving from state init -> state preparing >Thread-286679::INFO::2014-01-16 16:30:19,695::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286679::INFO::2014-01-16 16:30:19,695::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000389014', 'lastCheck': '1.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233125', 'lastCheck': '3.5', 'valid': True}} >Thread-286679::DEBUG::2014-01-16 16:30:19,695::task::1168::TaskManager.Task::(prepare) Task=`c70402dc-f9be-4087-9720-3a924748dc12`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000389014', 'lastCheck': '1.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233125', 'lastCheck': '3.5', 'valid': True}} >Thread-286679::DEBUG::2014-01-16 16:30:19,695::task::579::TaskManager.Task::(_updateState) Task=`c70402dc-f9be-4087-9720-3a924748dc12`::moving from state preparing -> state finished >Thread-286679::DEBUG::2014-01-16 16:30:19,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286679::DEBUG::2014-01-16 16:30:19,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286679::DEBUG::2014-01-16 16:30:19,696::task::974::TaskManager.Task::(_decref) Task=`c70402dc-f9be-4087-9720-3a924748dc12`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:20,005::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:21,007::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:21,418::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:22,007::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:30:22,399::task::579::TaskManager.Task::(_updateState) Task=`2ceaf4ef-6f8c-493f-b920-739740f054e1`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:30:22,399::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:30:22,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:30:22,400::task::1168::TaskManager.Task::(prepare) Task=`2ceaf4ef-6f8c-493f-b920-739740f054e1`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:30:22,400::task::579::TaskManager.Task::(_updateState) Task=`2ceaf4ef-6f8c-493f-b920-739740f054e1`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:30:22,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:30:22,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:30:22,400::task::974::TaskManager.Task::(_decref) Task=`2ceaf4ef-6f8c-493f-b920-739740f054e1`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:30:22,401::task::579::TaskManager.Task::(_updateState) Task=`8f91f77f-ed36-4929-a32d-79ca5be65f5e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:30:22,401::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:30:22,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:30:22,401::task::1168::TaskManager.Task::(prepare) Task=`8f91f77f-ed36-4929-a32d-79ca5be65f5e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:30:22,401::task::579::TaskManager.Task::(_updateState) Task=`8f91f77f-ed36-4929-a32d-79ca5be65f5e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:30:22,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:30:22,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:30:22,402::task::974::TaskManager.Task::(_decref) Task=`8f91f77f-ed36-4929-a32d-79ca5be65f5e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:23,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:23,420::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:23,421::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:24,009::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:30:24,009::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:30:24,009::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:30:24,370::task::579::TaskManager.Task::(_updateState) Task=`8de3bb8e-190e-47de-b0ae-d2cc29df2edf`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:30:24,370::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:30:24,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:30:24,371::task::1168::TaskManager.Task::(prepare) Task=`8de3bb8e-190e-47de-b0ae-d2cc29df2edf`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:30:24,371::task::579::TaskManager.Task::(_updateState) Task=`8de3bb8e-190e-47de-b0ae-d2cc29df2edf`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:30:24,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:30:24,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:30:24,371::task::974::TaskManager.Task::(_decref) Task=`8de3bb8e-190e-47de-b0ae-d2cc29df2edf`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:30:24,565::task::579::TaskManager.Task::(_updateState) Task=`0fc4dfb7-fa71-4b2c-8c23-3648f003b466`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:30:24,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:30:24,566::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:30:24,566::task::1168::TaskManager.Task::(prepare) Task=`0fc4dfb7-fa71-4b2c-8c23-3648f003b466`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:30:24,566::task::579::TaskManager.Task::(_updateState) Task=`0fc4dfb7-fa71-4b2c-8c23-3648f003b466`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:30:24,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:30:24,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:30:24,566::task::974::TaskManager.Task::(_decref) Task=`0fc4dfb7-fa71-4b2c-8c23-3648f003b466`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:25,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:30:25,011::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:25,422::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:26,012::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:30:26,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:30:26,013::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:30:26,213::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:26,230::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000297222 s, 13.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:27,014::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:30:27,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:27,423::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:30:27,768::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:30:27,785::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000285546 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:28,016::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:30:28,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:30:28,093::task::579::TaskManager.Task::(_updateState) Task=`6ddf41f5-8d95-493b-9616-846899cd2b71`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:30:28,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-59295::DEBUG::2014-01-16 16:30:28,094::task::579::TaskManager.Task::(_updateState) Task=`863c3bb4-3885-4190-b1da-49afa13f0ce9`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:30:28,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-3175::INFO::2014-01-16 16:30:28,095::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:30:28,095::task::1168::TaskManager.Task::(prepare) Task=`6ddf41f5-8d95-493b-9616-846899cd2b71`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::INFO::2014-01-16 16:30:28,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 16:30:28,096::task::579::TaskManager.Task::(_updateState) Task=`6ddf41f5-8d95-493b-9616-846899cd2b71`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:30:28,096::task::1168::TaskManager.Task::(prepare) Task=`863c3bb4-3885-4190-b1da-49afa13f0ce9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 16:30:28,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:30:28,096::task::579::TaskManager.Task::(_updateState) Task=`863c3bb4-3885-4190-b1da-49afa13f0ce9`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:30:28,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:30:28,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:30:28,097::task::974::TaskManager.Task::(_decref) Task=`6ddf41f5-8d95-493b-9616-846899cd2b71`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:30:28,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:30:28,097::task::974::TaskManager.Task::(_decref) Task=`863c3bb4-3885-4190-b1da-49afa13f0ce9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:28,426::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:30:28,426::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:30:28,428::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:29,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:29,429::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:30,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:30:30,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:31,019::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:30:31,019::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:31,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:32,020::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:30:32,021::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:30:32,021::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:30:32,021::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:33,021::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:30:33,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:30:33,022::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:30:33,109::task::579::TaskManager.Task::(_updateState) Task=`355dd442-bb8d-4c13-b167-11435fd4b3cd`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:30:33,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:30:33,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:30:33,110::task::1168::TaskManager.Task::(prepare) Task=`355dd442-bb8d-4c13-b167-11435fd4b3cd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:30:33,110::task::579::TaskManager.Task::(_updateState) Task=`355dd442-bb8d-4c13-b167-11435fd4b3cd`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:30:33,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:30:33,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:30:33,111::task::974::TaskManager.Task::(_decref) Task=`355dd442-bb8d-4c13-b167-11435fd4b3cd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:33,431::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:33,432::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:34,023::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:30:34,023::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:35,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:30:35,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:30:35,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:30:35,025::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:35,433::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:30:35,687::task::579::TaskManager.Task::(_updateState) Task=`a8f24257-4b59-493b-9fe1-c8e17297009f`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:30:35,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:30:35,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:30:35,688::task::1168::TaskManager.Task::(prepare) Task=`a8f24257-4b59-493b-9fe1-c8e17297009f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:30:35,688::task::579::TaskManager.Task::(_updateState) Task=`a8f24257-4b59-493b-9fe1-c8e17297009f`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:30:35,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:30:35,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:30:35,689::task::974::TaskManager.Task::(_decref) Task=`a8f24257-4b59-493b-9fe1-c8e17297009f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:36,026::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286685::DEBUG::2014-01-16 16:30:36,099::task::579::TaskManager.Task::(_updateState) Task=`2536368d-fa7e-4f4f-a0e4-4ca05754c0db`::moving from state init -> state preparing >Thread-286685::INFO::2014-01-16 16:30:36,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286685::INFO::2014-01-16 16:30:36,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000285546', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297222', 'lastCheck': '9.9', 'valid': True}} >Thread-286685::DEBUG::2014-01-16 16:30:36,099::task::1168::TaskManager.Task::(prepare) Task=`2536368d-fa7e-4f4f-a0e4-4ca05754c0db`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000285546', 'lastCheck': '8.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297222', 'lastCheck': '9.9', 'valid': True}} >Thread-286685::DEBUG::2014-01-16 16:30:36,100::task::579::TaskManager.Task::(_updateState) Task=`2536368d-fa7e-4f4f-a0e4-4ca05754c0db`::moving from state preparing -> state finished >Thread-286685::DEBUG::2014-01-16 16:30:36,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286685::DEBUG::2014-01-16 16:30:36,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286685::DEBUG::2014-01-16 16:30:36,100::task::974::TaskManager.Task::(_decref) Task=`2536368d-fa7e-4f4f-a0e4-4ca05754c0db`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:30:36,240::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:36,272::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000313625 s, 13.1 MB/s\n'; <rc> = 0 >Thread-16393::DEBUG::2014-01-16 16:30:36,468::task::579::TaskManager.Task::(_updateState) Task=`8a2c8d84-5404-4551-80ff-d3215bf05dc1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:30:36,469::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:30:36,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:30:36,469::task::1168::TaskManager.Task::(prepare) Task=`8a2c8d84-5404-4551-80ff-d3215bf05dc1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:30:36,469::task::579::TaskManager.Task::(_updateState) Task=`8a2c8d84-5404-4551-80ff-d3215bf05dc1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:30:36,469::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:30:36,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:30:36,470::task::974::TaskManager.Task::(_decref) Task=`8a2c8d84-5404-4551-80ff-d3215bf05dc1`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:30:36,513::task::579::TaskManager.Task::(_updateState) Task=`54b4789c-d71c-470d-aa1b-9c06eb429b51`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:30:36,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:30:36,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:30:36,514::task::1168::TaskManager.Task::(prepare) Task=`54b4789c-d71c-470d-aa1b-9c06eb429b51`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:30:36,514::task::579::TaskManager.Task::(_updateState) Task=`54b4789c-d71c-470d-aa1b-9c06eb429b51`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:30:36,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:30:36,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:30:36,515::task::974::TaskManager.Task::(_decref) Task=`54b4789c-d71c-470d-aa1b-9c06eb429b51`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:30:36,596::task::579::TaskManager.Task::(_updateState) Task=`70a2249e-907d-448c-81fe-dfe9875dc5c4`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:30:36,596::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:30:36,596::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:30:36,596::task::1168::TaskManager.Task::(prepare) Task=`70a2249e-907d-448c-81fe-dfe9875dc5c4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:30:36,596::task::579::TaskManager.Task::(_updateState) Task=`70a2249e-907d-448c-81fe-dfe9875dc5c4`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:30:36,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:30:36,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:30:36,597::task::974::TaskManager.Task::(_decref) Task=`70a2249e-907d-448c-81fe-dfe9875dc5c4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:37,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:30:37,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:30:37,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:30:37,028::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:37,029::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:30:37,030::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-20952::DEBUG::2014-01-16 16:30:37,422::task::579::TaskManager.Task::(_updateState) Task=`c9fa3bd9-780e-41b6-af9e-c60a8c5a60a8`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:30:37,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:30:37,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:30:37,423::task::1168::TaskManager.Task::(prepare) Task=`c9fa3bd9-780e-41b6-af9e-c60a8c5a60a8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:30:37,423::task::579::TaskManager.Task::(_updateState) Task=`c9fa3bd9-780e-41b6-af9e-c60a8c5a60a8`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:30:37,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:30:37,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:30:37,423::task::974::TaskManager.Task::(_decref) Task=`c9fa3bd9-780e-41b6-af9e-c60a8c5a60a8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:37,435::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:30:37,715::task::579::TaskManager.Task::(_updateState) Task=`65996038-be34-4b26-b37b-0803e3701d5d`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:30:37,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:30:37,716::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:30:37,716::task::1168::TaskManager.Task::(prepare) Task=`65996038-be34-4b26-b37b-0803e3701d5d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:30:37,716::task::579::TaskManager.Task::(_updateState) Task=`65996038-be34-4b26-b37b-0803e3701d5d`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:30:37,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:30:37,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:30:37,716::task::974::TaskManager.Task::(_decref) Task=`65996038-be34-4b26-b37b-0803e3701d5d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:30:37,793::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:30:37,811::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289168 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:38,031::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:38,437::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:39,032::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:30:39,033::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:30:39,033::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:39,438::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:30:39,826::task::579::TaskManager.Task::(_updateState) Task=`4c3d2eac-94eb-4ff7-9efa-379eb23aac2c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:30:39,827::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:30:39,827::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:30:39,827::task::1168::TaskManager.Task::(prepare) Task=`4c3d2eac-94eb-4ff7-9efa-379eb23aac2c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:30:39,827::task::579::TaskManager.Task::(_updateState) Task=`4c3d2eac-94eb-4ff7-9efa-379eb23aac2c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:30:39,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:30:39,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:30:39,828::task::974::TaskManager.Task::(_decref) Task=`4c3d2eac-94eb-4ff7-9efa-379eb23aac2c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:30:39,828::task::579::TaskManager.Task::(_updateState) Task=`a27d9b0f-f0a8-4345-b165-2f28ad6922ec`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:30:39,828::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:30:39,829::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:30:39,829::task::1168::TaskManager.Task::(prepare) Task=`a27d9b0f-f0a8-4345-b165-2f28ad6922ec`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:30:39,829::task::579::TaskManager.Task::(_updateState) Task=`a27d9b0f-f0a8-4345-b165-2f28ad6922ec`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:30:39,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:30:39,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:30:39,829::task::974::TaskManager.Task::(_decref) Task=`a27d9b0f-f0a8-4345-b165-2f28ad6922ec`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:30:39,830::task::579::TaskManager.Task::(_updateState) Task=`da3bb9d1-57ed-4ab8-b100-22c1a25f9e1b`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:30:39,830::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:30:39,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:30:39,830::task::1168::TaskManager.Task::(prepare) Task=`da3bb9d1-57ed-4ab8-b100-22c1a25f9e1b`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:30:39,830::task::579::TaskManager.Task::(_updateState) Task=`da3bb9d1-57ed-4ab8-b100-22c1a25f9e1b`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:30:39,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:30:39,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:30:39,831::task::974::TaskManager.Task::(_decref) Task=`da3bb9d1-57ed-4ab8-b100-22c1a25f9e1b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:40,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:30:40,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:30:40,034::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:41,035::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:30:41,035::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:30:41,036::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:30:41,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:41,439::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:42,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:43,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:30:43,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:43,441::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:43,442::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:30:43,442::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:30:43,443::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:44,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:45,040::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:30:45,438::task::579::TaskManager.Task::(_updateState) Task=`5b6aec8a-f28f-4af2-ac32-904bf1b95cc0`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:30:45,439::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:30:45,439::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:30:45,439::task::1168::TaskManager.Task::(prepare) Task=`5b6aec8a-f28f-4af2-ac32-904bf1b95cc0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:30:45,439::task::579::TaskManager.Task::(_updateState) Task=`5b6aec8a-f28f-4af2-ac32-904bf1b95cc0`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:30:45,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:30:45,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:30:45,440::task::974::TaskManager.Task::(_decref) Task=`5b6aec8a-f28f-4af2-ac32-904bf1b95cc0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:45,445::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:46,041::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:30:46,288::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:46,305::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000256728 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:47,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:47,446::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:30:47,819::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:30:47,835::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000265463 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:48,044::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:48,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:49,045::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:30:49,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:49,449::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:30:49,726::task::579::TaskManager.Task::(_updateState) Task=`c58deb1d-32f3-4fb0-8673-c80beeb19816`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:30:49,726::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:30:49,727::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:30:49,727::task::1168::TaskManager.Task::(prepare) Task=`c58deb1d-32f3-4fb0-8673-c80beeb19816`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:30:49,727::task::579::TaskManager.Task::(_updateState) Task=`c58deb1d-32f3-4fb0-8673-c80beeb19816`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:30:49,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:30:49,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:30:49,728::task::974::TaskManager.Task::(_decref) Task=`c58deb1d-32f3-4fb0-8673-c80beeb19816`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:50,046::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:51,047::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:51,450::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:52,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286691::DEBUG::2014-01-16 16:30:52,149::task::579::TaskManager.Task::(_updateState) Task=`034f05c2-ad93-43a3-bc28-107f389bb843`::moving from state init -> state preparing >Thread-286691::INFO::2014-01-16 16:30:52,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286691::INFO::2014-01-16 16:30:52,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265463', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256728', 'lastCheck': '5.8', 'valid': True}} >Thread-286691::DEBUG::2014-01-16 16:30:52,150::task::1168::TaskManager.Task::(prepare) Task=`034f05c2-ad93-43a3-bc28-107f389bb843`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265463', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256728', 'lastCheck': '5.8', 'valid': True}} >Thread-286691::DEBUG::2014-01-16 16:30:52,150::task::579::TaskManager.Task::(_updateState) Task=`034f05c2-ad93-43a3-bc28-107f389bb843`::moving from state preparing -> state finished >Thread-286691::DEBUG::2014-01-16 16:30:52,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286691::DEBUG::2014-01-16 16:30:52,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286691::DEBUG::2014-01-16 16:30:52,151::task::974::TaskManager.Task::(_decref) Task=`034f05c2-ad93-43a3-bc28-107f389bb843`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:53,050::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:53,452::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:30:53,453::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:54,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:30:54,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:30:54,052::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:30:55,052::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:30:55,052::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:55,454::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:56,053::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:30:56,053::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:30:56,053::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:30:56,311::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:30:56,328::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235161 s, 17.4 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:30:56,560::task::579::TaskManager.Task::(_updateState) Task=`671fab75-63d8-40d2-bb1e-d4e1c1a008f9`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:30:56,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:30:56,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:30:56,561::task::1168::TaskManager.Task::(prepare) Task=`671fab75-63d8-40d2-bb1e-d4e1c1a008f9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:30:56,561::task::579::TaskManager.Task::(_updateState) Task=`671fab75-63d8-40d2-bb1e-d4e1c1a008f9`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:30:56,561::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:30:56,561::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:30:56,561::task::974::TaskManager.Task::(_decref) Task=`671fab75-63d8-40d2-bb1e-d4e1c1a008f9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:30:57,055::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:30:57,055::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:57,455::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:30:57,844::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:30:57,861::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000265931 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:30:58,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:30:58,056::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:30:58,169::task::579::TaskManager.Task::(_updateState) Task=`f7031ba9-20f5-4995-986d-eed75ce23570`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:30:58,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:30:58,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:30:58,170::task::1168::TaskManager.Task::(prepare) Task=`f7031ba9-20f5-4995-986d-eed75ce23570`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:30:58,170::task::579::TaskManager.Task::(_updateState) Task=`f7031ba9-20f5-4995-986d-eed75ce23570`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:30:58,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:30:58,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:30:58,170::task::974::TaskManager.Task::(_decref) Task=`f7031ba9-20f5-4995-986d-eed75ce23570`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:30:58,171::task::579::TaskManager.Task::(_updateState) Task=`9117908b-da7e-416b-8894-ed71d130e936`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:30:58,171::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:30:58,171::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:30:58,171::task::1168::TaskManager.Task::(prepare) Task=`9117908b-da7e-416b-8894-ed71d130e936`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:30:58,172::task::579::TaskManager.Task::(_updateState) Task=`9117908b-da7e-416b-8894-ed71d130e936`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:30:58,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:30:58,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:30:58,172::task::974::TaskManager.Task::(_decref) Task=`9117908b-da7e-416b-8894-ed71d130e936`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:30:58,172::task::579::TaskManager.Task::(_updateState) Task=`8cbcd18e-dc5f-4845-b535-1ddaca6eeb6b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:30:58,173::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:30:58,173::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:30:58,173::task::1168::TaskManager.Task::(prepare) Task=`8cbcd18e-dc5f-4845-b535-1ddaca6eeb6b`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:30:58,173::task::579::TaskManager.Task::(_updateState) Task=`8cbcd18e-dc5f-4845-b535-1ddaca6eeb6b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:30:58,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:30:58,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:30:58,174::task::974::TaskManager.Task::(_decref) Task=`8cbcd18e-dc5f-4845-b535-1ddaca6eeb6b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:30:58,458::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:30:58,458::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:30:58,459::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:30:59,057::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:30:59,461::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:00,058::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:31:00,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:01,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:31:01,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:31:01,349::task::579::TaskManager.Task::(_updateState) Task=`14cf1a63-67a7-4823-9f26-cc6fc648116b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:31:01,349::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:31:01,349::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:31:01,349::task::1168::TaskManager.Task::(prepare) Task=`14cf1a63-67a7-4823-9f26-cc6fc648116b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:31:01,350::task::579::TaskManager.Task::(_updateState) Task=`14cf1a63-67a7-4823-9f26-cc6fc648116b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:31:01,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:31:01,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:31:01,350::task::974::TaskManager.Task::(_decref) Task=`14cf1a63-67a7-4823-9f26-cc6fc648116b`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:31:01,350::task::579::TaskManager.Task::(_updateState) Task=`8b2088b4-3fea-41da-a9b3-d0881b242a40`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:31:01,350::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:31:01,351::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:31:01,351::task::1168::TaskManager.Task::(prepare) Task=`8b2088b4-3fea-41da-a9b3-d0881b242a40`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:31:01,351::task::579::TaskManager.Task::(_updateState) Task=`8b2088b4-3fea-41da-a9b3-d0881b242a40`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:31:01,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:31:01,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:31:01,351::task::974::TaskManager.Task::(_decref) Task=`8b2088b4-3fea-41da-a9b3-d0881b242a40`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:01,462::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:02,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:31:02,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:31:02,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:31:02,061::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:03,062::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:31:03,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:31:03,063::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:03,463::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:03,464::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:31:03,660::task::579::TaskManager.Task::(_updateState) Task=`1214052c-38f7-465c-a1cc-e8e606330356`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:31:03,660::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:31:03,660::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:31:03,660::task::1168::TaskManager.Task::(prepare) Task=`1214052c-38f7-465c-a1cc-e8e606330356`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:31:03,660::task::579::TaskManager.Task::(_updateState) Task=`1214052c-38f7-465c-a1cc-e8e606330356`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:31:03,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:31:03,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:31:03,661::task::974::TaskManager.Task::(_decref) Task=`1214052c-38f7-465c-a1cc-e8e606330356`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:04,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:31:04,064::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:31:04,859::task::579::TaskManager.Task::(_updateState) Task=`fd3d9385-dbc1-4b1d-b7d6-837c7993a337`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:31:04,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:31:04,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:31:04,861::task::1168::TaskManager.Task::(prepare) Task=`fd3d9385-dbc1-4b1d-b7d6-837c7993a337`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:31:04,861::task::579::TaskManager.Task::(_updateState) Task=`fd3d9385-dbc1-4b1d-b7d6-837c7993a337`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:31:04,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:31:04,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:31:04,862::task::974::TaskManager.Task::(_decref) Task=`fd3d9385-dbc1-4b1d-b7d6-837c7993a337`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:31:04,865::task::579::TaskManager.Task::(_updateState) Task=`24cb1141-c848-402a-a6af-9039270f6129`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:31:04,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:31:04,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:31:04,866::task::1168::TaskManager.Task::(prepare) Task=`24cb1141-c848-402a-a6af-9039270f6129`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:31:04,866::task::579::TaskManager.Task::(_updateState) Task=`24cb1141-c848-402a-a6af-9039270f6129`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:31:04,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:31:04,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:31:04,866::task::974::TaskManager.Task::(_decref) Task=`24cb1141-c848-402a-a6af-9039270f6129`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:05,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:31:05,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:31:05,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:31:05,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:05,465::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:06,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:31:06,239::task::579::TaskManager.Task::(_updateState) Task=`ef4497f6-fa37-412b-852c-ff7d684dabf4`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:31:06,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:31:06,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:31:06,240::task::1168::TaskManager.Task::(prepare) Task=`ef4497f6-fa37-412b-852c-ff7d684dabf4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:31:06,240::task::579::TaskManager.Task::(_updateState) Task=`ef4497f6-fa37-412b-852c-ff7d684dabf4`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:31:06,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:31:06,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:31:06,240::task::974::TaskManager.Task::(_decref) Task=`ef4497f6-fa37-412b-852c-ff7d684dabf4`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:31:06,241::task::579::TaskManager.Task::(_updateState) Task=`6b457904-1941-4788-b88b-72e3f6168516`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:31:06,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:31:06,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:31:06,241::task::1168::TaskManager.Task::(prepare) Task=`6b457904-1941-4788-b88b-72e3f6168516`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:31:06,242::task::579::TaskManager.Task::(_updateState) Task=`6b457904-1941-4788-b88b-72e3f6168516`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:31:06,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:31:06,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:31:06,242::task::974::TaskManager.Task::(_decref) Task=`6b457904-1941-4788-b88b-72e3f6168516`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:31:06,333::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:31:06,350::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000325692 s, 12.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:07,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:31:07,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:31:07,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:31:07,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:07,069::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:31:07,069::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-17110::DEBUG::2014-01-16 16:31:07,448::task::579::TaskManager.Task::(_updateState) Task=`f079f019-73e1-4b13-8c31-8d15ae8070b9`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:31:07,449::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:31:07,449::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:31:07,449::task::1168::TaskManager.Task::(prepare) Task=`f079f019-73e1-4b13-8c31-8d15ae8070b9`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:31:07,449::task::579::TaskManager.Task::(_updateState) Task=`f079f019-73e1-4b13-8c31-8d15ae8070b9`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:31:07,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:31:07,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:31:07,450::task::974::TaskManager.Task::(_decref) Task=`f079f019-73e1-4b13-8c31-8d15ae8070b9`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:31:07,450::task::579::TaskManager.Task::(_updateState) Task=`a20bb641-2898-4de0-9fa4-529f437b373f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:31:07,450::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:31:07,451::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:31:07,451::task::1168::TaskManager.Task::(prepare) Task=`a20bb641-2898-4de0-9fa4-529f437b373f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:31:07,451::task::579::TaskManager.Task::(_updateState) Task=`a20bb641-2898-4de0-9fa4-529f437b373f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:31:07,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:31:07,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:31:07,451::task::974::TaskManager.Task::(_decref) Task=`a20bb641-2898-4de0-9fa4-529f437b373f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:07,468::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:31:07,863::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:31:07,867::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:31:07,868::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:31:07,873::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:31:07,874::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:31:07,874::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:31:07,875::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:31:07,879::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:31:07,895::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000303115 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:31:07,902::task::579::TaskManager.Task::(_updateState) Task=`b759222f-d6c0-4654-8b47-f903e34c1bca`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:31:07,903::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:31:07,903::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:31:07,903::task::1168::TaskManager.Task::(prepare) Task=`b759222f-d6c0-4654-8b47-f903e34c1bca`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:31:07,903::task::579::TaskManager.Task::(_updateState) Task=`b759222f-d6c0-4654-8b47-f903e34c1bca`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:31:07,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:31:07,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:31:07,904::task::974::TaskManager.Task::(_decref) Task=`b759222f-d6c0-4654-8b47-f903e34c1bca`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:31:07,918::task::579::TaskManager.Task::(_updateState) Task=`1a4a1216-e8b7-4276-b55c-9f8a88fa9362`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:31:07,918::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:31:07,919::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:31:07,919::task::1168::TaskManager.Task::(prepare) Task=`1a4a1216-e8b7-4276-b55c-9f8a88fa9362`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:31:07,919::task::579::TaskManager.Task::(_updateState) Task=`1a4a1216-e8b7-4276-b55c-9f8a88fa9362`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:31:07,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:31:07,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:31:07,919::task::974::TaskManager.Task::(_decref) Task=`1a4a1216-e8b7-4276-b55c-9f8a88fa9362`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:08,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286698::DEBUG::2014-01-16 16:31:08,271::task::579::TaskManager.Task::(_updateState) Task=`1c5de748-848c-4d2c-bff7-1cd295852a73`::moving from state init -> state preparing >Thread-286698::INFO::2014-01-16 16:31:08,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286698::INFO::2014-01-16 16:31:08,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303115', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325692', 'lastCheck': '1.9', 'valid': True}} >Thread-286698::DEBUG::2014-01-16 16:31:08,272::task::1168::TaskManager.Task::(prepare) Task=`1c5de748-848c-4d2c-bff7-1cd295852a73`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303115', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325692', 'lastCheck': '1.9', 'valid': True}} >Thread-286698::DEBUG::2014-01-16 16:31:08,272::task::579::TaskManager.Task::(_updateState) Task=`1c5de748-848c-4d2c-bff7-1cd295852a73`::moving from state preparing -> state finished >Thread-286698::DEBUG::2014-01-16 16:31:08,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286698::DEBUG::2014-01-16 16:31:08,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286698::DEBUG::2014-01-16 16:31:08,273::task::974::TaskManager.Task::(_decref) Task=`1c5de748-848c-4d2c-bff7-1cd295852a73`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:08,469::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:09,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:31:09,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:31:09,072::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:31:09,075::task::579::TaskManager.Task::(_updateState) Task=`e471e905-ae57-44e6-ac75-7c9ae2d93791`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:31:09,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:31:09,076::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:31:09,076::task::1168::TaskManager.Task::(prepare) Task=`e471e905-ae57-44e6-ac75-7c9ae2d93791`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:31:09,076::task::579::TaskManager.Task::(_updateState) Task=`e471e905-ae57-44e6-ac75-7c9ae2d93791`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:31:09,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:31:09,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:31:09,077::task::974::TaskManager.Task::(_decref) Task=`e471e905-ae57-44e6-ac75-7c9ae2d93791`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:09,471::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:10,072::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:31:10,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:31:10,073::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:31:10,135::task::579::TaskManager.Task::(_updateState) Task=`61571562-eed3-4c60-afd3-44f969240604`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:31:10,135::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:31:10,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:31:10,136::task::1168::TaskManager.Task::(prepare) Task=`61571562-eed3-4c60-afd3-44f969240604`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:31:10,136::task::579::TaskManager.Task::(_updateState) Task=`61571562-eed3-4c60-afd3-44f969240604`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:31:10,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:31:10,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:31:10,136::task::974::TaskManager.Task::(_decref) Task=`61571562-eed3-4c60-afd3-44f969240604`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:11,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:31:11,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:31:11,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:31:11,075::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:11,472::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:12,076::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:13,077::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:31:13,078::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:31:13,205::task::579::TaskManager.Task::(_updateState) Task=`fc6d0bf9-3ede-4830-8f88-2c3c9bec5a11`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:31:13,205::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:31:13,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:31:13,206::task::1168::TaskManager.Task::(prepare) Task=`fc6d0bf9-3ede-4830-8f88-2c3c9bec5a11`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:31:13,206::task::579::TaskManager.Task::(_updateState) Task=`fc6d0bf9-3ede-4830-8f88-2c3c9bec5a11`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:31:13,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:31:13,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:31:13,206::task::974::TaskManager.Task::(_decref) Task=`fc6d0bf9-3ede-4830-8f88-2c3c9bec5a11`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:13,474::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:13,474::task::579::TaskManager.Task::(_updateState) Task=`27998a34-982e-4a74-bd80-9d678e584459`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:31:13,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:31:13,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:31:13,475::task::1168::TaskManager.Task::(prepare) Task=`27998a34-982e-4a74-bd80-9d678e584459`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:31:13,475::task::579::TaskManager.Task::(_updateState) Task=`27998a34-982e-4a74-bd80-9d678e584459`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:31:13,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:31:13,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:31:13,475::task::974::TaskManager.Task::(_decref) Task=`27998a34-982e-4a74-bd80-9d678e584459`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:13,477::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:31:13,477::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:31:13,479::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:13,481::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:13,482::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:14,079::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:15,080::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:15,483::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:16,081::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:31:16,133::task::579::TaskManager.Task::(_updateState) Task=`152a8f2a-1466-4270-8042-786a5ab91362`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:31:16,133::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:31:16,134::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:31:16,134::task::1168::TaskManager.Task::(prepare) Task=`152a8f2a-1466-4270-8042-786a5ab91362`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:31:16,134::task::579::TaskManager.Task::(_updateState) Task=`152a8f2a-1466-4270-8042-786a5ab91362`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:31:16,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:31:16,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:31:16,135::task::974::TaskManager.Task::(_decref) Task=`152a8f2a-1466-4270-8042-786a5ab91362`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:31:16,355::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:31:16,373::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000289243 s, 14.2 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:31:16,598::task::579::TaskManager.Task::(_updateState) Task=`a92a2482-f35e-4f5b-a6cd-0a508bfdf19b`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:31:16,598::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:31:16,598::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:31:16,599::task::1168::TaskManager.Task::(prepare) Task=`a92a2482-f35e-4f5b-a6cd-0a508bfdf19b`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:31:16,599::task::579::TaskManager.Task::(_updateState) Task=`a92a2482-f35e-4f5b-a6cd-0a508bfdf19b`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:31:16,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:31:16,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:31:16,599::task::974::TaskManager.Task::(_decref) Task=`a92a2482-f35e-4f5b-a6cd-0a508bfdf19b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:17,083::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:17,485::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:31:17,905::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:31:17,922::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000319913 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:18,083::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:18,486::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:19,084::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:31:19,085::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:19,488::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:20,085::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:21,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:21,489::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:22,088::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:31:22,770::task::579::TaskManager.Task::(_updateState) Task=`5067d970-de0b-4093-ac78-a47276ca141c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:31:22,770::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:31:22,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:31:22,771::task::1168::TaskManager.Task::(prepare) Task=`5067d970-de0b-4093-ac78-a47276ca141c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:31:22,771::task::579::TaskManager.Task::(_updateState) Task=`5067d970-de0b-4093-ac78-a47276ca141c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:31:22,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:31:22,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:31:22,771::task::974::TaskManager.Task::(_decref) Task=`5067d970-de0b-4093-ac78-a47276ca141c`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:31:22,772::task::579::TaskManager.Task::(_updateState) Task=`8a217970-d3df-4b9c-8d18-5996808e79d4`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:31:22,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:31:22,772::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:31:22,772::task::1168::TaskManager.Task::(prepare) Task=`8a217970-d3df-4b9c-8d18-5996808e79d4`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:31:22,772::task::579::TaskManager.Task::(_updateState) Task=`8a217970-d3df-4b9c-8d18-5996808e79d4`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:31:22,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:31:22,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:31:22,773::task::974::TaskManager.Task::(_decref) Task=`8a217970-d3df-4b9c-8d18-5996808e79d4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:23,089::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:23,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:23,492::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:24,096::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:31:24,096::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:31:24,096::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286704::DEBUG::2014-01-16 16:31:24,226::task::579::TaskManager.Task::(_updateState) Task=`23ea04c6-98b8-4b5d-a957-03024c9326f9`::moving from state init -> state preparing >Thread-286704::INFO::2014-01-16 16:31:24,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286704::INFO::2014-01-16 16:31:24,227::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319913', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289243', 'lastCheck': '7.9', 'valid': True}} >Thread-286704::DEBUG::2014-01-16 16:31:24,227::task::1168::TaskManager.Task::(prepare) Task=`23ea04c6-98b8-4b5d-a957-03024c9326f9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319913', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289243', 'lastCheck': '7.9', 'valid': True}} >Thread-286704::DEBUG::2014-01-16 16:31:24,227::task::579::TaskManager.Task::(_updateState) Task=`23ea04c6-98b8-4b5d-a957-03024c9326f9`::moving from state preparing -> state finished >Thread-286704::DEBUG::2014-01-16 16:31:24,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286704::DEBUG::2014-01-16 16:31:24,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286704::DEBUG::2014-01-16 16:31:24,228::task::974::TaskManager.Task::(_decref) Task=`23ea04c6-98b8-4b5d-a957-03024c9326f9`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:31:24,438::task::579::TaskManager.Task::(_updateState) Task=`ed931df9-060e-4729-a5c5-99d85ef9a01d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:31:24,438::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:31:24,438::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:31:24,439::task::1168::TaskManager.Task::(prepare) Task=`ed931df9-060e-4729-a5c5-99d85ef9a01d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:31:24,439::task::579::TaskManager.Task::(_updateState) Task=`ed931df9-060e-4729-a5c5-99d85ef9a01d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:31:24,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:31:24,439::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:31:24,439::task::974::TaskManager.Task::(_decref) Task=`ed931df9-060e-4729-a5c5-99d85ef9a01d`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:31:24,737::task::579::TaskManager.Task::(_updateState) Task=`58f9a177-5291-476a-a901-66aa64276207`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:31:24,737::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:31:24,737::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:31:24,737::task::1168::TaskManager.Task::(prepare) Task=`58f9a177-5291-476a-a901-66aa64276207`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:31:24,738::task::579::TaskManager.Task::(_updateState) Task=`58f9a177-5291-476a-a901-66aa64276207`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:31:24,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:31:24,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:31:24,738::task::974::TaskManager.Task::(_decref) Task=`58f9a177-5291-476a-a901-66aa64276207`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:25,097::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:31:25,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:25,494::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:26,098::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:31:26,098::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:31:26,099::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:31:26,380::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:31:26,396::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000281415 s, 14.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:27,100::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:31:27,101::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:27,496::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:31:27,931::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:31:27,947::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000331339 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:28,101::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:31:28,101::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:31:28,299::task::579::TaskManager.Task::(_updateState) Task=`24db1f64-068e-478f-81f7-4820e9b4fee7`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:31:28,300::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:31:28,300::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:31:28,301::task::1168::TaskManager.Task::(prepare) Task=`24db1f64-068e-478f-81f7-4820e9b4fee7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::DEBUG::2014-01-16 16:31:28,301::task::579::TaskManager.Task::(_updateState) Task=`bd56f2ab-9d09-4ef3-8d4b-f5946b958bba`::moving from state init -> state preparing >Thread-3175::DEBUG::2014-01-16 16:31:28,302::task::579::TaskManager.Task::(_updateState) Task=`24db1f64-068e-478f-81f7-4820e9b4fee7`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:31:28,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::INFO::2014-01-16 16:31:28,303::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-3175::DEBUG::2014-01-16 16:31:28,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::INFO::2014-01-16 16:31:28,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 16:31:28,305::task::974::TaskManager.Task::(_decref) Task=`24db1f64-068e-478f-81f7-4820e9b4fee7`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:31:28,305::task::1168::TaskManager.Task::(prepare) Task=`bd56f2ab-9d09-4ef3-8d4b-f5946b958bba`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:31:28,306::task::579::TaskManager.Task::(_updateState) Task=`bd56f2ab-9d09-4ef3-8d4b-f5946b958bba`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:31:28,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:31:28,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:31:28,306::task::974::TaskManager.Task::(_decref) Task=`bd56f2ab-9d09-4ef3-8d4b-f5946b958bba`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:28,499::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:31:28,499::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:31:28,507::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:29,103::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:29,508::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:30,104::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:31:30,104::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:31,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:31:31,106::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:31,510::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:32,107::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:31:32,107::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:31:32,107::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:31:32,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:33,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:31:33,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:31:33,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:31:33,293::task::579::TaskManager.Task::(_updateState) Task=`be96fc36-08ba-4f7f-ad21-21ed39a2f4ca`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:31:33,293::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:31:33,294::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:31:33,294::task::1168::TaskManager.Task::(prepare) Task=`be96fc36-08ba-4f7f-ad21-21ed39a2f4ca`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:31:33,294::task::579::TaskManager.Task::(_updateState) Task=`be96fc36-08ba-4f7f-ad21-21ed39a2f4ca`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:31:33,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:31:33,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:31:33,294::task::974::TaskManager.Task::(_decref) Task=`be96fc36-08ba-4f7f-ad21-21ed39a2f4ca`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:31:33,511::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:33,513::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:34,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:31:34,110::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:35,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:31:35,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:31:35,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:31:35,112::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:35,514::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:31:35,847::task::579::TaskManager.Task::(_updateState) Task=`e937715a-d0b0-44d5-bc3d-4e85a1cf4e70`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:31:35,847::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:31:35,848::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:31:35,848::task::1168::TaskManager.Task::(prepare) Task=`e937715a-d0b0-44d5-bc3d-4e85a1cf4e70`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:31:35,848::task::579::TaskManager.Task::(_updateState) Task=`e937715a-d0b0-44d5-bc3d-4e85a1cf4e70`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:31:35,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:31:35,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:31:35,848::task::974::TaskManager.Task::(_decref) Task=`e937715a-d0b0-44d5-bc3d-4e85a1cf4e70`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:36,113::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:31:36,403::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:31:36,420::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000274618 s, 14.9 MB/s\n'; <rc> = 0 >Thread-16393::DEBUG::2014-01-16 16:31:36,633::task::579::TaskManager.Task::(_updateState) Task=`827c2c84-78b5-4dc1-97ce-e4f78faa0a0c`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:31:36,634::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:31:36,634::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:31:36,635::task::1168::TaskManager.Task::(prepare) Task=`827c2c84-78b5-4dc1-97ce-e4f78faa0a0c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:31:36,635::task::579::TaskManager.Task::(_updateState) Task=`827c2c84-78b5-4dc1-97ce-e4f78faa0a0c`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:31:36,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:31:36,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:31:36,636::task::974::TaskManager.Task::(_decref) Task=`827c2c84-78b5-4dc1-97ce-e4f78faa0a0c`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:31:36,683::task::579::TaskManager.Task::(_updateState) Task=`c6fd2f1f-1021-4158-b642-4a94621548bf`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:31:36,683::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:31:36,683::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:31:36,683::task::1168::TaskManager.Task::(prepare) Task=`c6fd2f1f-1021-4158-b642-4a94621548bf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:31:36,684::task::579::TaskManager.Task::(_updateState) Task=`c6fd2f1f-1021-4158-b642-4a94621548bf`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:31:36,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:31:36,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:31:36,684::task::974::TaskManager.Task::(_decref) Task=`c6fd2f1f-1021-4158-b642-4a94621548bf`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:31:36,768::task::579::TaskManager.Task::(_updateState) Task=`76601611-2a9d-43cd-8c62-1d8c55195242`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:31:36,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:31:36,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:31:36,769::task::1168::TaskManager.Task::(prepare) Task=`76601611-2a9d-43cd-8c62-1d8c55195242`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:31:36,769::task::579::TaskManager.Task::(_updateState) Task=`76601611-2a9d-43cd-8c62-1d8c55195242`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:31:36,770::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:31:36,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:31:36,770::task::974::TaskManager.Task::(_decref) Task=`76601611-2a9d-43cd-8c62-1d8c55195242`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:37,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:31:37,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:31:37,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:31:37,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:37,116::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:31:37,117::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:31:37,516::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:31:37,597::task::579::TaskManager.Task::(_updateState) Task=`dd86b18d-4dab-49b6-8ec1-721f7d308c08`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:31:37,598::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:31:37,598::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:31:37,598::task::1168::TaskManager.Task::(prepare) Task=`dd86b18d-4dab-49b6-8ec1-721f7d308c08`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:31:37,599::task::579::TaskManager.Task::(_updateState) Task=`dd86b18d-4dab-49b6-8ec1-721f7d308c08`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:31:37,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:31:37,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:31:37,599::task::974::TaskManager.Task::(_decref) Task=`dd86b18d-4dab-49b6-8ec1-721f7d308c08`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:31:37,886::task::579::TaskManager.Task::(_updateState) Task=`ccdfc820-e60a-4eda-a7a9-9c4e6fd069bd`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:31:37,886::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:31:37,887::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:31:37,887::task::1168::TaskManager.Task::(prepare) Task=`ccdfc820-e60a-4eda-a7a9-9c4e6fd069bd`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:31:37,887::task::579::TaskManager.Task::(_updateState) Task=`ccdfc820-e60a-4eda-a7a9-9c4e6fd069bd`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:31:37,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:31:37,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:31:37,888::task::974::TaskManager.Task::(_decref) Task=`ccdfc820-e60a-4eda-a7a9-9c4e6fd069bd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:31:37,954::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:31:37,971::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000304566 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:38,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:38,518::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:39,119::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:31:39,119::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:31:39,119::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:39,520::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286710::DEBUG::2014-01-16 16:31:40,066::task::579::TaskManager.Task::(_updateState) Task=`06af2638-49c8-44af-aeae-917de690526d`::moving from state init -> state preparing >Thread-286710::INFO::2014-01-16 16:31:40,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286710::INFO::2014-01-16 16:31:40,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304566', 'lastCheck': '2.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274618', 'lastCheck': '3.6', 'valid': True}} >Thread-286710::DEBUG::2014-01-16 16:31:40,068::task::1168::TaskManager.Task::(prepare) Task=`06af2638-49c8-44af-aeae-917de690526d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000304566', 'lastCheck': '2.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274618', 'lastCheck': '3.6', 'valid': True}} >Thread-286710::DEBUG::2014-01-16 16:31:40,068::task::579::TaskManager.Task::(_updateState) Task=`06af2638-49c8-44af-aeae-917de690526d`::moving from state preparing -> state finished >Thread-286710::DEBUG::2014-01-16 16:31:40,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286710::DEBUG::2014-01-16 16:31:40,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286710::DEBUG::2014-01-16 16:31:40,068::task::974::TaskManager.Task::(_decref) Task=`06af2638-49c8-44af-aeae-917de690526d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:31:40,094::task::579::TaskManager.Task::(_updateState) Task=`68a43a57-e1db-4772-93c0-4adb4099f1de`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:31:40,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:31:40,095::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:31:40,095::task::1168::TaskManager.Task::(prepare) Task=`68a43a57-e1db-4772-93c0-4adb4099f1de`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:31:40,095::task::579::TaskManager.Task::(_updateState) Task=`68a43a57-e1db-4772-93c0-4adb4099f1de`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:31:40,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:31:40,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:31:40,095::task::974::TaskManager.Task::(_decref) Task=`68a43a57-e1db-4772-93c0-4adb4099f1de`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:31:40,096::task::579::TaskManager.Task::(_updateState) Task=`d39b495d-6a63-4899-8561-be43e8976ca7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:31:40,096::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:31:40,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:31:40,096::task::1168::TaskManager.Task::(prepare) Task=`d39b495d-6a63-4899-8561-be43e8976ca7`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:31:40,096::task::579::TaskManager.Task::(_updateState) Task=`d39b495d-6a63-4899-8561-be43e8976ca7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:31:40,097::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:31:40,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:31:40,097::task::974::TaskManager.Task::(_decref) Task=`d39b495d-6a63-4899-8561-be43e8976ca7`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:31:40,097::task::579::TaskManager.Task::(_updateState) Task=`f1b2c033-988b-4ca1-b5c7-3de9447cf8c0`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:31:40,097::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:31:40,098::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:31:40,098::task::1168::TaskManager.Task::(prepare) Task=`f1b2c033-988b-4ca1-b5c7-3de9447cf8c0`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:31:40,098::task::579::TaskManager.Task::(_updateState) Task=`f1b2c033-988b-4ca1-b5c7-3de9447cf8c0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:31:40,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:31:40,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:31:40,098::task::974::TaskManager.Task::(_decref) Task=`f1b2c033-988b-4ca1-b5c7-3de9447cf8c0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:40,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:31:40,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:31:40,121::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:41,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:31:41,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:31:41,122::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:31:41,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:41,522::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:42,123::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:43,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:31:43,124::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:43,523::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:43,526::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:31:43,526::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:31:43,528::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:44,125::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:45,127::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:45,529::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:31:45,618::task::579::TaskManager.Task::(_updateState) Task=`4f20ce62-2e45-41a7-8fbf-4f99afa5e212`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:31:45,618::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:31:45,619::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:31:45,619::task::1168::TaskManager.Task::(prepare) Task=`4f20ce62-2e45-41a7-8fbf-4f99afa5e212`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:31:45,619::task::579::TaskManager.Task::(_updateState) Task=`4f20ce62-2e45-41a7-8fbf-4f99afa5e212`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:31:45,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:31:45,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:31:45,619::task::974::TaskManager.Task::(_decref) Task=`4f20ce62-2e45-41a7-8fbf-4f99afa5e212`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:46,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:31:46,425::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:31:46,442::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000342789 s, 11.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:47,130::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:47,531::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:31:47,979::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:31:47,995::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289137 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:48,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:48,533::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:49,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:31:49,133::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:49,534::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:31:49,925::task::579::TaskManager.Task::(_updateState) Task=`ddc03564-199c-4e3b-8c42-0da25580a1dc`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:31:49,926::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:31:49,926::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:31:49,926::task::1168::TaskManager.Task::(prepare) Task=`ddc03564-199c-4e3b-8c42-0da25580a1dc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:31:49,927::task::579::TaskManager.Task::(_updateState) Task=`ddc03564-199c-4e3b-8c42-0da25580a1dc`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:31:49,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:31:49,927::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:31:49,927::task::974::TaskManager.Task::(_decref) Task=`ddc03564-199c-4e3b-8c42-0da25580a1dc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:50,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:51,135::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:51,536::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:52,136::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:53,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:53,538::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:31:53,539::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:31:54,139::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:31:54,139::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:31:54,139::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:31:55,140::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:31:55,141::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:55,540::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286716::DEBUG::2014-01-16 16:31:55,877::task::579::TaskManager.Task::(_updateState) Task=`2e487f18-dbb7-4aac-a786-80ffb842abcd`::moving from state init -> state preparing >Thread-286716::INFO::2014-01-16 16:31:55,878::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286716::INFO::2014-01-16 16:31:55,878::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289137', 'lastCheck': '7.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342789', 'lastCheck': '9.4', 'valid': True}} >Thread-286716::DEBUG::2014-01-16 16:31:55,878::task::1168::TaskManager.Task::(prepare) Task=`2e487f18-dbb7-4aac-a786-80ffb842abcd`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289137', 'lastCheck': '7.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342789', 'lastCheck': '9.4', 'valid': True}} >Thread-286716::DEBUG::2014-01-16 16:31:55,878::task::579::TaskManager.Task::(_updateState) Task=`2e487f18-dbb7-4aac-a786-80ffb842abcd`::moving from state preparing -> state finished >Thread-286716::DEBUG::2014-01-16 16:31:55,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286716::DEBUG::2014-01-16 16:31:55,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286716::DEBUG::2014-01-16 16:31:55,879::task::974::TaskManager.Task::(_decref) Task=`2e487f18-dbb7-4aac-a786-80ffb842abcd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:56,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:31:56,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:31:56,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:31:56,448::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:31:56,465::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000275469 s, 14.9 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:31:56,749::task::579::TaskManager.Task::(_updateState) Task=`8b8e1568-275f-42cf-9d87-ca22861b3a5f`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:31:56,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:31:56,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:31:56,751::task::1168::TaskManager.Task::(prepare) Task=`8b8e1568-275f-42cf-9d87-ca22861b3a5f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:31:56,751::task::579::TaskManager.Task::(_updateState) Task=`8b8e1568-275f-42cf-9d87-ca22861b3a5f`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:31:56,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:31:56,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:31:56,751::task::974::TaskManager.Task::(_decref) Task=`8b8e1568-275f-42cf-9d87-ca22861b3a5f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:57,143::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:31:57,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:57,542::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:31:58,003::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:31:58,021::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000241526 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:31:58,145::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:31:58,145::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:58,544::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:31:58,545::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:31:58,547::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:31:58,765::task::579::TaskManager.Task::(_updateState) Task=`80a92cd3-35fe-4535-862a-be16db9db5b4`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:31:58,765::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:31:58,765::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:31:58,765::task::1168::TaskManager.Task::(prepare) Task=`80a92cd3-35fe-4535-862a-be16db9db5b4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:31:58,766::task::579::TaskManager.Task::(_updateState) Task=`80a92cd3-35fe-4535-862a-be16db9db5b4`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:31:58,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:31:58,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:31:58,766::task::974::TaskManager.Task::(_decref) Task=`80a92cd3-35fe-4535-862a-be16db9db5b4`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:31:58,766::task::579::TaskManager.Task::(_updateState) Task=`4949510c-f592-4349-ad02-f3dfb52778b7`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:31:58,767::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:31:58,767::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:31:58,768::task::1168::TaskManager.Task::(prepare) Task=`4949510c-f592-4349-ad02-f3dfb52778b7`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:31:58,768::task::579::TaskManager.Task::(_updateState) Task=`4949510c-f592-4349-ad02-f3dfb52778b7`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:31:58,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:31:58,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:31:58,768::task::974::TaskManager.Task::(_decref) Task=`4949510c-f592-4349-ad02-f3dfb52778b7`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:31:58,768::task::579::TaskManager.Task::(_updateState) Task=`5d4e885a-6b0d-4bc2-aea5-8777ab1a2c9d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:31:58,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:31:58,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:31:58,769::task::1168::TaskManager.Task::(prepare) Task=`5d4e885a-6b0d-4bc2-aea5-8777ab1a2c9d`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:31:58,769::task::579::TaskManager.Task::(_updateState) Task=`5d4e885a-6b0d-4bc2-aea5-8777ab1a2c9d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:31:58,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:31:58,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:31:58,770::task::974::TaskManager.Task::(_decref) Task=`5d4e885a-6b0d-4bc2-aea5-8777ab1a2c9d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:31:59,146::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:31:59,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:00,147::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:32:00,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:01,148::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:32:01,149::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:01,550::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:32:01,580::task::579::TaskManager.Task::(_updateState) Task=`6ab519ed-ca72-40c5-a8c3-980c292f4419`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:32:01,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:32:01,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:32:01,581::task::1168::TaskManager.Task::(prepare) Task=`6ab519ed-ca72-40c5-a8c3-980c292f4419`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:32:01,581::task::579::TaskManager.Task::(_updateState) Task=`6ab519ed-ca72-40c5-a8c3-980c292f4419`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:32:01,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:32:01,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:32:01,581::task::974::TaskManager.Task::(_decref) Task=`6ab519ed-ca72-40c5-a8c3-980c292f4419`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:32:01,582::task::579::TaskManager.Task::(_updateState) Task=`d9943bbf-7368-4748-b911-aa7bfdd04b23`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:32:01,582::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:32:01,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:32:01,582::task::1168::TaskManager.Task::(prepare) Task=`d9943bbf-7368-4748-b911-aa7bfdd04b23`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:32:01,582::task::579::TaskManager.Task::(_updateState) Task=`d9943bbf-7368-4748-b911-aa7bfdd04b23`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:32:01,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:32:01,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:32:01,583::task::974::TaskManager.Task::(_decref) Task=`d9943bbf-7368-4748-b911-aa7bfdd04b23`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:02,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:32:02,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:32:02,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:32:02,151::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:03,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:32:03,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:32:03,152::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:03,552::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:03,553::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:32:03,832::task::579::TaskManager.Task::(_updateState) Task=`68832bb7-91d5-417b-bd04-5da9da07ac9a`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:32:03,832::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:32:03,832::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:32:03,832::task::1168::TaskManager.Task::(prepare) Task=`68832bb7-91d5-417b-bd04-5da9da07ac9a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:32:03,833::task::579::TaskManager.Task::(_updateState) Task=`68832bb7-91d5-417b-bd04-5da9da07ac9a`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:32:03,833::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:32:03,833::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:32:03,833::task::974::TaskManager.Task::(_decref) Task=`68832bb7-91d5-417b-bd04-5da9da07ac9a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:04,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:32:04,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:32:04,933::task::579::TaskManager.Task::(_updateState) Task=`e6771bcd-6620-41a2-ac6f-5ee24f549ee3`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:32:04,933::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:32:04,934::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:32:04,935::task::1168::TaskManager.Task::(prepare) Task=`e6771bcd-6620-41a2-ac6f-5ee24f549ee3`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:32:04,935::task::579::TaskManager.Task::(_updateState) Task=`e6771bcd-6620-41a2-ac6f-5ee24f549ee3`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:32:04,935::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:32:04,935::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:32:04,935::task::974::TaskManager.Task::(_decref) Task=`e6771bcd-6620-41a2-ac6f-5ee24f549ee3`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:32:04,949::task::579::TaskManager.Task::(_updateState) Task=`97629a24-5e68-4cb9-8f77-98481a6c34ff`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:32:04,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:32:04,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:32:04,950::task::1168::TaskManager.Task::(prepare) Task=`97629a24-5e68-4cb9-8f77-98481a6c34ff`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:32:04,950::task::579::TaskManager.Task::(_updateState) Task=`97629a24-5e68-4cb9-8f77-98481a6c34ff`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:32:04,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:32:04,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:32:04,951::task::974::TaskManager.Task::(_decref) Task=`97629a24-5e68-4cb9-8f77-98481a6c34ff`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:05,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:32:05,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:32:05,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:32:05,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:05,555::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:06,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:32:06,327::task::579::TaskManager.Task::(_updateState) Task=`305c90d5-c508-4cab-99ca-525dfdbc44b4`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:32:06,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:32:06,328::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:32:06,328::task::1168::TaskManager.Task::(prepare) Task=`305c90d5-c508-4cab-99ca-525dfdbc44b4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:32:06,328::task::579::TaskManager.Task::(_updateState) Task=`305c90d5-c508-4cab-99ca-525dfdbc44b4`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:32:06,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:32:06,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:32:06,328::task::974::TaskManager.Task::(_decref) Task=`305c90d5-c508-4cab-99ca-525dfdbc44b4`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:32:06,329::task::579::TaskManager.Task::(_updateState) Task=`00b06cc5-0e6f-4e4b-91e6-14cf17710cb1`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:32:06,329::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:32:06,329::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:32:06,329::task::1168::TaskManager.Task::(prepare) Task=`00b06cc5-0e6f-4e4b-91e6-14cf17710cb1`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:32:06,329::task::579::TaskManager.Task::(_updateState) Task=`00b06cc5-0e6f-4e4b-91e6-14cf17710cb1`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:32:06,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:32:06,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:32:06,330::task::974::TaskManager.Task::(_decref) Task=`00b06cc5-0e6f-4e4b-91e6-14cf17710cb1`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:32:06,470::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:32:06,487::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000305987 s, 13.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:07,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:32:07,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:32:07,159::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:32:07,159::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:07,159::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:32:07,160::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:32:07,556::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:32:07,688::task::579::TaskManager.Task::(_updateState) Task=`1233e392-483c-402a-be18-040a352702be`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:32:07,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:32:07,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:32:07,689::task::1168::TaskManager.Task::(prepare) Task=`1233e392-483c-402a-be18-040a352702be`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:32:07,689::task::579::TaskManager.Task::(_updateState) Task=`1233e392-483c-402a-be18-040a352702be`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:32:07,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:32:07,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:32:07,689::task::974::TaskManager.Task::(_decref) Task=`1233e392-483c-402a-be18-040a352702be`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:32:07,690::task::579::TaskManager.Task::(_updateState) Task=`9937866d-12ec-43c9-a27e-511c3e63e0e6`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:32:07,690::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:32:07,690::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:32:07,690::task::1168::TaskManager.Task::(prepare) Task=`9937866d-12ec-43c9-a27e-511c3e63e0e6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:32:07,690::task::579::TaskManager.Task::(_updateState) Task=`9937866d-12ec-43c9-a27e-511c3e63e0e6`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:32:07,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:32:07,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:32:07,691::task::974::TaskManager.Task::(_decref) Task=`9937866d-12ec-43c9-a27e-511c3e63e0e6`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:32:08,029::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:32:08,048::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000260449 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:32:08,050::task::579::TaskManager.Task::(_updateState) Task=`d042732e-d9e8-4e59-8516-a56ca874d103`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:32:08,051::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:32:08,051::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:32:08,051::task::1168::TaskManager.Task::(prepare) Task=`d042732e-d9e8-4e59-8516-a56ca874d103`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:32:08,051::task::579::TaskManager.Task::(_updateState) Task=`d042732e-d9e8-4e59-8516-a56ca874d103`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:32:08,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:32:08,052::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:32:08,052::task::974::TaskManager.Task::(_decref) Task=`d042732e-d9e8-4e59-8516-a56ca874d103`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:32:08,092::task::579::TaskManager.Task::(_updateState) Task=`9a21f230-87b8-4410-8c67-9270002bab98`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:32:08,093::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:32:08,093::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:32:08,093::task::1168::TaskManager.Task::(prepare) Task=`9a21f230-87b8-4410-8c67-9270002bab98`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:32:08,093::task::579::TaskManager.Task::(_updateState) Task=`9a21f230-87b8-4410-8c67-9270002bab98`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:32:08,093::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:32:08,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:32:08,094::task::974::TaskManager.Task::(_decref) Task=`9a21f230-87b8-4410-8c67-9270002bab98`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:08,160::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:08,558::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:09,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:32:09,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:32:09,162::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:32:09,254::task::579::TaskManager.Task::(_updateState) Task=`28249b0a-1425-4b89-b420-203dde4e8fd4`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:32:09,255::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:32:09,255::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:32:09,255::task::1168::TaskManager.Task::(prepare) Task=`28249b0a-1425-4b89-b420-203dde4e8fd4`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:32:09,255::task::579::TaskManager.Task::(_updateState) Task=`28249b0a-1425-4b89-b420-203dde4e8fd4`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:32:09,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:32:09,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:32:09,256::task::974::TaskManager.Task::(_decref) Task=`28249b0a-1425-4b89-b420-203dde4e8fd4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:09,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:10,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:32:10,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:32:10,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:32:10,308::task::579::TaskManager.Task::(_updateState) Task=`aa6ebe63-de06-4ce2-ac38-1d1f73a804b0`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:32:10,308::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:32:10,309::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:32:10,309::task::1168::TaskManager.Task::(prepare) Task=`aa6ebe63-de06-4ce2-ac38-1d1f73a804b0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:32:10,309::task::579::TaskManager.Task::(_updateState) Task=`aa6ebe63-de06-4ce2-ac38-1d1f73a804b0`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:32:10,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:32:10,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:32:10,309::task::974::TaskManager.Task::(_decref) Task=`aa6ebe63-de06-4ce2-ac38-1d1f73a804b0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:11,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:32:11,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:32:11,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:32:11,165::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:11,561::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286722::DEBUG::2014-01-16 16:32:11,731::task::579::TaskManager.Task::(_updateState) Task=`f7e9b07d-a69a-4e73-ad3b-66ddc319bece`::moving from state init -> state preparing >Thread-286722::INFO::2014-01-16 16:32:11,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286722::INFO::2014-01-16 16:32:11,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260449', 'lastCheck': '3.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305987', 'lastCheck': '5.2', 'valid': True}} >Thread-286722::DEBUG::2014-01-16 16:32:11,732::task::1168::TaskManager.Task::(prepare) Task=`f7e9b07d-a69a-4e73-ad3b-66ddc319bece`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260449', 'lastCheck': '3.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305987', 'lastCheck': '5.2', 'valid': True}} >Thread-286722::DEBUG::2014-01-16 16:32:11,732::task::579::TaskManager.Task::(_updateState) Task=`f7e9b07d-a69a-4e73-ad3b-66ddc319bece`::moving from state preparing -> state finished >Thread-286722::DEBUG::2014-01-16 16:32:11,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286722::DEBUG::2014-01-16 16:32:11,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286722::DEBUG::2014-01-16 16:32:11,733::task::974::TaskManager.Task::(_decref) Task=`f7e9b07d-a69a-4e73-ad3b-66ddc319bece`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:12,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:13,167::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:32:13,168::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:32:13,392::task::579::TaskManager.Task::(_updateState) Task=`7e63d560-64e5-4e2a-969c-55c51f64e1cf`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:32:13,392::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:32:13,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:32:13,393::task::1168::TaskManager.Task::(prepare) Task=`7e63d560-64e5-4e2a-969c-55c51f64e1cf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:32:13,393::task::579::TaskManager.Task::(_updateState) Task=`7e63d560-64e5-4e2a-969c-55c51f64e1cf`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:32:13,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:32:13,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:32:13,393::task::974::TaskManager.Task::(_decref) Task=`7e63d560-64e5-4e2a-969c-55c51f64e1cf`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:13,563::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:13,564::task::579::TaskManager.Task::(_updateState) Task=`3bf46562-138e-432a-8b8e-b07a53d65dfb`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:32:13,564::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:32:13,564::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:32:13,564::task::1168::TaskManager.Task::(prepare) Task=`3bf46562-138e-432a-8b8e-b07a53d65dfb`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:32:13,565::task::579::TaskManager.Task::(_updateState) Task=`3bf46562-138e-432a-8b8e-b07a53d65dfb`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:32:13,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:32:13,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:32:13,565::task::974::TaskManager.Task::(_decref) Task=`3bf46562-138e-432a-8b8e-b07a53d65dfb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:13,567::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:32:13,567::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:32:13,568::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:13,570::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:13,571::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:14,168::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:15,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:15,573::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:16,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:32:16,216::task::579::TaskManager.Task::(_updateState) Task=`ab95f298-39c1-4291-9c46-ae5d3766bcfc`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:32:16,217::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:32:16,217::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:32:16,217::task::1168::TaskManager.Task::(prepare) Task=`ab95f298-39c1-4291-9c46-ae5d3766bcfc`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:32:16,217::task::579::TaskManager.Task::(_updateState) Task=`ab95f298-39c1-4291-9c46-ae5d3766bcfc`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:32:16,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:32:16,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:32:16,218::task::974::TaskManager.Task::(_decref) Task=`ab95f298-39c1-4291-9c46-ae5d3766bcfc`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:32:16,492::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:32:16,512::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00418539 s, 979 kB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:32:16,793::task::579::TaskManager.Task::(_updateState) Task=`1f02ec56-076e-43cf-af7b-e3fb633b1dcb`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:32:16,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:32:16,793::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:32:16,794::task::1168::TaskManager.Task::(prepare) Task=`1f02ec56-076e-43cf-af7b-e3fb633b1dcb`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:32:16,794::task::579::TaskManager.Task::(_updateState) Task=`1f02ec56-076e-43cf-af7b-e3fb633b1dcb`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:32:16,794::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:32:16,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:32:16,794::task::974::TaskManager.Task::(_decref) Task=`1f02ec56-076e-43cf-af7b-e3fb633b1dcb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:17,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:17,575::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:32:18,056::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:32:18,073::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257586 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:18,172::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:18,577::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:19,173::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:32:19,173::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:19,579::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:20,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:21,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:21,580::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:22,176::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:32:23,153::task::579::TaskManager.Task::(_updateState) Task=`7eaa44d2-97dc-48a1-96fb-474f6783db8e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:32:23,153::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:32:23,154::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:32:23,154::task::1168::TaskManager.Task::(prepare) Task=`7eaa44d2-97dc-48a1-96fb-474f6783db8e`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:32:23,154::task::579::TaskManager.Task::(_updateState) Task=`7eaa44d2-97dc-48a1-96fb-474f6783db8e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:32:23,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:32:23,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:32:23,154::task::974::TaskManager.Task::(_decref) Task=`7eaa44d2-97dc-48a1-96fb-474f6783db8e`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:32:23,155::task::579::TaskManager.Task::(_updateState) Task=`ee7f37ed-c144-49d5-ab2a-63408b05fe77`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:32:23,155::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:32:23,155::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:32:23,155::task::1168::TaskManager.Task::(prepare) Task=`ee7f37ed-c144-49d5-ab2a-63408b05fe77`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:32:23,155::task::579::TaskManager.Task::(_updateState) Task=`ee7f37ed-c144-49d5-ab2a-63408b05fe77`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:32:23,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:32:23,156::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:32:23,156::task::974::TaskManager.Task::(_decref) Task=`ee7f37ed-c144-49d5-ab2a-63408b05fe77`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:23,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:23,582::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:23,583::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:24,178::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:32:24,179::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:32:24,179::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:32:24,509::task::579::TaskManager.Task::(_updateState) Task=`f46779fa-e397-456e-9c5d-f977bee2da2a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:32:24,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:32:24,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:32:24,510::task::1168::TaskManager.Task::(prepare) Task=`f46779fa-e397-456e-9c5d-f977bee2da2a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:32:24,510::task::579::TaskManager.Task::(_updateState) Task=`f46779fa-e397-456e-9c5d-f977bee2da2a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:32:24,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:32:24,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:32:24,510::task::974::TaskManager.Task::(_decref) Task=`f46779fa-e397-456e-9c5d-f977bee2da2a`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:32:24,898::task::579::TaskManager.Task::(_updateState) Task=`1b786af0-fb1f-4b56-af58-2c01c8518cac`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:32:24,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:32:24,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:32:24,899::task::1168::TaskManager.Task::(prepare) Task=`1b786af0-fb1f-4b56-af58-2c01c8518cac`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:32:24,899::task::579::TaskManager.Task::(_updateState) Task=`1b786af0-fb1f-4b56-af58-2c01c8518cac`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:32:24,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:32:24,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:32:24,899::task::974::TaskManager.Task::(_decref) Task=`1b786af0-fb1f-4b56-af58-2c01c8518cac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:25,180::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:32:25,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:25,585::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:26,182::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:32:26,182::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:32:26,182::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:32:26,517::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:32:26,535::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000290977 s, 14.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:27,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:32:27,184::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286728::DEBUG::2014-01-16 16:32:27,521::task::579::TaskManager.Task::(_updateState) Task=`4e03a3f5-fc88-4e8d-8a78-61c2f02ef278`::moving from state init -> state preparing >Thread-286728::INFO::2014-01-16 16:32:27,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286728::INFO::2014-01-16 16:32:27,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257586', 'lastCheck': '9.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290977', 'lastCheck': '1.0', 'valid': True}} >Thread-286728::DEBUG::2014-01-16 16:32:27,522::task::1168::TaskManager.Task::(prepare) Task=`4e03a3f5-fc88-4e8d-8a78-61c2f02ef278`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257586', 'lastCheck': '9.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290977', 'lastCheck': '1.0', 'valid': True}} >Thread-286728::DEBUG::2014-01-16 16:32:27,522::task::579::TaskManager.Task::(_updateState) Task=`4e03a3f5-fc88-4e8d-8a78-61c2f02ef278`::moving from state preparing -> state finished >Thread-286728::DEBUG::2014-01-16 16:32:27,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286728::DEBUG::2014-01-16 16:32:27,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286728::DEBUG::2014-01-16 16:32:27,522::task::974::TaskManager.Task::(_decref) Task=`4e03a3f5-fc88-4e8d-8a78-61c2f02ef278`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:27,586::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:32:28,080::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:32:28,097::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026041 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:28,185::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:32:28,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:32:28,477::task::579::TaskManager.Task::(_updateState) Task=`a733cb0b-56f0-4ae2-8670-6c0b25d7f1b5`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:32:28,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:32:28,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:32:28,478::task::1168::TaskManager.Task::(prepare) Task=`a733cb0b-56f0-4ae2-8670-6c0b25d7f1b5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:32:28,478::task::579::TaskManager.Task::(_updateState) Task=`a733cb0b-56f0-4ae2-8670-6c0b25d7f1b5`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:32:28,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:32:28,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:32:28,478::task::974::TaskManager.Task::(_decref) Task=`a733cb0b-56f0-4ae2-8670-6c0b25d7f1b5`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:32:28,480::task::579::TaskManager.Task::(_updateState) Task=`48767f3f-303f-4378-b050-695c9863770e`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:32:28,480::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:32:28,480::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:32:28,480::task::1168::TaskManager.Task::(prepare) Task=`48767f3f-303f-4378-b050-695c9863770e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:32:28,481::task::579::TaskManager.Task::(_updateState) Task=`48767f3f-303f-4378-b050-695c9863770e`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:32:28,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:32:28,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:32:28,481::task::974::TaskManager.Task::(_decref) Task=`48767f3f-303f-4378-b050-695c9863770e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:28,589::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:32:28,589::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:32:28,590::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:29,186::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:29,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:30,187::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:32:30,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:31,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:32:31,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:31,593::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:32,190::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:32:32,190::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:32:32,190::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:32:32,190::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:33,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:32:33,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:32:33,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:32:33,471::task::579::TaskManager.Task::(_updateState) Task=`826b2b77-db2b-4842-bc34-81ee108f1bbd`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:32:33,472::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:32:33,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:32:33,472::task::1168::TaskManager.Task::(prepare) Task=`826b2b77-db2b-4842-bc34-81ee108f1bbd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:32:33,473::task::579::TaskManager.Task::(_updateState) Task=`826b2b77-db2b-4842-bc34-81ee108f1bbd`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:32:33,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:32:33,473::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:32:33,473::task::974::TaskManager.Task::(_decref) Task=`826b2b77-db2b-4842-bc34-81ee108f1bbd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:33,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:33,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:34,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:32:34,193::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:35,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:32:35,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:32:35,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:32:35,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:35,597::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:32:36,022::task::579::TaskManager.Task::(_updateState) Task=`27b9bd4c-7825-4580-b05b-07a95c4a6abf`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:32:36,022::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:32:36,022::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:32:36,022::task::1168::TaskManager.Task::(prepare) Task=`27b9bd4c-7825-4580-b05b-07a95c4a6abf`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:32:36,022::task::579::TaskManager.Task::(_updateState) Task=`27b9bd4c-7825-4580-b05b-07a95c4a6abf`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:32:36,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:32:36,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:32:36,023::task::974::TaskManager.Task::(_decref) Task=`27b9bd4c-7825-4580-b05b-07a95c4a6abf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:36,196::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:32:36,540::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:32:36,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000317873 s, 12.9 MB/s\n'; <rc> = 0 >Thread-16393::DEBUG::2014-01-16 16:32:36,807::task::579::TaskManager.Task::(_updateState) Task=`25d926c8-be73-47e7-8bf4-bedf33927960`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:32:36,807::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:32:36,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:32:36,808::task::1168::TaskManager.Task::(prepare) Task=`25d926c8-be73-47e7-8bf4-bedf33927960`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:32:36,808::task::579::TaskManager.Task::(_updateState) Task=`25d926c8-be73-47e7-8bf4-bedf33927960`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:32:36,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:32:36,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:32:36,808::task::974::TaskManager.Task::(_decref) Task=`25d926c8-be73-47e7-8bf4-bedf33927960`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:32:36,849::task::579::TaskManager.Task::(_updateState) Task=`8e943822-bf7d-4bff-8dcf-b404aaf7f34c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:32:36,850::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:32:36,850::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:32:36,850::task::1168::TaskManager.Task::(prepare) Task=`8e943822-bf7d-4bff-8dcf-b404aaf7f34c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:32:36,850::task::579::TaskManager.Task::(_updateState) Task=`8e943822-bf7d-4bff-8dcf-b404aaf7f34c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:32:36,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:32:36,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:32:36,851::task::974::TaskManager.Task::(_decref) Task=`8e943822-bf7d-4bff-8dcf-b404aaf7f34c`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:32:36,935::task::579::TaskManager.Task::(_updateState) Task=`26954ce1-8a18-46ff-9ed5-1ee74aeef9b8`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:32:36,935::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:32:36,935::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:32:36,936::task::1168::TaskManager.Task::(prepare) Task=`26954ce1-8a18-46ff-9ed5-1ee74aeef9b8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:32:36,936::task::579::TaskManager.Task::(_updateState) Task=`26954ce1-8a18-46ff-9ed5-1ee74aeef9b8`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:32:36,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:32:36,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:32:36,936::task::974::TaskManager.Task::(_decref) Task=`26954ce1-8a18-46ff-9ed5-1ee74aeef9b8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:37,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:32:37,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:32:37,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:32:37,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:37,198::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:32:37,198::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:32:37,599::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:32:37,764::task::579::TaskManager.Task::(_updateState) Task=`71483450-1524-424a-b0e3-14ea41c1c0a5`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:32:37,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:32:37,764::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:32:37,764::task::1168::TaskManager.Task::(prepare) Task=`71483450-1524-424a-b0e3-14ea41c1c0a5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:32:37,764::task::579::TaskManager.Task::(_updateState) Task=`71483450-1524-424a-b0e3-14ea41c1c0a5`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:32:37,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:32:37,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:32:37,765::task::974::TaskManager.Task::(_decref) Task=`71483450-1524-424a-b0e3-14ea41c1c0a5`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:32:38,059::task::579::TaskManager.Task::(_updateState) Task=`030c64f2-3304-45e8-8559-b2cb62ba3703`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:32:38,059::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:32:38,060::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:32:38,060::task::1168::TaskManager.Task::(prepare) Task=`030c64f2-3304-45e8-8559-b2cb62ba3703`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:32:38,060::task::579::TaskManager.Task::(_updateState) Task=`030c64f2-3304-45e8-8559-b2cb62ba3703`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:32:38,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:32:38,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:32:38,060::task::974::TaskManager.Task::(_decref) Task=`030c64f2-3304-45e8-8559-b2cb62ba3703`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:32:38,104::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:32:38,121::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276354 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:38,198::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:38,601::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:39,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:32:39,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:32:39,200::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:39,602::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:40,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:32:40,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:32:40,202::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:32:40,400::task::579::TaskManager.Task::(_updateState) Task=`918f4df0-5232-4235-b7e9-5ac983ec5c5f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:32:40,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:32:40,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:32:40,401::task::1168::TaskManager.Task::(prepare) Task=`918f4df0-5232-4235-b7e9-5ac983ec5c5f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:32:40,401::task::579::TaskManager.Task::(_updateState) Task=`918f4df0-5232-4235-b7e9-5ac983ec5c5f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:32:40,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:32:40,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:32:40,401::task::974::TaskManager.Task::(_decref) Task=`918f4df0-5232-4235-b7e9-5ac983ec5c5f`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:32:40,402::task::579::TaskManager.Task::(_updateState) Task=`0d9c65e3-cd30-4e16-a46a-f35464a7a1e1`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:32:40,402::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:32:40,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:32:40,402::task::1168::TaskManager.Task::(prepare) Task=`0d9c65e3-cd30-4e16-a46a-f35464a7a1e1`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:32:40,402::task::579::TaskManager.Task::(_updateState) Task=`0d9c65e3-cd30-4e16-a46a-f35464a7a1e1`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:32:40,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:32:40,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:32:40,403::task::974::TaskManager.Task::(_decref) Task=`0d9c65e3-cd30-4e16-a46a-f35464a7a1e1`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:32:40,403::task::579::TaskManager.Task::(_updateState) Task=`0767505d-55c2-455e-8bf5-29bf9350f067`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:32:40,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:32:40,403::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:32:40,403::task::1168::TaskManager.Task::(prepare) Task=`0767505d-55c2-455e-8bf5-29bf9350f067`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:32:40,403::task::579::TaskManager.Task::(_updateState) Task=`0767505d-55c2-455e-8bf5-29bf9350f067`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:32:40,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:32:40,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:32:40,404::task::974::TaskManager.Task::(_decref) Task=`0767505d-55c2-455e-8bf5-29bf9350f067`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:41,203::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:32:41,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:32:41,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:32:41,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:41,604::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:42,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:43,206::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:32:43,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:43,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:43,608::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:32:43,608::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:32:43,609::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286734::DEBUG::2014-01-16 16:32:43,683::task::579::TaskManager.Task::(_updateState) Task=`504b8f3d-76b7-4262-95dc-1f1703bebfe0`::moving from state init -> state preparing >Thread-286734::INFO::2014-01-16 16:32:43,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286734::INFO::2014-01-16 16:32:43,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276354', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317873', 'lastCheck': '7.1', 'valid': True}} >Thread-286734::DEBUG::2014-01-16 16:32:43,683::task::1168::TaskManager.Task::(prepare) Task=`504b8f3d-76b7-4262-95dc-1f1703bebfe0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276354', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317873', 'lastCheck': '7.1', 'valid': True}} >Thread-286734::DEBUG::2014-01-16 16:32:43,683::task::579::TaskManager.Task::(_updateState) Task=`504b8f3d-76b7-4262-95dc-1f1703bebfe0`::moving from state preparing -> state finished >Thread-286734::DEBUG::2014-01-16 16:32:43,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286734::DEBUG::2014-01-16 16:32:43,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286734::DEBUG::2014-01-16 16:32:43,684::task::974::TaskManager.Task::(_decref) Task=`504b8f3d-76b7-4262-95dc-1f1703bebfe0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:44,208::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:45,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:45,611::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:32:45,791::task::579::TaskManager.Task::(_updateState) Task=`4a97afa8-48f5-43c6-9236-83b7d31bbd6a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:32:45,791::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:32:45,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:32:45,792::task::1168::TaskManager.Task::(prepare) Task=`4a97afa8-48f5-43c6-9236-83b7d31bbd6a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:32:45,792::task::579::TaskManager.Task::(_updateState) Task=`4a97afa8-48f5-43c6-9236-83b7d31bbd6a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:32:45,792::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:32:45,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:32:45,792::task::974::TaskManager.Task::(_decref) Task=`4a97afa8-48f5-43c6-9236-83b7d31bbd6a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:46,210::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:32:46,563::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:32:46,578::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024557 s, 16.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:47,211::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:47,612::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:32:48,129::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:32:48,143::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000317114 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:48,213::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:48,614::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:49,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:32:49,214::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:49,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:32:50,119::task::579::TaskManager.Task::(_updateState) Task=`bfcd7fc7-9e26-43bf-8235-7a6afd5f1065`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:32:50,120::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:32:50,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:32:50,120::task::1168::TaskManager.Task::(prepare) Task=`bfcd7fc7-9e26-43bf-8235-7a6afd5f1065`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:32:50,120::task::579::TaskManager.Task::(_updateState) Task=`bfcd7fc7-9e26-43bf-8235-7a6afd5f1065`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:32:50,121::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:32:50,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:32:50,121::task::974::TaskManager.Task::(_decref) Task=`bfcd7fc7-9e26-43bf-8235-7a6afd5f1065`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:50,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:51,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:51,617::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:52,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:53,217::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:53,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:32:53,620::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:54,218::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:32:54,218::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:32:54,218::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:32:55,219::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:32:55,219::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:55,621::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:56,221::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:32:56,221::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:32:56,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:32:56,583::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:32:56,599::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000330668 s, 12.4 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:32:56,923::task::579::TaskManager.Task::(_updateState) Task=`f0640c8f-6298-4ca4-9fc8-e4d5bcd30de0`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:32:56,924::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:32:56,925::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:32:56,925::task::1168::TaskManager.Task::(prepare) Task=`f0640c8f-6298-4ca4-9fc8-e4d5bcd30de0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:32:56,925::task::579::TaskManager.Task::(_updateState) Task=`f0640c8f-6298-4ca4-9fc8-e4d5bcd30de0`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:32:56,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:32:56,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:32:56,925::task::974::TaskManager.Task::(_decref) Task=`f0640c8f-6298-4ca4-9fc8-e4d5bcd30de0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:32:57,222::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:32:57,222::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:57,623::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:32:58,150::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:32:58,165::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000395335 s, 923 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:32:58,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:32:58,224::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:32:58,625::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:32:58,625::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:32:58,627::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:32:59,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:32:59,341::task::579::TaskManager.Task::(_updateState) Task=`23c7e3c2-6f31-4257-b89b-4b828982f55f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:32:59,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:32:59,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:32:59,341::task::1168::TaskManager.Task::(prepare) Task=`23c7e3c2-6f31-4257-b89b-4b828982f55f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:32:59,342::task::579::TaskManager.Task::(_updateState) Task=`23c7e3c2-6f31-4257-b89b-4b828982f55f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:32:59,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:32:59,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:32:59,342::task::974::TaskManager.Task::(_decref) Task=`23c7e3c2-6f31-4257-b89b-4b828982f55f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:32:59,342::task::579::TaskManager.Task::(_updateState) Task=`2bdd189e-c901-425a-b97d-d37af2103634`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:32:59,343::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:32:59,343::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:32:59,343::task::1168::TaskManager.Task::(prepare) Task=`2bdd189e-c901-425a-b97d-d37af2103634`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:32:59,343::task::579::TaskManager.Task::(_updateState) Task=`2bdd189e-c901-425a-b97d-d37af2103634`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:32:59,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:32:59,344::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:32:59,344::task::974::TaskManager.Task::(_decref) Task=`2bdd189e-c901-425a-b97d-d37af2103634`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:32:59,344::task::579::TaskManager.Task::(_updateState) Task=`46a9e6d9-4026-408f-aa72-619cb8e26a0b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:32:59,344::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:32:59,345::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:32:59,345::task::1168::TaskManager.Task::(prepare) Task=`46a9e6d9-4026-408f-aa72-619cb8e26a0b`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:32:59,345::task::579::TaskManager.Task::(_updateState) Task=`46a9e6d9-4026-408f-aa72-619cb8e26a0b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:32:59,345::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:32:59,345::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:32:59,345::task::974::TaskManager.Task::(_decref) Task=`46a9e6d9-4026-408f-aa72-619cb8e26a0b`::ref 0 aborting False >Thread-286740::DEBUG::2014-01-16 16:32:59,429::task::579::TaskManager.Task::(_updateState) Task=`925d3eac-182c-4e74-b6ce-d2e9543d6da3`::moving from state init -> state preparing >Thread-286740::INFO::2014-01-16 16:32:59,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286740::INFO::2014-01-16 16:32:59,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000395335', 'lastCheck': '1.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330668', 'lastCheck': '2.8', 'valid': True}} >Thread-286740::DEBUG::2014-01-16 16:32:59,429::task::1168::TaskManager.Task::(prepare) Task=`925d3eac-182c-4e74-b6ce-d2e9543d6da3`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000395335', 'lastCheck': '1.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330668', 'lastCheck': '2.8', 'valid': True}} >Thread-286740::DEBUG::2014-01-16 16:32:59,430::task::579::TaskManager.Task::(_updateState) Task=`925d3eac-182c-4e74-b6ce-d2e9543d6da3`::moving from state preparing -> state finished >Thread-286740::DEBUG::2014-01-16 16:32:59,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286740::DEBUG::2014-01-16 16:32:59,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286740::DEBUG::2014-01-16 16:32:59,430::task::974::TaskManager.Task::(_decref) Task=`925d3eac-182c-4e74-b6ce-d2e9543d6da3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:32:59,628::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:00,226::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:33:00,226::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:01,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:33:01,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:01,629::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:33:01,820::task::579::TaskManager.Task::(_updateState) Task=`bdeb81ac-90ff-47a1-b5ae-6391b29f12cb`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:33:01,820::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:33:01,820::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:33:01,821::task::1168::TaskManager.Task::(prepare) Task=`bdeb81ac-90ff-47a1-b5ae-6391b29f12cb`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:33:01,821::task::579::TaskManager.Task::(_updateState) Task=`bdeb81ac-90ff-47a1-b5ae-6391b29f12cb`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:33:01,821::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:33:01,821::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:33:01,821::task::974::TaskManager.Task::(_decref) Task=`bdeb81ac-90ff-47a1-b5ae-6391b29f12cb`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:33:01,821::task::579::TaskManager.Task::(_updateState) Task=`d569df6e-d889-4117-b19f-3e544c286bb1`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:33:01,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:33:01,822::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:33:01,822::task::1168::TaskManager.Task::(prepare) Task=`d569df6e-d889-4117-b19f-3e544c286bb1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:33:01,822::task::579::TaskManager.Task::(_updateState) Task=`d569df6e-d889-4117-b19f-3e544c286bb1`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:33:01,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:33:01,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:33:01,822::task::974::TaskManager.Task::(_decref) Task=`d569df6e-d889-4117-b19f-3e544c286bb1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:02,228::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:33:02,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:33:02,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:33:02,229::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:03,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:33:03,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:33:03,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:03,630::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:03,631::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:33:04,004::task::579::TaskManager.Task::(_updateState) Task=`a9bf5011-ce9b-44fe-aa0c-f5be8fa44327`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:33:04,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:33:04,005::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:33:04,005::task::1168::TaskManager.Task::(prepare) Task=`a9bf5011-ce9b-44fe-aa0c-f5be8fa44327`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:33:04,005::task::579::TaskManager.Task::(_updateState) Task=`a9bf5011-ce9b-44fe-aa0c-f5be8fa44327`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:33:04,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:33:04,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:33:04,005::task::974::TaskManager.Task::(_decref) Task=`a9bf5011-ce9b-44fe-aa0c-f5be8fa44327`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:04,231::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:33:04,232::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:33:05,012::task::579::TaskManager.Task::(_updateState) Task=`217365d9-ecdc-46d2-994a-fb8049ec1564`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:33:05,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:33:05,013::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:33:05,013::task::1168::TaskManager.Task::(prepare) Task=`217365d9-ecdc-46d2-994a-fb8049ec1564`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:33:05,013::task::579::TaskManager.Task::(_updateState) Task=`217365d9-ecdc-46d2-994a-fb8049ec1564`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:33:05,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:33:05,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:33:05,013::task::974::TaskManager.Task::(_decref) Task=`217365d9-ecdc-46d2-994a-fb8049ec1564`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:33:05,017::task::579::TaskManager.Task::(_updateState) Task=`a76dafac-b203-431f-b69d-5836240dc4ee`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:33:05,017::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:33:05,017::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:33:05,017::task::1168::TaskManager.Task::(prepare) Task=`a76dafac-b203-431f-b69d-5836240dc4ee`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:33:05,017::task::579::TaskManager.Task::(_updateState) Task=`a76dafac-b203-431f-b69d-5836240dc4ee`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:33:05,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:33:05,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:33:05,018::task::974::TaskManager.Task::(_decref) Task=`a76dafac-b203-431f-b69d-5836240dc4ee`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:05,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:33:05,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:33:05,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:33:05,233::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:05,633::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:06,234::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:33:06,422::task::579::TaskManager.Task::(_updateState) Task=`b48e3132-413a-4020-b9df-eec88736d2d4`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:33:06,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:33:06,423::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:33:06,423::task::1168::TaskManager.Task::(prepare) Task=`b48e3132-413a-4020-b9df-eec88736d2d4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:33:06,424::task::579::TaskManager.Task::(_updateState) Task=`b48e3132-413a-4020-b9df-eec88736d2d4`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:33:06,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:33:06,424::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:33:06,424::task::974::TaskManager.Task::(_decref) Task=`b48e3132-413a-4020-b9df-eec88736d2d4`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:33:06,424::task::579::TaskManager.Task::(_updateState) Task=`4c27b7ff-5876-45f7-91dd-026f65f50085`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:33:06,424::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:33:06,425::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:33:06,425::task::1168::TaskManager.Task::(prepare) Task=`4c27b7ff-5876-45f7-91dd-026f65f50085`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:33:06,425::task::579::TaskManager.Task::(_updateState) Task=`4c27b7ff-5876-45f7-91dd-026f65f50085`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:33:06,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:33:06,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:33:06,425::task::974::TaskManager.Task::(_decref) Task=`4c27b7ff-5876-45f7-91dd-026f65f50085`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:33:06,604::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:33:06,619::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000238088 s, 17.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:33:07,235::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:33:07,235::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:33:07,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:33:07,236::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:07,236::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:33:07,236::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:33:07,634::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:33:07,909::task::579::TaskManager.Task::(_updateState) Task=`f4a49989-622a-42bc-a44a-bc9f4f0e97cf`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:33:07,909::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:33:07,909::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:33:07,910::task::1168::TaskManager.Task::(prepare) Task=`f4a49989-622a-42bc-a44a-bc9f4f0e97cf`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:33:07,910::task::579::TaskManager.Task::(_updateState) Task=`f4a49989-622a-42bc-a44a-bc9f4f0e97cf`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:33:07,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:33:07,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:33:07,910::task::974::TaskManager.Task::(_decref) Task=`f4a49989-622a-42bc-a44a-bc9f4f0e97cf`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:33:07,910::task::579::TaskManager.Task::(_updateState) Task=`5d1e488a-db89-4475-9d31-7481b5c40e96`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:33:07,911::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:33:07,911::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:33:07,911::task::1168::TaskManager.Task::(prepare) Task=`5d1e488a-db89-4475-9d31-7481b5c40e96`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:33:07,911::task::579::TaskManager.Task::(_updateState) Task=`5d1e488a-db89-4475-9d31-7481b5c40e96`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:33:07,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:33:07,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:33:07,911::task::974::TaskManager.Task::(_decref) Task=`5d1e488a-db89-4475-9d31-7481b5c40e96`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:33:08,174::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:33:08,190::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002751 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:33:08,197::task::579::TaskManager.Task::(_updateState) Task=`ff626859-8085-4910-9618-ca783a1877c9`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:33:08,198::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:33:08,198::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:33:08,199::task::1168::TaskManager.Task::(prepare) Task=`ff626859-8085-4910-9618-ca783a1877c9`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:33:08,199::task::579::TaskManager.Task::(_updateState) Task=`ff626859-8085-4910-9618-ca783a1877c9`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:33:08,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:33:08,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:33:08,200::task::974::TaskManager.Task::(_decref) Task=`ff626859-8085-4910-9618-ca783a1877c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:08,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 16:33:08,269::task::579::TaskManager.Task::(_updateState) Task=`7ad95381-7ca7-45e0-b6d0-9aa4e618e1ed`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:33:08,269::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:33:08,269::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:33:08,270::task::1168::TaskManager.Task::(prepare) Task=`7ad95381-7ca7-45e0-b6d0-9aa4e618e1ed`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:33:08,270::task::579::TaskManager.Task::(_updateState) Task=`7ad95381-7ca7-45e0-b6d0-9aa4e618e1ed`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:33:08,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:33:08,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:33:08,271::task::974::TaskManager.Task::(_decref) Task=`7ad95381-7ca7-45e0-b6d0-9aa4e618e1ed`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:08,636::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:09,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:33:09,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:33:09,239::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:33:09,428::task::579::TaskManager.Task::(_updateState) Task=`7dac191f-7ba3-4624-ae29-2c9fed084fae`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:33:09,428::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:33:09,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:33:09,429::task::1168::TaskManager.Task::(prepare) Task=`7dac191f-7ba3-4624-ae29-2c9fed084fae`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:33:09,429::task::579::TaskManager.Task::(_updateState) Task=`7dac191f-7ba3-4624-ae29-2c9fed084fae`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:33:09,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:33:09,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:33:09,429::task::974::TaskManager.Task::(_decref) Task=`7dac191f-7ba3-4624-ae29-2c9fed084fae`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:09,637::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:10,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:33:10,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:33:10,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:33:10,482::task::579::TaskManager.Task::(_updateState) Task=`2abca1af-4561-4d0f-b86f-31b3c3f3b595`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:33:10,483::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:33:10,483::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:33:10,483::task::1168::TaskManager.Task::(prepare) Task=`2abca1af-4561-4d0f-b86f-31b3c3f3b595`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:33:10,483::task::579::TaskManager.Task::(_updateState) Task=`2abca1af-4561-4d0f-b86f-31b3c3f3b595`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:33:10,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:33:10,484::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:33:10,484::task::974::TaskManager.Task::(_decref) Task=`2abca1af-4561-4d0f-b86f-31b3c3f3b595`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:11,241::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:33:11,242::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:33:11,242::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:33:11,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:11,639::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:12,243::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:13,245::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:33:13,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:33:13,578::task::579::TaskManager.Task::(_updateState) Task=`eb364c6e-8d28-4879-9660-d7b01a2a1236`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:33:13,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:33:13,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:33:13,579::task::1168::TaskManager.Task::(prepare) Task=`eb364c6e-8d28-4879-9660-d7b01a2a1236`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:33:13,579::task::579::TaskManager.Task::(_updateState) Task=`eb364c6e-8d28-4879-9660-d7b01a2a1236`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:33:13,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:33:13,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:33:13,579::task::974::TaskManager.Task::(_decref) Task=`eb364c6e-8d28-4879-9660-d7b01a2a1236`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:13,640::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:13,640::task::579::TaskManager.Task::(_updateState) Task=`b175dde8-c6a4-4c7e-b47c-b9e2661214ff`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:33:13,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:33:13,641::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:33:13,641::task::1168::TaskManager.Task::(prepare) Task=`b175dde8-c6a4-4c7e-b47c-b9e2661214ff`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:33:13,641::task::579::TaskManager.Task::(_updateState) Task=`b175dde8-c6a4-4c7e-b47c-b9e2661214ff`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:33:13,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:33:13,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:33:13,642::task::974::TaskManager.Task::(_decref) Task=`b175dde8-c6a4-4c7e-b47c-b9e2661214ff`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:13,643::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:33:13,643::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:33:13,646::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:13,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:13,648::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:14,246::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:15,247::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286746::DEBUG::2014-01-16 16:33:15,345::task::579::TaskManager.Task::(_updateState) Task=`3fa166fe-5976-4d18-81fc-3483fe7331da`::moving from state init -> state preparing >Thread-286746::INFO::2014-01-16 16:33:15,346::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286746::INFO::2014-01-16 16:33:15,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002751', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238088', 'lastCheck': '8.7', 'valid': True}} >Thread-286746::DEBUG::2014-01-16 16:33:15,346::task::1168::TaskManager.Task::(prepare) Task=`3fa166fe-5976-4d18-81fc-3483fe7331da`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002751', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238088', 'lastCheck': '8.7', 'valid': True}} >Thread-286746::DEBUG::2014-01-16 16:33:15,346::task::579::TaskManager.Task::(_updateState) Task=`3fa166fe-5976-4d18-81fc-3483fe7331da`::moving from state preparing -> state finished >Thread-286746::DEBUG::2014-01-16 16:33:15,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286746::DEBUG::2014-01-16 16:33:15,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286746::DEBUG::2014-01-16 16:33:15,347::task::974::TaskManager.Task::(_decref) Task=`3fa166fe-5976-4d18-81fc-3483fe7331da`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:15,649::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:16,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:33:16,304::task::579::TaskManager.Task::(_updateState) Task=`c57e459e-fabd-47fa-b704-57237384fcf2`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:33:16,304::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:33:16,305::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:33:16,305::task::1168::TaskManager.Task::(prepare) Task=`c57e459e-fabd-47fa-b704-57237384fcf2`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:33:16,306::task::579::TaskManager.Task::(_updateState) Task=`c57e459e-fabd-47fa-b704-57237384fcf2`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:33:16,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:33:16,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:33:16,306::task::974::TaskManager.Task::(_decref) Task=`c57e459e-fabd-47fa-b704-57237384fcf2`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:33:16,624::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:33:16,644::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000264473 s, 15.5 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:33:16,963::task::579::TaskManager.Task::(_updateState) Task=`21c26702-9a8a-447f-89e2-0ff7aea2d097`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:33:16,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:33:16,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:33:16,964::task::1168::TaskManager.Task::(prepare) Task=`21c26702-9a8a-447f-89e2-0ff7aea2d097`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:33:16,964::task::579::TaskManager.Task::(_updateState) Task=`21c26702-9a8a-447f-89e2-0ff7aea2d097`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:33:16,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:33:16,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:33:16,965::task::974::TaskManager.Task::(_decref) Task=`21c26702-9a8a-447f-89e2-0ff7aea2d097`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:17,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:17,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:33:18,199::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:33:18,216::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267534 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:33:18,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:18,652::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:19,252::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:33:19,252::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:19,654::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:20,253::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:21,254::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:21,655::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:22,255::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:23,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:33:23,530::task::579::TaskManager.Task::(_updateState) Task=`820adaad-dea8-4801-9b62-bf249772d2c4`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:33:23,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:33:23,531::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:33:23,531::task::1168::TaskManager.Task::(prepare) Task=`820adaad-dea8-4801-9b62-bf249772d2c4`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:33:23,531::task::579::TaskManager.Task::(_updateState) Task=`820adaad-dea8-4801-9b62-bf249772d2c4`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:33:23,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:33:23,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:33:23,531::task::974::TaskManager.Task::(_decref) Task=`820adaad-dea8-4801-9b62-bf249772d2c4`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:33:23,532::task::579::TaskManager.Task::(_updateState) Task=`ef831c08-73de-4fcd-92c4-c7fc4e6b2dc0`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:33:23,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:33:23,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:33:23,532::task::1168::TaskManager.Task::(prepare) Task=`ef831c08-73de-4fcd-92c4-c7fc4e6b2dc0`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:33:23,532::task::579::TaskManager.Task::(_updateState) Task=`ef831c08-73de-4fcd-92c4-c7fc4e6b2dc0`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:33:23,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:33:23,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:33:23,533::task::974::TaskManager.Task::(_decref) Task=`ef831c08-73de-4fcd-92c4-c7fc4e6b2dc0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:23,656::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:23,657::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:24,258::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:33:24,259::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:33:24,259::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:33:24,585::task::579::TaskManager.Task::(_updateState) Task=`86e64208-f2dd-4874-8ec8-76fbe796bbeb`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:33:24,585::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:33:24,585::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:33:24,585::task::1168::TaskManager.Task::(prepare) Task=`86e64208-f2dd-4874-8ec8-76fbe796bbeb`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:33:24,586::task::579::TaskManager.Task::(_updateState) Task=`86e64208-f2dd-4874-8ec8-76fbe796bbeb`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:33:24,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:33:24,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:33:24,586::task::974::TaskManager.Task::(_decref) Task=`86e64208-f2dd-4874-8ec8-76fbe796bbeb`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:33:25,070::task::579::TaskManager.Task::(_updateState) Task=`25c674cb-5a5d-4cf7-b6a2-882b01ae4da9`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:33:25,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:33:25,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:33:25,070::task::1168::TaskManager.Task::(prepare) Task=`25c674cb-5a5d-4cf7-b6a2-882b01ae4da9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:33:25,071::task::579::TaskManager.Task::(_updateState) Task=`25c674cb-5a5d-4cf7-b6a2-882b01ae4da9`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:33:25,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:33:25,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:33:25,071::task::974::TaskManager.Task::(_decref) Task=`25c674cb-5a5d-4cf7-b6a2-882b01ae4da9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:25,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:33:25,260::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:25,658::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:26,261::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:33:26,261::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:33:26,262::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:33:26,651::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:33:26,668::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022122 s, 18.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:33:27,263::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:33:27,263::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:27,660::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:33:28,223::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:33:28,239::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297226 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:33:28,264::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:33:28,264::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:33:28,647::task::579::TaskManager.Task::(_updateState) Task=`7f8f5c4d-87ab-47a7-827f-88de3a9b7d89`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:33:28,647::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:33:28,648::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:33:28,648::task::1168::TaskManager.Task::(prepare) Task=`7f8f5c4d-87ab-47a7-827f-88de3a9b7d89`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:33:28,648::task::579::TaskManager.Task::(_updateState) Task=`7f8f5c4d-87ab-47a7-827f-88de3a9b7d89`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:33:28,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:33:28,649::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:33:28,649::task::974::TaskManager.Task::(_decref) Task=`7f8f5c4d-87ab-47a7-827f-88de3a9b7d89`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:28,670::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:33:28,671::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:33:28,672::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-59295::DEBUG::2014-01-16 16:33:28,675::task::579::TaskManager.Task::(_updateState) Task=`cfb09163-c645-476e-beec-86d1167bd2cf`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:33:28,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:33:28,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:33:28,676::task::1168::TaskManager.Task::(prepare) Task=`cfb09163-c645-476e-beec-86d1167bd2cf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:33:28,676::task::579::TaskManager.Task::(_updateState) Task=`cfb09163-c645-476e-beec-86d1167bd2cf`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:33:28,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:33:28,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:33:28,676::task::974::TaskManager.Task::(_decref) Task=`cfb09163-c645-476e-beec-86d1167bd2cf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:29,265::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:29,674::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:30,266::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:33:30,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286752::DEBUG::2014-01-16 16:33:31,049::task::579::TaskManager.Task::(_updateState) Task=`66498222-f872-4809-95ce-4709f73f6142`::moving from state init -> state preparing >Thread-286752::INFO::2014-01-16 16:33:31,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286752::INFO::2014-01-16 16:33:31,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297226', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022122', 'lastCheck': '4.4', 'valid': True}} >Thread-286752::DEBUG::2014-01-16 16:33:31,050::task::1168::TaskManager.Task::(prepare) Task=`66498222-f872-4809-95ce-4709f73f6142`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297226', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022122', 'lastCheck': '4.4', 'valid': True}} >Thread-286752::DEBUG::2014-01-16 16:33:31,050::task::579::TaskManager.Task::(_updateState) Task=`66498222-f872-4809-95ce-4709f73f6142`::moving from state preparing -> state finished >Thread-286752::DEBUG::2014-01-16 16:33:31,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286752::DEBUG::2014-01-16 16:33:31,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286752::DEBUG::2014-01-16 16:33:31,051::task::974::TaskManager.Task::(_decref) Task=`66498222-f872-4809-95ce-4709f73f6142`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:31,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:33:31,268::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:31,675::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:32,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:33:32,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:33:32,270::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:33:32,270::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:33,271::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:33:33,271::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:33:33,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:33:33,657::task::579::TaskManager.Task::(_updateState) Task=`2722c5e1-67bc-4367-a2a7-fd1e573dd373`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:33:33,657::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:33:33,657::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:33:33,657::task::1168::TaskManager.Task::(prepare) Task=`2722c5e1-67bc-4367-a2a7-fd1e573dd373`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:33:33,658::task::579::TaskManager.Task::(_updateState) Task=`2722c5e1-67bc-4367-a2a7-fd1e573dd373`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:33:33,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:33:33,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:33:33,658::task::974::TaskManager.Task::(_decref) Task=`2722c5e1-67bc-4367-a2a7-fd1e573dd373`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:33:33,677::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:33,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:34,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:33:34,273::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:35,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:33:35,274::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:33:35,274::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:33:35,274::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:35,679::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:33:36,182::task::579::TaskManager.Task::(_updateState) Task=`0e17a186-f9c6-491f-857e-86a4fdde70a7`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:33:36,183::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:33:36,183::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:33:36,183::task::1168::TaskManager.Task::(prepare) Task=`0e17a186-f9c6-491f-857e-86a4fdde70a7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:33:36,183::task::579::TaskManager.Task::(_updateState) Task=`0e17a186-f9c6-491f-857e-86a4fdde70a7`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:33:36,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:33:36,184::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:33:36,184::task::974::TaskManager.Task::(_decref) Task=`0e17a186-f9c6-491f-857e-86a4fdde70a7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:36,275::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:33:36,674::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:33:36,691::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000252181 s, 16.2 MB/s\n'; <rc> = 0 >Thread-16393::DEBUG::2014-01-16 16:33:36,971::task::579::TaskManager.Task::(_updateState) Task=`a0669d91-22ea-4f3e-89ab-6dcb38c9d4a1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:33:36,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:33:36,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:33:36,972::task::1168::TaskManager.Task::(prepare) Task=`a0669d91-22ea-4f3e-89ab-6dcb38c9d4a1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:33:36,972::task::579::TaskManager.Task::(_updateState) Task=`a0669d91-22ea-4f3e-89ab-6dcb38c9d4a1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:33:36,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:33:36,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:33:36,973::task::974::TaskManager.Task::(_decref) Task=`a0669d91-22ea-4f3e-89ab-6dcb38c9d4a1`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:33:37,016::task::579::TaskManager.Task::(_updateState) Task=`f5c2aa21-331b-423a-ad6a-8265cfc8146d`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:33:37,016::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:33:37,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:33:37,016::task::1168::TaskManager.Task::(prepare) Task=`f5c2aa21-331b-423a-ad6a-8265cfc8146d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:33:37,017::task::579::TaskManager.Task::(_updateState) Task=`f5c2aa21-331b-423a-ad6a-8265cfc8146d`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:33:37,017::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:33:37,017::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:33:37,017::task::974::TaskManager.Task::(_decref) Task=`f5c2aa21-331b-423a-ad6a-8265cfc8146d`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:33:37,115::task::579::TaskManager.Task::(_updateState) Task=`81df4156-61c5-4679-ae9e-9e4ace004100`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:33:37,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:33:37,116::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:33:37,116::task::1168::TaskManager.Task::(prepare) Task=`81df4156-61c5-4679-ae9e-9e4ace004100`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:33:37,116::task::579::TaskManager.Task::(_updateState) Task=`81df4156-61c5-4679-ae9e-9e4ace004100`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:33:37,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:33:37,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:33:37,117::task::974::TaskManager.Task::(_decref) Task=`81df4156-61c5-4679-ae9e-9e4ace004100`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:37,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:33:37,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:33:37,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:33:37,277::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:37,277::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:33:37,278::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:33:37,680::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:33:37,937::task::579::TaskManager.Task::(_updateState) Task=`446f0114-aeba-4484-95e9-2bd723d409ae`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:33:37,937::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:33:37,937::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:33:37,937::task::1168::TaskManager.Task::(prepare) Task=`446f0114-aeba-4484-95e9-2bd723d409ae`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:33:37,938::task::579::TaskManager.Task::(_updateState) Task=`446f0114-aeba-4484-95e9-2bd723d409ae`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:33:37,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:33:37,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:33:37,938::task::974::TaskManager.Task::(_decref) Task=`446f0114-aeba-4484-95e9-2bd723d409ae`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 16:33:38,221::task::579::TaskManager.Task::(_updateState) Task=`48d9deba-399d-4977-86a0-c267741042ca`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:33:38,222::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:33:38,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:33:38,222::task::1168::TaskManager.Task::(prepare) Task=`48d9deba-399d-4977-86a0-c267741042ca`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:33:38,222::task::579::TaskManager.Task::(_updateState) Task=`48d9deba-399d-4977-86a0-c267741042ca`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:33:38,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:33:38,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:33:38,223::task::974::TaskManager.Task::(_decref) Task=`48d9deba-399d-4977-86a0-c267741042ca`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:33:38,247::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:33:38,265::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000268292 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:33:38,280::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:38,682::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:39,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:33:39,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:33:39,282::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:39,683::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:40,283::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:33:40,283::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:33:40,283::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:33:40,700::task::579::TaskManager.Task::(_updateState) Task=`344bae0f-7a8f-46e2-adcc-6e3921f37724`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:33:40,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:33:40,700::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:33:40,701::task::1168::TaskManager.Task::(prepare) Task=`344bae0f-7a8f-46e2-adcc-6e3921f37724`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:33:40,701::task::579::TaskManager.Task::(_updateState) Task=`344bae0f-7a8f-46e2-adcc-6e3921f37724`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:33:40,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:33:40,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:33:40,701::task::974::TaskManager.Task::(_decref) Task=`344bae0f-7a8f-46e2-adcc-6e3921f37724`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:33:40,702::task::579::TaskManager.Task::(_updateState) Task=`2576ede1-4f9c-409b-a294-5c2e29715dfb`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:33:40,702::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:33:40,702::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:33:40,702::task::1168::TaskManager.Task::(prepare) Task=`2576ede1-4f9c-409b-a294-5c2e29715dfb`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:33:40,702::task::579::TaskManager.Task::(_updateState) Task=`2576ede1-4f9c-409b-a294-5c2e29715dfb`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:33:40,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:33:40,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:33:40,703::task::974::TaskManager.Task::(_decref) Task=`2576ede1-4f9c-409b-a294-5c2e29715dfb`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:33:40,703::task::579::TaskManager.Task::(_updateState) Task=`3ce99107-52a3-41b1-87f2-b0f49fb2aa33`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:33:40,703::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:33:40,703::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:33:40,703::task::1168::TaskManager.Task::(prepare) Task=`3ce99107-52a3-41b1-87f2-b0f49fb2aa33`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:33:40,704::task::579::TaskManager.Task::(_updateState) Task=`3ce99107-52a3-41b1-87f2-b0f49fb2aa33`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:33:40,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:33:40,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:33:40,704::task::974::TaskManager.Task::(_decref) Task=`3ce99107-52a3-41b1-87f2-b0f49fb2aa33`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:41,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:33:41,285::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:33:41,285::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:33:41,285::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:41,685::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:42,286::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:43,287::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:33:43,287::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:43,687::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:43,690::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:33:43,690::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:33:43,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:44,288::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:45,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:45,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:33:45,958::task::579::TaskManager.Task::(_updateState) Task=`4461fb86-f4ea-47d6-8301-0bca4c411baa`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:33:45,958::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:33:45,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:33:45,959::task::1168::TaskManager.Task::(prepare) Task=`4461fb86-f4ea-47d6-8301-0bca4c411baa`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:33:45,959::task::579::TaskManager.Task::(_updateState) Task=`4461fb86-f4ea-47d6-8301-0bca4c411baa`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:33:45,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:33:45,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:33:45,959::task::974::TaskManager.Task::(_decref) Task=`4461fb86-f4ea-47d6-8301-0bca4c411baa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:46,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:33:46,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:33:46,712::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000282667 s, 14.5 MB/s\n'; <rc> = 0 >Thread-286758::DEBUG::2014-01-16 16:33:46,806::task::579::TaskManager.Task::(_updateState) Task=`a58189cb-6b4c-441c-94c1-9f1cb3d74297`::moving from state init -> state preparing >Thread-286758::INFO::2014-01-16 16:33:46,807::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286758::INFO::2014-01-16 16:33:46,807::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268292', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282667', 'lastCheck': '0.1', 'valid': True}} >Thread-286758::DEBUG::2014-01-16 16:33:46,807::task::1168::TaskManager.Task::(prepare) Task=`a58189cb-6b4c-441c-94c1-9f1cb3d74297`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268292', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282667', 'lastCheck': '0.1', 'valid': True}} >Thread-286758::DEBUG::2014-01-16 16:33:46,807::task::579::TaskManager.Task::(_updateState) Task=`a58189cb-6b4c-441c-94c1-9f1cb3d74297`::moving from state preparing -> state finished >Thread-286758::DEBUG::2014-01-16 16:33:46,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286758::DEBUG::2014-01-16 16:33:46,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286758::DEBUG::2014-01-16 16:33:46,808::task::974::TaskManager.Task::(_decref) Task=`a58189cb-6b4c-441c-94c1-9f1cb3d74297`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:47,292::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:47,696::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:33:48,274::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:33:48,291::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000427483 s, 854 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:33:48,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:48,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:49,295::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:33:49,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:49,699::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:50,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:33:50,315::task::579::TaskManager.Task::(_updateState) Task=`0a5960e3-b4ab-4e34-87fe-0abc3e5b0137`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:33:50,315::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:33:50,316::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:33:50,316::task::1168::TaskManager.Task::(prepare) Task=`0a5960e3-b4ab-4e34-87fe-0abc3e5b0137`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:33:50,316::task::579::TaskManager.Task::(_updateState) Task=`0a5960e3-b4ab-4e34-87fe-0abc3e5b0137`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:33:50,316::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:33:50,316::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:33:50,316::task::974::TaskManager.Task::(_decref) Task=`0a5960e3-b4ab-4e34-87fe-0abc3e5b0137`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:51,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:51,701::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:52,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:53,300::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:53,702::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:33:53,704::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:54,301::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:33:54,301::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:33:54,301::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:33:55,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:33:55,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:55,705::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:56,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:33:56,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:33:56,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:33:56,717::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:33:56,754::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000239691 s, 17.1 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:33:57,099::task::579::TaskManager.Task::(_updateState) Task=`42e1d3a1-5f96-4a1c-8c4c-f999c7fe4442`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:33:57,100::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:33:57,100::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:33:57,101::task::1168::TaskManager.Task::(prepare) Task=`42e1d3a1-5f96-4a1c-8c4c-f999c7fe4442`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:33:57,101::task::579::TaskManager.Task::(_updateState) Task=`42e1d3a1-5f96-4a1c-8c4c-f999c7fe4442`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:33:57,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:33:57,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:33:57,101::task::974::TaskManager.Task::(_decref) Task=`42e1d3a1-5f96-4a1c-8c4c-f999c7fe4442`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:33:57,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:33:57,305::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:57,707::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:33:58,298::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:33:58,312::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:33:58,314::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:33:58,316::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000324128 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:33:58,709::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:33:58,709::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:33:58,711::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:33:59,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:33:59,713::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:33:59,911::task::579::TaskManager.Task::(_updateState) Task=`3f08c0fd-1dde-4791-90f0-1850d8becc67`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:33:59,912::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:33:59,912::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:33:59,912::task::1168::TaskManager.Task::(prepare) Task=`3f08c0fd-1dde-4791-90f0-1850d8becc67`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:33:59,912::task::579::TaskManager.Task::(_updateState) Task=`3f08c0fd-1dde-4791-90f0-1850d8becc67`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:33:59,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:33:59,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:33:59,913::task::974::TaskManager.Task::(_decref) Task=`3f08c0fd-1dde-4791-90f0-1850d8becc67`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:33:59,913::task::579::TaskManager.Task::(_updateState) Task=`84ccbf1d-fb7f-4dc7-8c85-aa90db9ce49f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:33:59,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:33:59,914::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:33:59,914::task::1168::TaskManager.Task::(prepare) Task=`84ccbf1d-fb7f-4dc7-8c85-aa90db9ce49f`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:33:59,914::task::579::TaskManager.Task::(_updateState) Task=`84ccbf1d-fb7f-4dc7-8c85-aa90db9ce49f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:33:59,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:33:59,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:33:59,915::task::974::TaskManager.Task::(_decref) Task=`84ccbf1d-fb7f-4dc7-8c85-aa90db9ce49f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:33:59,915::task::579::TaskManager.Task::(_updateState) Task=`fa690885-4434-4932-9e5a-a630cea99ce2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:33:59,915::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:33:59,915::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:33:59,915::task::1168::TaskManager.Task::(prepare) Task=`fa690885-4434-4932-9e5a-a630cea99ce2`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:33:59,916::task::579::TaskManager.Task::(_updateState) Task=`fa690885-4434-4932-9e5a-a630cea99ce2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:33:59,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:33:59,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:33:59,916::task::974::TaskManager.Task::(_decref) Task=`fa690885-4434-4932-9e5a-a630cea99ce2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:00,318::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:34:00,318::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:01,320::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:34:01,320::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:01,714::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:34:02,045::task::579::TaskManager.Task::(_updateState) Task=`1eb6693e-7efb-402d-bfd0-1d63e4a036f7`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:34:02,045::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:34:02,046::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:34:02,046::task::1168::TaskManager.Task::(prepare) Task=`1eb6693e-7efb-402d-bfd0-1d63e4a036f7`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:34:02,046::task::579::TaskManager.Task::(_updateState) Task=`1eb6693e-7efb-402d-bfd0-1d63e4a036f7`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:34:02,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:34:02,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:34:02,046::task::974::TaskManager.Task::(_decref) Task=`1eb6693e-7efb-402d-bfd0-1d63e4a036f7`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:34:02,047::task::579::TaskManager.Task::(_updateState) Task=`ee8f1741-629d-498a-ab14-eca0e2b8d27a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:34:02,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:34:02,047::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:34:02,047::task::1168::TaskManager.Task::(prepare) Task=`ee8f1741-629d-498a-ab14-eca0e2b8d27a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:34:02,047::task::579::TaskManager.Task::(_updateState) Task=`ee8f1741-629d-498a-ab14-eca0e2b8d27a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:34:02,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:34:02,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:34:02,048::task::974::TaskManager.Task::(_decref) Task=`ee8f1741-629d-498a-ab14-eca0e2b8d27a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:02,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:34:02,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:34:02,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:34:02,322::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286764::DEBUG::2014-01-16 16:34:02,866::task::579::TaskManager.Task::(_updateState) Task=`b9cd66fd-5b5f-4e4f-b580-6fcb11c39b20`::moving from state init -> state preparing >Thread-286764::INFO::2014-01-16 16:34:02,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286764::INFO::2014-01-16 16:34:02,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324128', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239691', 'lastCheck': '6.1', 'valid': True}} >Thread-286764::DEBUG::2014-01-16 16:34:02,867::task::1168::TaskManager.Task::(prepare) Task=`b9cd66fd-5b5f-4e4f-b580-6fcb11c39b20`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324128', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239691', 'lastCheck': '6.1', 'valid': True}} >Thread-286764::DEBUG::2014-01-16 16:34:02,867::task::579::TaskManager.Task::(_updateState) Task=`b9cd66fd-5b5f-4e4f-b580-6fcb11c39b20`::moving from state preparing -> state finished >Thread-286764::DEBUG::2014-01-16 16:34:02,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286764::DEBUG::2014-01-16 16:34:02,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286764::DEBUG::2014-01-16 16:34:02,867::task::974::TaskManager.Task::(_decref) Task=`b9cd66fd-5b5f-4e4f-b580-6fcb11c39b20`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:03,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:34:03,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:34:03,324::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:03,716::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:03,717::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:34:04,169::task::579::TaskManager.Task::(_updateState) Task=`34f6d86f-a1ef-46e9-be0b-c52289763bd0`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:34:04,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:34:04,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:34:04,170::task::1168::TaskManager.Task::(prepare) Task=`34f6d86f-a1ef-46e9-be0b-c52289763bd0`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:34:04,170::task::579::TaskManager.Task::(_updateState) Task=`34f6d86f-a1ef-46e9-be0b-c52289763bd0`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:34:04,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:34:04,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:34:04,170::task::974::TaskManager.Task::(_decref) Task=`34f6d86f-a1ef-46e9-be0b-c52289763bd0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:04,325::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:34:04,325::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:34:05,090::task::579::TaskManager.Task::(_updateState) Task=`efef2a3a-0ac4-40ed-80fe-449320897f40`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:34:05,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:34:05,090::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:34:05,091::task::1168::TaskManager.Task::(prepare) Task=`efef2a3a-0ac4-40ed-80fe-449320897f40`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:34:05,091::task::579::TaskManager.Task::(_updateState) Task=`efef2a3a-0ac4-40ed-80fe-449320897f40`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:34:05,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:34:05,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:34:05,091::task::974::TaskManager.Task::(_decref) Task=`efef2a3a-0ac4-40ed-80fe-449320897f40`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:34:05,099::task::579::TaskManager.Task::(_updateState) Task=`74a9c4f3-01e4-4d09-8664-0faa458ad413`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:34:05,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:34:05,099::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:34:05,100::task::1168::TaskManager.Task::(prepare) Task=`74a9c4f3-01e4-4d09-8664-0faa458ad413`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:34:05,100::task::579::TaskManager.Task::(_updateState) Task=`74a9c4f3-01e4-4d09-8664-0faa458ad413`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:34:05,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:34:05,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:34:05,100::task::974::TaskManager.Task::(_decref) Task=`74a9c4f3-01e4-4d09-8664-0faa458ad413`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:05,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:34:05,327::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:34:05,327::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:34:05,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:05,718::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:06,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:34:06,512::task::579::TaskManager.Task::(_updateState) Task=`ca2220f5-7d48-454f-a5bc-4a55dbb609f1`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:34:06,512::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:34:06,513::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:34:06,513::task::1168::TaskManager.Task::(prepare) Task=`ca2220f5-7d48-454f-a5bc-4a55dbb609f1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:34:06,513::task::579::TaskManager.Task::(_updateState) Task=`ca2220f5-7d48-454f-a5bc-4a55dbb609f1`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:34:06,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:34:06,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:34:06,514::task::974::TaskManager.Task::(_decref) Task=`ca2220f5-7d48-454f-a5bc-4a55dbb609f1`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:34:06,514::task::579::TaskManager.Task::(_updateState) Task=`840fad9e-3b89-43ff-acae-6ba908b9da8f`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:34:06,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:34:06,515::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:34:06,515::task::1168::TaskManager.Task::(prepare) Task=`840fad9e-3b89-43ff-acae-6ba908b9da8f`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:34:06,515::task::579::TaskManager.Task::(_updateState) Task=`840fad9e-3b89-43ff-acae-6ba908b9da8f`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:34:06,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:34:06,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:34:06,515::task::974::TaskManager.Task::(_decref) Task=`840fad9e-3b89-43ff-acae-6ba908b9da8f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:34:06,760::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:34:06,778::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000225748 s, 18.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:34:07,329::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:34:07,329::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:34:07,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:34:07,330::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:07,330::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:34:07,330::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:34:07,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:34:08,135::task::579::TaskManager.Task::(_updateState) Task=`baf746bb-658c-4738-b464-9cd843a6edd0`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:34:08,135::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:34:08,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:34:08,136::task::1168::TaskManager.Task::(prepare) Task=`baf746bb-658c-4738-b464-9cd843a6edd0`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:34:08,136::task::579::TaskManager.Task::(_updateState) Task=`baf746bb-658c-4738-b464-9cd843a6edd0`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:34:08,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:34:08,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:34:08,136::task::974::TaskManager.Task::(_decref) Task=`baf746bb-658c-4738-b464-9cd843a6edd0`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:34:08,136::task::579::TaskManager.Task::(_updateState) Task=`f342ba59-271b-41ec-a644-29d51e68aa62`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:34:08,137::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:34:08,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:34:08,137::task::1168::TaskManager.Task::(prepare) Task=`f342ba59-271b-41ec-a644-29d51e68aa62`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:34:08,137::task::579::TaskManager.Task::(_updateState) Task=`f342ba59-271b-41ec-a644-29d51e68aa62`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:34:08,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:34:08,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:34:08,138::task::974::TaskManager.Task::(_decref) Task=`f342ba59-271b-41ec-a644-29d51e68aa62`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:34:08,324::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:34:08,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:34:08,341::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000304761 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:34:08,350::task::579::TaskManager.Task::(_updateState) Task=`26d20c61-5bb2-45ac-a8b8-e48cc77e2973`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:34:08,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:34:08,351::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:34:08,351::task::1168::TaskManager.Task::(prepare) Task=`26d20c61-5bb2-45ac-a8b8-e48cc77e2973`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:34:08,351::task::579::TaskManager.Task::(_updateState) Task=`26d20c61-5bb2-45ac-a8b8-e48cc77e2973`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:34:08,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:34:08,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:34:08,352::task::974::TaskManager.Task::(_decref) Task=`26d20c61-5bb2-45ac-a8b8-e48cc77e2973`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:34:08,438::task::579::TaskManager.Task::(_updateState) Task=`c7a90ad7-c347-448e-aeef-3094749ae69d`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:34:08,438::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:34:08,438::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:34:08,438::task::1168::TaskManager.Task::(prepare) Task=`c7a90ad7-c347-448e-aeef-3094749ae69d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:34:08,439::task::579::TaskManager.Task::(_updateState) Task=`c7a90ad7-c347-448e-aeef-3094749ae69d`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:34:08,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:34:08,439::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:34:08,439::task::974::TaskManager.Task::(_decref) Task=`c7a90ad7-c347-448e-aeef-3094749ae69d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:34:08,722::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:09,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:34:09,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:34:09,341::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:34:09,604::task::579::TaskManager.Task::(_updateState) Task=`784a5de2-fae4-4aa6-a20d-303d9a629676`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:34:09,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:34:09,605::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:34:09,605::task::1168::TaskManager.Task::(prepare) Task=`784a5de2-fae4-4aa6-a20d-303d9a629676`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:34:09,605::task::579::TaskManager.Task::(_updateState) Task=`784a5de2-fae4-4aa6-a20d-303d9a629676`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:34:09,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:34:09,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:34:09,605::task::974::TaskManager.Task::(_decref) Task=`784a5de2-fae4-4aa6-a20d-303d9a629676`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:34:09,723::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:10,342::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:34:10,342::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:34:10,342::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:34:10,646::task::579::TaskManager.Task::(_updateState) Task=`239aa2a7-7e7a-4df3-974e-20169e7e355e`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:34:10,647::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:34:10,647::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:34:10,647::task::1168::TaskManager.Task::(prepare) Task=`239aa2a7-7e7a-4df3-974e-20169e7e355e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:34:10,647::task::579::TaskManager.Task::(_updateState) Task=`239aa2a7-7e7a-4df3-974e-20169e7e355e`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:34:10,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:34:10,648::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:34:10,648::task::974::TaskManager.Task::(_decref) Task=`239aa2a7-7e7a-4df3-974e-20169e7e355e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:11,343::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:34:11,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:34:11,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:34:11,344::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:11,725::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:12,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:13,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:34:13,346::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:13,726::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:13,727::task::579::TaskManager.Task::(_updateState) Task=`e01691b1-9a76-4b30-94aa-9e76c3173a1d`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:34:13,727::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:34:13,727::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:34:13,727::task::1168::TaskManager.Task::(prepare) Task=`e01691b1-9a76-4b30-94aa-9e76c3173a1d`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:34:13,727::task::579::TaskManager.Task::(_updateState) Task=`e01691b1-9a76-4b30-94aa-9e76c3173a1d`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:34:13,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:34:13,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:34:13,728::task::974::TaskManager.Task::(_decref) Task=`e01691b1-9a76-4b30-94aa-9e76c3173a1d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:34:13,729::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:34:13,730::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:34:13,731::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:13,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:13,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:34:13,761::task::579::TaskManager.Task::(_updateState) Task=`12164b55-aea6-48c8-b5af-402bb483221f`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:34:13,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:34:13,762::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:34:13,762::task::1168::TaskManager.Task::(prepare) Task=`12164b55-aea6-48c8-b5af-402bb483221f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:34:13,762::task::579::TaskManager.Task::(_updateState) Task=`12164b55-aea6-48c8-b5af-402bb483221f`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:34:13,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:34:13,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:34:13,763::task::974::TaskManager.Task::(_decref) Task=`12164b55-aea6-48c8-b5af-402bb483221f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:14,347::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:15,349::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:15,734::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:16,350::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:34:16,391::task::579::TaskManager.Task::(_updateState) Task=`107cb390-8e08-465c-931e-1adc7e58b57e`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:34:16,391::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:34:16,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:34:16,391::task::1168::TaskManager.Task::(prepare) Task=`107cb390-8e08-465c-931e-1adc7e58b57e`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:34:16,391::task::579::TaskManager.Task::(_updateState) Task=`107cb390-8e08-465c-931e-1adc7e58b57e`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:34:16,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:34:16,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:34:16,392::task::974::TaskManager.Task::(_decref) Task=`107cb390-8e08-465c-931e-1adc7e58b57e`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:34:16,784::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:34:16,803::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000201934 s, 20.3 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:34:17,144::task::579::TaskManager.Task::(_updateState) Task=`eb2f7bc8-c0bf-4f52-a33a-b8e376d61173`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:34:17,144::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:34:17,145::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:34:17,145::task::1168::TaskManager.Task::(prepare) Task=`eb2f7bc8-c0bf-4f52-a33a-b8e376d61173`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:34:17,145::task::579::TaskManager.Task::(_updateState) Task=`eb2f7bc8-c0bf-4f52-a33a-b8e376d61173`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:34:17,145::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:34:17,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:34:17,146::task::974::TaskManager.Task::(_decref) Task=`eb2f7bc8-c0bf-4f52-a33a-b8e376d61173`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:17,351::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:17,736::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:34:18,349::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:34:18,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:34:18,367::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290119 s, 1.3 MB/s\n'; <rc> = 0 >Thread-286770::DEBUG::2014-01-16 16:34:18,617::task::579::TaskManager.Task::(_updateState) Task=`fc0acf3c-c9de-495b-a985-65dbc021b5e7`::moving from state init -> state preparing >Thread-286770::INFO::2014-01-16 16:34:18,617::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286770::INFO::2014-01-16 16:34:18,617::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290119', 'lastCheck': '0.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201934', 'lastCheck': '1.8', 'valid': True}} >Thread-286770::DEBUG::2014-01-16 16:34:18,618::task::1168::TaskManager.Task::(prepare) Task=`fc0acf3c-c9de-495b-a985-65dbc021b5e7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290119', 'lastCheck': '0.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201934', 'lastCheck': '1.8', 'valid': True}} >Thread-286770::DEBUG::2014-01-16 16:34:18,618::task::579::TaskManager.Task::(_updateState) Task=`fc0acf3c-c9de-495b-a985-65dbc021b5e7`::moving from state preparing -> state finished >Thread-286770::DEBUG::2014-01-16 16:34:18,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286770::DEBUG::2014-01-16 16:34:18,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286770::DEBUG::2014-01-16 16:34:18,618::task::974::TaskManager.Task::(_decref) Task=`fc0acf3c-c9de-495b-a985-65dbc021b5e7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:34:18,737::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:19,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:34:19,368::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:19,738::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:20,369::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:21,370::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:21,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:22,371::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:23,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:23,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:23,742::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:34:23,912::task::579::TaskManager.Task::(_updateState) Task=`4d74c2be-3643-4ad5-839b-de1958e0b699`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:34:23,919::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:34:23,919::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:34:23,919::task::1168::TaskManager.Task::(prepare) Task=`4d74c2be-3643-4ad5-839b-de1958e0b699`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:34:23,919::task::579::TaskManager.Task::(_updateState) Task=`4d74c2be-3643-4ad5-839b-de1958e0b699`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:34:23,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:34:23,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:34:23,920::task::974::TaskManager.Task::(_decref) Task=`4d74c2be-3643-4ad5-839b-de1958e0b699`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:34:23,920::task::579::TaskManager.Task::(_updateState) Task=`1482862c-05c4-44ef-b1ac-df7b16850870`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:34:23,920::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:34:23,920::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:34:23,920::task::1168::TaskManager.Task::(prepare) Task=`1482862c-05c4-44ef-b1ac-df7b16850870`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:34:23,921::task::579::TaskManager.Task::(_updateState) Task=`1482862c-05c4-44ef-b1ac-df7b16850870`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:34:23,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:34:23,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:34:23,921::task::974::TaskManager.Task::(_decref) Task=`1482862c-05c4-44ef-b1ac-df7b16850870`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:24,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:34:24,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:34:24,374::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:34:24,650::task::579::TaskManager.Task::(_updateState) Task=`4bf6073a-0dbd-40c1-b55e-a3e33915e59c`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:34:24,650::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:34:24,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:34:24,652::task::1168::TaskManager.Task::(prepare) Task=`4bf6073a-0dbd-40c1-b55e-a3e33915e59c`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:34:24,652::task::579::TaskManager.Task::(_updateState) Task=`4bf6073a-0dbd-40c1-b55e-a3e33915e59c`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:34:24,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:34:24,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:34:24,652::task::974::TaskManager.Task::(_decref) Task=`4bf6073a-0dbd-40c1-b55e-a3e33915e59c`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:34:25,234::task::579::TaskManager.Task::(_updateState) Task=`09c3304c-d756-44b8-9eb4-e6e917e039c7`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:34:25,234::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:34:25,235::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:34:25,235::task::1168::TaskManager.Task::(prepare) Task=`09c3304c-d756-44b8-9eb4-e6e917e039c7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:34:25,235::task::579::TaskManager.Task::(_updateState) Task=`09c3304c-d756-44b8-9eb4-e6e917e039c7`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:34:25,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:34:25,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:34:25,235::task::974::TaskManager.Task::(_decref) Task=`09c3304c-d756-44b8-9eb4-e6e917e039c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:25,375::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:34:25,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:25,743::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:26,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:34:26,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:34:26,377::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:34:26,810::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:34:26,828::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0002121 s, 19.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:34:27,378::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:34:27,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:27,745::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:34:28,375::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:34:28,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:34:28,391::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:34:28,392::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000283693 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:34:28,747::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:34:28,747::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:34:28,754::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:34:28,834::task::579::TaskManager.Task::(_updateState) Task=`7c50b696-81e6-40c1-a8f3-6d309c2b9766`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:34:28,834::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:34:28,835::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:34:28,835::task::1168::TaskManager.Task::(prepare) Task=`7c50b696-81e6-40c1-a8f3-6d309c2b9766`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:34:28,835::task::579::TaskManager.Task::(_updateState) Task=`7c50b696-81e6-40c1-a8f3-6d309c2b9766`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:34:28,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:34:28,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:34:28,836::task::974::TaskManager.Task::(_decref) Task=`7c50b696-81e6-40c1-a8f3-6d309c2b9766`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:34:28,845::task::579::TaskManager.Task::(_updateState) Task=`84c15eda-9572-4ddd-a021-12f83f801abf`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:34:28,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:34:28,846::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:34:28,846::task::1168::TaskManager.Task::(prepare) Task=`84c15eda-9572-4ddd-a021-12f83f801abf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:34:28,847::task::579::TaskManager.Task::(_updateState) Task=`84c15eda-9572-4ddd-a021-12f83f801abf`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:34:28,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:34:28,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:34:28,847::task::974::TaskManager.Task::(_decref) Task=`84c15eda-9572-4ddd-a021-12f83f801abf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:29,392::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:29,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:30,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:34:30,394::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:31,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:34:31,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:31,756::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:32,396::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:34:32,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:34:32,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:34:32,397::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:33,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:34:33,399::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:34:33,399::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:33,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:33,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:34:33,834::task::579::TaskManager.Task::(_updateState) Task=`2db9a61b-ba07-4c0c-8791-f98c1fe94d44`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:34:33,834::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:34:33,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:34:33,834::task::1168::TaskManager.Task::(prepare) Task=`2db9a61b-ba07-4c0c-8791-f98c1fe94d44`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:34:33,834::task::579::TaskManager.Task::(_updateState) Task=`2db9a61b-ba07-4c0c-8791-f98c1fe94d44`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:34:33,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:34:33,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:34:33,835::task::974::TaskManager.Task::(_decref) Task=`2db9a61b-ba07-4c0c-8791-f98c1fe94d44`::ref 0 aborting False >Thread-286776::DEBUG::2014-01-16 16:34:34,363::task::579::TaskManager.Task::(_updateState) Task=`ac2ca9a8-1d1d-4d8b-99d9-d7025cd908bb`::moving from state init -> state preparing >Thread-286776::INFO::2014-01-16 16:34:34,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286776::INFO::2014-01-16 16:34:34,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283693', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002121', 'lastCheck': '7.5', 'valid': True}} >Thread-286776::DEBUG::2014-01-16 16:34:34,363::task::1168::TaskManager.Task::(prepare) Task=`ac2ca9a8-1d1d-4d8b-99d9-d7025cd908bb`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283693', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002121', 'lastCheck': '7.5', 'valid': True}} >Thread-286776::DEBUG::2014-01-16 16:34:34,363::task::579::TaskManager.Task::(_updateState) Task=`ac2ca9a8-1d1d-4d8b-99d9-d7025cd908bb`::moving from state preparing -> state finished >Thread-286776::DEBUG::2014-01-16 16:34:34,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286776::DEBUG::2014-01-16 16:34:34,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286776::DEBUG::2014-01-16 16:34:34,364::task::974::TaskManager.Task::(_decref) Task=`ac2ca9a8-1d1d-4d8b-99d9-d7025cd908bb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:34,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:34:34,400::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:35,401::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:34:35,401::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:34:35,402::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:34:35,402::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:35,760::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:34:36,347::task::579::TaskManager.Task::(_updateState) Task=`b1d685b8-5ca9-4704-83ea-ef872a5a42b0`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:34:36,347::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:34:36,348::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:34:36,348::task::1168::TaskManager.Task::(prepare) Task=`b1d685b8-5ca9-4704-83ea-ef872a5a42b0`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:34:36,348::task::579::TaskManager.Task::(_updateState) Task=`b1d685b8-5ca9-4704-83ea-ef872a5a42b0`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:34:36,348::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:34:36,348::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:34:36,348::task::974::TaskManager.Task::(_decref) Task=`b1d685b8-5ca9-4704-83ea-ef872a5a42b0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:36,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:34:36,834::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:34:36,851::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000222508 s, 18.4 MB/s\n'; <rc> = 0 >Thread-16393::DEBUG::2014-01-16 16:34:37,142::task::579::TaskManager.Task::(_updateState) Task=`3497994c-56fb-4a6f-b1e3-7c1de1ae81a3`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:34:37,142::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:34:37,143::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:34:37,143::task::1168::TaskManager.Task::(prepare) Task=`3497994c-56fb-4a6f-b1e3-7c1de1ae81a3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:34:37,143::task::579::TaskManager.Task::(_updateState) Task=`3497994c-56fb-4a6f-b1e3-7c1de1ae81a3`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:34:37,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:34:37,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:34:37,143::task::974::TaskManager.Task::(_decref) Task=`3497994c-56fb-4a6f-b1e3-7c1de1ae81a3`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:34:37,184::task::579::TaskManager.Task::(_updateState) Task=`2474ced5-c8d5-4d60-b845-ab08757c25bb`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:34:37,184::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:34:37,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:34:37,184::task::1168::TaskManager.Task::(prepare) Task=`2474ced5-c8d5-4d60-b845-ab08757c25bb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:34:37,184::task::579::TaskManager.Task::(_updateState) Task=`2474ced5-c8d5-4d60-b845-ab08757c25bb`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:34:37,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:34:37,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:34:37,185::task::974::TaskManager.Task::(_decref) Task=`2474ced5-c8d5-4d60-b845-ab08757c25bb`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:34:37,284::task::579::TaskManager.Task::(_updateState) Task=`8fa72366-8536-463f-8ce4-20705015e5af`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:34:37,284::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:34:37,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:34:37,284::task::1168::TaskManager.Task::(prepare) Task=`8fa72366-8536-463f-8ce4-20705015e5af`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:34:37,284::task::579::TaskManager.Task::(_updateState) Task=`8fa72366-8536-463f-8ce4-20705015e5af`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:34:37,284::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:34:37,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:34:37,285::task::974::TaskManager.Task::(_decref) Task=`8fa72366-8536-463f-8ce4-20705015e5af`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:37,404::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:34:37,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:34:37,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:34:37,405::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:37,405::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:34:37,406::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:34:37,761::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:34:38,110::task::579::TaskManager.Task::(_updateState) Task=`67802b2a-22d0-4cfb-a127-a8150d36bde4`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:34:38,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:34:38,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:34:38,110::task::1168::TaskManager.Task::(prepare) Task=`67802b2a-22d0-4cfb-a127-a8150d36bde4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:34:38,111::task::579::TaskManager.Task::(_updateState) Task=`67802b2a-22d0-4cfb-a127-a8150d36bde4`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:34:38,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:34:38,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:34:38,111::task::974::TaskManager.Task::(_decref) Task=`67802b2a-22d0-4cfb-a127-a8150d36bde4`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:34:38,401::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:34:38,417::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:34:38,420::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00024946 s, 1.5 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:34:38,423::task::579::TaskManager.Task::(_updateState) Task=`1690502d-bdc6-4732-b35b-47dc45af2391`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:34:38,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:34:38,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:34:38,427::task::1168::TaskManager.Task::(prepare) Task=`1690502d-bdc6-4732-b35b-47dc45af2391`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:34:38,427::task::579::TaskManager.Task::(_updateState) Task=`1690502d-bdc6-4732-b35b-47dc45af2391`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:34:38,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:34:38,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:34:38,428::task::974::TaskManager.Task::(_decref) Task=`1690502d-bdc6-4732-b35b-47dc45af2391`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:34:38,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:39,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:34:39,420::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:34:39,420::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:39,764::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:40,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:34:40,422::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:34:40,422::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:34:40,978::task::579::TaskManager.Task::(_updateState) Task=`b52bcb12-147a-41d0-b32b-62c3f057a847`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:34:40,979::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:34:40,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:34:40,979::task::1168::TaskManager.Task::(prepare) Task=`b52bcb12-147a-41d0-b32b-62c3f057a847`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:34:40,979::task::579::TaskManager.Task::(_updateState) Task=`b52bcb12-147a-41d0-b32b-62c3f057a847`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:34:40,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:34:40,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:34:40,980::task::974::TaskManager.Task::(_decref) Task=`b52bcb12-147a-41d0-b32b-62c3f057a847`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:34:40,980::task::579::TaskManager.Task::(_updateState) Task=`b65a5071-d8fa-4e19-ae4f-c9711e35c251`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:34:40,980::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:34:40,981::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:34:40,981::task::1168::TaskManager.Task::(prepare) Task=`b65a5071-d8fa-4e19-ae4f-c9711e35c251`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:34:40,981::task::579::TaskManager.Task::(_updateState) Task=`b65a5071-d8fa-4e19-ae4f-c9711e35c251`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:34:40,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:34:40,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:34:40,981::task::974::TaskManager.Task::(_decref) Task=`b65a5071-d8fa-4e19-ae4f-c9711e35c251`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:34:40,981::task::579::TaskManager.Task::(_updateState) Task=`00c3596b-185f-46d0-874e-1f2148f337fb`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:34:40,982::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:34:40,982::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:34:40,982::task::1168::TaskManager.Task::(prepare) Task=`00c3596b-185f-46d0-874e-1f2148f337fb`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:34:40,982::task::579::TaskManager.Task::(_updateState) Task=`00c3596b-185f-46d0-874e-1f2148f337fb`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:34:40,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:34:40,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:34:40,982::task::974::TaskManager.Task::(_decref) Task=`00c3596b-185f-46d0-874e-1f2148f337fb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:41,423::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:34:41,423::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:34:41,423::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:34:41,423::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:41,765::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:42,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:43,426::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:34:43,426::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:43,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:43,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:34:43,768::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:34:43,769::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:44,427::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:45,428::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:45,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:34:46,127::task::579::TaskManager.Task::(_updateState) Task=`fa1362f8-2a5c-4fc0-aba9-2fe8ef02d7ee`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:34:46,127::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:34:46,128::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:34:46,128::task::1168::TaskManager.Task::(prepare) Task=`fa1362f8-2a5c-4fc0-aba9-2fe8ef02d7ee`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:34:46,128::task::579::TaskManager.Task::(_updateState) Task=`fa1362f8-2a5c-4fc0-aba9-2fe8ef02d7ee`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:34:46,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:34:46,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:34:46,128::task::974::TaskManager.Task::(_decref) Task=`fa1362f8-2a5c-4fc0-aba9-2fe8ef02d7ee`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:46,429::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:34:46,856::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:34:46,874::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000203133 s, 20.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:34:47,430::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:47,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:48,432::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:34:48,436::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:34:48,453::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286111 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:34:48,773::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:49,435::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:34:49,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:49,774::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286782::DEBUG::2014-01-16 16:34:50,176::task::579::TaskManager.Task::(_updateState) Task=`32f22599-48bd-487f-a1b1-2454c7aec448`::moving from state init -> state preparing >Thread-286782::INFO::2014-01-16 16:34:50,177::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286782::INFO::2014-01-16 16:34:50,177::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286111', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000203133', 'lastCheck': '3.3', 'valid': True}} >Thread-286782::DEBUG::2014-01-16 16:34:50,177::task::1168::TaskManager.Task::(prepare) Task=`32f22599-48bd-487f-a1b1-2454c7aec448`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286111', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000203133', 'lastCheck': '3.3', 'valid': True}} >Thread-286782::DEBUG::2014-01-16 16:34:50,177::task::579::TaskManager.Task::(_updateState) Task=`32f22599-48bd-487f-a1b1-2454c7aec448`::moving from state preparing -> state finished >Thread-286782::DEBUG::2014-01-16 16:34:50,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286782::DEBUG::2014-01-16 16:34:50,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286782::DEBUG::2014-01-16 16:34:50,178::task::974::TaskManager.Task::(_decref) Task=`32f22599-48bd-487f-a1b1-2454c7aec448`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:50,437::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:34:50,496::task::579::TaskManager.Task::(_updateState) Task=`b676d872-6342-42d5-afe6-07e7dbc07bba`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:34:50,496::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:34:50,496::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:34:50,497::task::1168::TaskManager.Task::(prepare) Task=`b676d872-6342-42d5-afe6-07e7dbc07bba`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-221160::DEBUG::2014-01-16 16:34:50,497::task::579::TaskManager.Task::(_updateState) Task=`b676d872-6342-42d5-afe6-07e7dbc07bba`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:34:50,497::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:34:50,497::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:34:50,497::task::974::TaskManager.Task::(_decref) Task=`b676d872-6342-42d5-afe6-07e7dbc07bba`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:51,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:51,776::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:52,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:53,441::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:53,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:34:53,778::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:54,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:34:54,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:34:54,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:34:55,443::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:34:55,443::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:55,779::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:56,443::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:34:56,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:34:56,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:34:56,880::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:34:56,899::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000329787 s, 12.4 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:34:57,274::task::579::TaskManager.Task::(_updateState) Task=`345f15cf-78a8-4403-80bc-21c904e16082`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:34:57,274::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:34:57,274::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:34:57,275::task::1168::TaskManager.Task::(prepare) Task=`345f15cf-78a8-4403-80bc-21c904e16082`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:34:57,275::task::579::TaskManager.Task::(_updateState) Task=`345f15cf-78a8-4403-80bc-21c904e16082`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:34:57,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:34:57,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:34:57,275::task::974::TaskManager.Task::(_decref) Task=`345f15cf-78a8-4403-80bc-21c904e16082`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:34:57,445::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:34:57,445::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:57,781::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:58,446::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:34:58,446::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:34:58,462::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:34:58,479::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271133 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:34:58,783::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:34:58,783::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:34:58,784::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:34:59,448::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:34:59,786::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:00,449::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:35:00,449::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:35:00,498::task::579::TaskManager.Task::(_updateState) Task=`7f96f116-e00f-4608-b5f8-13303f7f300f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:35:00,498::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:35:00,499::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:35:00,499::task::1168::TaskManager.Task::(prepare) Task=`7f96f116-e00f-4608-b5f8-13303f7f300f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:35:00,499::task::579::TaskManager.Task::(_updateState) Task=`7f96f116-e00f-4608-b5f8-13303f7f300f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:35:00,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:35:00,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:35:00,499::task::974::TaskManager.Task::(_decref) Task=`7f96f116-e00f-4608-b5f8-13303f7f300f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:35:00,500::task::579::TaskManager.Task::(_updateState) Task=`8e7492c3-4453-4fca-9d90-69ed2d2715d5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:35:00,500::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:35:00,500::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:35:00,500::task::1168::TaskManager.Task::(prepare) Task=`8e7492c3-4453-4fca-9d90-69ed2d2715d5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:35:00,501::task::579::TaskManager.Task::(_updateState) Task=`8e7492c3-4453-4fca-9d90-69ed2d2715d5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:35:00,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:35:00,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:35:00,501::task::974::TaskManager.Task::(_decref) Task=`8e7492c3-4453-4fca-9d90-69ed2d2715d5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:35:00,501::task::579::TaskManager.Task::(_updateState) Task=`bbf88498-90ca-435f-ae71-ddda8b729176`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:35:00,502::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:35:00,502::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:35:00,502::task::1168::TaskManager.Task::(prepare) Task=`bbf88498-90ca-435f-ae71-ddda8b729176`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:35:00,502::task::579::TaskManager.Task::(_updateState) Task=`bbf88498-90ca-435f-ae71-ddda8b729176`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:35:00,502::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:35:00,502::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:35:00,502::task::974::TaskManager.Task::(_decref) Task=`bbf88498-90ca-435f-ae71-ddda8b729176`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:01,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:35:01,451::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:01,787::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:35:02,288::task::579::TaskManager.Task::(_updateState) Task=`fb564a1c-91d1-441c-a238-1b6884de89c7`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:35:02,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:35:02,288::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:35:02,288::task::1168::TaskManager.Task::(prepare) Task=`fb564a1c-91d1-441c-a238-1b6884de89c7`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:35:02,289::task::579::TaskManager.Task::(_updateState) Task=`fb564a1c-91d1-441c-a238-1b6884de89c7`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:35:02,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:35:02,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:35:02,289::task::974::TaskManager.Task::(_decref) Task=`fb564a1c-91d1-441c-a238-1b6884de89c7`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:35:02,289::task::579::TaskManager.Task::(_updateState) Task=`2ad1b64b-3dfe-4eed-a5b0-b6bf2ea4db21`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:35:02,289::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:35:02,290::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:35:02,290::task::1168::TaskManager.Task::(prepare) Task=`2ad1b64b-3dfe-4eed-a5b0-b6bf2ea4db21`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:35:02,290::task::579::TaskManager.Task::(_updateState) Task=`2ad1b64b-3dfe-4eed-a5b0-b6bf2ea4db21`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:35:02,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:35:02,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:35:02,290::task::974::TaskManager.Task::(_decref) Task=`2ad1b64b-3dfe-4eed-a5b0-b6bf2ea4db21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:02,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:35:02,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:35:02,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:35:02,453::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:03,454::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:35:03,454::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:35:03,454::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:03,788::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:03,789::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:35:04,344::task::579::TaskManager.Task::(_updateState) Task=`eec5155d-5b30-4821-adaa-b607691fd06b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:35:04,345::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:35:04,345::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:35:04,345::task::1168::TaskManager.Task::(prepare) Task=`eec5155d-5b30-4821-adaa-b607691fd06b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:35:04,345::task::579::TaskManager.Task::(_updateState) Task=`eec5155d-5b30-4821-adaa-b607691fd06b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:35:04,345::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:35:04,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:35:04,346::task::974::TaskManager.Task::(_decref) Task=`eec5155d-5b30-4821-adaa-b607691fd06b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:04,455::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:35:04,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:35:05,165::task::579::TaskManager.Task::(_updateState) Task=`50ad5f80-236c-484f-9a8d-2dad1ac33f70`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:35:05,166::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:35:05,167::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:35:05,167::task::1168::TaskManager.Task::(prepare) Task=`50ad5f80-236c-484f-9a8d-2dad1ac33f70`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:35:05,167::task::579::TaskManager.Task::(_updateState) Task=`50ad5f80-236c-484f-9a8d-2dad1ac33f70`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:35:05,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:35:05,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:35:05,168::task::974::TaskManager.Task::(_decref) Task=`50ad5f80-236c-484f-9a8d-2dad1ac33f70`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:35:05,174::task::579::TaskManager.Task::(_updateState) Task=`c1e9af88-1602-4f0c-8900-6c9249f18934`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:35:05,174::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:35:05,175::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:35:05,175::task::1168::TaskManager.Task::(prepare) Task=`c1e9af88-1602-4f0c-8900-6c9249f18934`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:35:05,175::task::579::TaskManager.Task::(_updateState) Task=`c1e9af88-1602-4f0c-8900-6c9249f18934`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:35:05,175::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:35:05,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:35:05,176::task::974::TaskManager.Task::(_decref) Task=`c1e9af88-1602-4f0c-8900-6c9249f18934`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:05,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:35:05,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:35:05,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:35:05,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:05,790::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286788::DEBUG::2014-01-16 16:35:05,953::task::579::TaskManager.Task::(_updateState) Task=`4968c228-78c8-44d7-83af-a751cce7ea7a`::moving from state init -> state preparing >Thread-286788::INFO::2014-01-16 16:35:05,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286788::INFO::2014-01-16 16:35:05,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271133', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329787', 'lastCheck': '9.1', 'valid': True}} >Thread-286788::DEBUG::2014-01-16 16:35:05,954::task::1168::TaskManager.Task::(prepare) Task=`4968c228-78c8-44d7-83af-a751cce7ea7a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271133', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329787', 'lastCheck': '9.1', 'valid': True}} >Thread-286788::DEBUG::2014-01-16 16:35:05,954::task::579::TaskManager.Task::(_updateState) Task=`4968c228-78c8-44d7-83af-a751cce7ea7a`::moving from state preparing -> state finished >Thread-286788::DEBUG::2014-01-16 16:35:05,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286788::DEBUG::2014-01-16 16:35:05,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286788::DEBUG::2014-01-16 16:35:05,954::task::974::TaskManager.Task::(_decref) Task=`4968c228-78c8-44d7-83af-a751cce7ea7a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:06,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:35:06,602::task::579::TaskManager.Task::(_updateState) Task=`6660c255-cb6a-4e95-beac-4bc3e3c97077`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:35:06,602::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:35:06,602::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:35:06,602::task::1168::TaskManager.Task::(prepare) Task=`6660c255-cb6a-4e95-beac-4bc3e3c97077`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:35:06,603::task::579::TaskManager.Task::(_updateState) Task=`6660c255-cb6a-4e95-beac-4bc3e3c97077`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:35:06,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:35:06,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:35:06,603::task::974::TaskManager.Task::(_decref) Task=`6660c255-cb6a-4e95-beac-4bc3e3c97077`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:35:06,603::task::579::TaskManager.Task::(_updateState) Task=`27fb0616-2cfc-4bda-9f75-8b7bec4edc49`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:35:06,603::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:35:06,604::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:35:06,604::task::1168::TaskManager.Task::(prepare) Task=`27fb0616-2cfc-4bda-9f75-8b7bec4edc49`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:35:06,604::task::579::TaskManager.Task::(_updateState) Task=`27fb0616-2cfc-4bda-9f75-8b7bec4edc49`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:35:06,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:35:06,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:35:06,604::task::974::TaskManager.Task::(_decref) Task=`27fb0616-2cfc-4bda-9f75-8b7bec4edc49`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:35:06,903::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:35:06,903::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:35:06,903::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:35:06,903::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:35:06,906::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:06,923::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00019506 s, 10.5 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:35:06,923::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00019506 s, 10.5 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:35:06,924::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:35:06,924::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:35:06,924::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:35:06,924::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:35:06,925::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:35:06,925::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:35:06,925::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:35:06,925::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:35:06,926::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:07,154::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:35:07,157::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:35:07,158::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:35:07,159::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:35:07,159::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:35:07,159::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:35:07,160::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:07,326::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:35:07,330::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:07,347::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000352131 s, 11.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:07,458::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:35:07,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:35:07,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:35:07,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:07,459::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:35:07,461::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:35:07,791::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:35:08,373::task::579::TaskManager.Task::(_updateState) Task=`6c4bc9c4-3b53-46a5-b52f-ce26aeff73de`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:35:08,373::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:35:08,374::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:35:08,374::task::1168::TaskManager.Task::(prepare) Task=`6c4bc9c4-3b53-46a5-b52f-ce26aeff73de`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:35:08,374::task::579::TaskManager.Task::(_updateState) Task=`6c4bc9c4-3b53-46a5-b52f-ce26aeff73de`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:35:08,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:35:08,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:35:08,375::task::974::TaskManager.Task::(_decref) Task=`6c4bc9c4-3b53-46a5-b52f-ce26aeff73de`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:35:08,375::task::579::TaskManager.Task::(_updateState) Task=`d417b12c-e76d-430c-a029-e79e440a660e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:35:08,375::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:35:08,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:35:08,376::task::1168::TaskManager.Task::(prepare) Task=`d417b12c-e76d-430c-a029-e79e440a660e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:35:08,376::task::579::TaskManager.Task::(_updateState) Task=`d417b12c-e76d-430c-a029-e79e440a660e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:35:08,376::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:35:08,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:35:08,376::task::974::TaskManager.Task::(_decref) Task=`d417b12c-e76d-430c-a029-e79e440a660e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:08,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:35:08,490::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:35:08,507::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266728 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:35:08,516::task::579::TaskManager.Task::(_updateState) Task=`b63a7bd8-9652-4d71-a5b8-9f51e256c873`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:35:08,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:35:08,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:35:08,517::task::1168::TaskManager.Task::(prepare) Task=`b63a7bd8-9652-4d71-a5b8-9f51e256c873`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:35:08,517::task::579::TaskManager.Task::(_updateState) Task=`b63a7bd8-9652-4d71-a5b8-9f51e256c873`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:35:08,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:35:08,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:35:08,517::task::974::TaskManager.Task::(_decref) Task=`b63a7bd8-9652-4d71-a5b8-9f51e256c873`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:35:08,606::task::579::TaskManager.Task::(_updateState) Task=`72280022-4a97-417c-9ab6-33d6bf1a4406`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:35:08,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:35:08,607::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:35:08,607::task::1168::TaskManager.Task::(prepare) Task=`72280022-4a97-417c-9ab6-33d6bf1a4406`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:35:08,608::task::579::TaskManager.Task::(_updateState) Task=`72280022-4a97-417c-9ab6-33d6bf1a4406`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:35:08,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:35:08,608::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:35:08,608::task::974::TaskManager.Task::(_decref) Task=`72280022-4a97-417c-9ab6-33d6bf1a4406`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:35:08,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:09,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:35:09,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:35:09,463::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:35:09,782::task::579::TaskManager.Task::(_updateState) Task=`0f508879-7f98-4b23-b65d-07dc1ed34d13`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:35:09,782::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:35:09,783::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:35:09,783::task::1168::TaskManager.Task::(prepare) Task=`0f508879-7f98-4b23-b65d-07dc1ed34d13`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:35:09,783::task::579::TaskManager.Task::(_updateState) Task=`0f508879-7f98-4b23-b65d-07dc1ed34d13`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:35:09,783::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:35:09,783::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:35:09,783::task::974::TaskManager.Task::(_decref) Task=`0f508879-7f98-4b23-b65d-07dc1ed34d13`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:35:09,795::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:10,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:35:10,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:35:10,464::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:35:10,818::task::579::TaskManager.Task::(_updateState) Task=`61f6e4f1-ba32-45f1-8faf-eed4a8618637`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:35:10,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:35:10,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:35:10,819::task::1168::TaskManager.Task::(prepare) Task=`61f6e4f1-ba32-45f1-8faf-eed4a8618637`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:35:10,819::task::579::TaskManager.Task::(_updateState) Task=`61f6e4f1-ba32-45f1-8faf-eed4a8618637`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:35:10,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:35:10,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:35:10,820::task::974::TaskManager.Task::(_decref) Task=`61f6e4f1-ba32-45f1-8faf-eed4a8618637`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:11,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:35:11,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:35:11,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:35:11,466::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:11,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:12,467::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:13,469::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:35:13,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:13,798::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:13,798::task::579::TaskManager.Task::(_updateState) Task=`3415f435-32ee-4f7b-a43e-8b160a9e3bc4`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:35:13,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:35:13,799::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:35:13,799::task::1168::TaskManager.Task::(prepare) Task=`3415f435-32ee-4f7b-a43e-8b160a9e3bc4`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:35:13,799::task::579::TaskManager.Task::(_updateState) Task=`3415f435-32ee-4f7b-a43e-8b160a9e3bc4`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:35:13,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:35:13,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:35:13,799::task::974::TaskManager.Task::(_decref) Task=`3415f435-32ee-4f7b-a43e-8b160a9e3bc4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:35:13,801::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:35:13,801::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:35:13,804::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:13,806::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:13,807::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:35:13,940::task::579::TaskManager.Task::(_updateState) Task=`966cda27-10de-43bb-a4d1-015b62be12e6`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:35:13,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:35:13,941::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:35:13,941::task::1168::TaskManager.Task::(prepare) Task=`966cda27-10de-43bb-a4d1-015b62be12e6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:35:13,941::task::579::TaskManager.Task::(_updateState) Task=`966cda27-10de-43bb-a4d1-015b62be12e6`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:35:13,941::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:35:13,941::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:35:13,941::task::974::TaskManager.Task::(_decref) Task=`966cda27-10de-43bb-a4d1-015b62be12e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:14,470::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:15,471::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:15,808::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:35:16,470::task::579::TaskManager.Task::(_updateState) Task=`8ba3adde-6018-453f-94a9-6374b09cb20f`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:35:16,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:35:16,472::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:35:16,472::task::1168::TaskManager.Task::(prepare) Task=`8ba3adde-6018-453f-94a9-6374b09cb20f`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:35:16,472::task::579::TaskManager.Task::(_updateState) Task=`8ba3adde-6018-453f-94a9-6374b09cb20f`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:35:16,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:35:16,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:35:16,473::task::974::TaskManager.Task::(_decref) Task=`8ba3adde-6018-453f-94a9-6374b09cb20f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:16,473::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:35:17,316::task::579::TaskManager.Task::(_updateState) Task=`3da10dcc-07a1-4515-aef3-85887b0af7a2`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:35:17,317::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:35:17,317::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:35:17,317::task::1168::TaskManager.Task::(prepare) Task=`3da10dcc-07a1-4515-aef3-85887b0af7a2`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:35:17,317::task::579::TaskManager.Task::(_updateState) Task=`3da10dcc-07a1-4515-aef3-85887b0af7a2`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:35:17,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:35:17,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:35:17,318::task::974::TaskManager.Task::(_decref) Task=`3da10dcc-07a1-4515-aef3-85887b0af7a2`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:35:17,353::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:17,370::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000250623 s, 16.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:17,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:17,809::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:18,476::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:35:18,515::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:35:18,532::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000246418 s, 1.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:35:18,811::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:19,477::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:35:19,478::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:19,812::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:20,479::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:21,480::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286794::DEBUG::2014-01-16 16:35:21,692::task::579::TaskManager.Task::(_updateState) Task=`30afb934-5746-482f-8f64-270f9a160a98`::moving from state init -> state preparing >Thread-286794::INFO::2014-01-16 16:35:21,693::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286794::INFO::2014-01-16 16:35:21,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246418', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250623', 'lastCheck': '4.3', 'valid': True}} >Thread-286794::DEBUG::2014-01-16 16:35:21,693::task::1168::TaskManager.Task::(prepare) Task=`30afb934-5746-482f-8f64-270f9a160a98`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246418', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250623', 'lastCheck': '4.3', 'valid': True}} >Thread-286794::DEBUG::2014-01-16 16:35:21,693::task::579::TaskManager.Task::(_updateState) Task=`30afb934-5746-482f-8f64-270f9a160a98`::moving from state preparing -> state finished >Thread-286794::DEBUG::2014-01-16 16:35:21,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286794::DEBUG::2014-01-16 16:35:21,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286794::DEBUG::2014-01-16 16:35:21,694::task::974::TaskManager.Task::(_decref) Task=`30afb934-5746-482f-8f64-270f9a160a98`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:35:21,813::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:22,481::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:23,483::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:23,815::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:23,816::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:35:24,301::task::579::TaskManager.Task::(_updateState) Task=`70b7d2b1-4557-41e2-a7c9-2c0486b2d7eb`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:35:24,301::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:35:24,301::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:35:24,301::task::1168::TaskManager.Task::(prepare) Task=`70b7d2b1-4557-41e2-a7c9-2c0486b2d7eb`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:35:24,302::task::579::TaskManager.Task::(_updateState) Task=`70b7d2b1-4557-41e2-a7c9-2c0486b2d7eb`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:35:24,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:35:24,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:35:24,302::task::974::TaskManager.Task::(_decref) Task=`70b7d2b1-4557-41e2-a7c9-2c0486b2d7eb`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:35:24,302::task::579::TaskManager.Task::(_updateState) Task=`7be20bbe-af50-4cdc-955b-9986e0f06b32`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:35:24,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:35:24,303::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:35:24,303::task::1168::TaskManager.Task::(prepare) Task=`7be20bbe-af50-4cdc-955b-9986e0f06b32`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:35:24,303::task::579::TaskManager.Task::(_updateState) Task=`7be20bbe-af50-4cdc-955b-9986e0f06b32`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:35:24,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:35:24,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:35:24,303::task::974::TaskManager.Task::(_decref) Task=`7be20bbe-af50-4cdc-955b-9986e0f06b32`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:24,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:35:24,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:35:24,484::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:35:24,722::task::579::TaskManager.Task::(_updateState) Task=`b92f4bca-86bf-4289-9d90-bcc715f1ce9d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:35:24,722::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:35:24,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:35:24,723::task::1168::TaskManager.Task::(prepare) Task=`b92f4bca-86bf-4289-9d90-bcc715f1ce9d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:35:24,724::task::579::TaskManager.Task::(_updateState) Task=`b92f4bca-86bf-4289-9d90-bcc715f1ce9d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:35:24,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:35:24,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:35:24,724::task::974::TaskManager.Task::(_decref) Task=`b92f4bca-86bf-4289-9d90-bcc715f1ce9d`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:35:25,406::task::579::TaskManager.Task::(_updateState) Task=`6f4c5fb1-bb0f-4b15-9665-bd9a113790a9`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:35:25,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:35:25,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:35:25,407::task::1168::TaskManager.Task::(prepare) Task=`6f4c5fb1-bb0f-4b15-9665-bd9a113790a9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:35:25,407::task::579::TaskManager.Task::(_updateState) Task=`6f4c5fb1-bb0f-4b15-9665-bd9a113790a9`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:35:25,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:35:25,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:35:25,407::task::974::TaskManager.Task::(_decref) Task=`6f4c5fb1-bb0f-4b15-9665-bd9a113790a9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:25,485::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:35:25,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:25,817::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:26,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:35:26,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:35:26,487::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:35:27,375::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:27,392::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000232103 s, 17.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:27,488::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:35:27,488::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:27,818::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:28,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:35:28,490::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:35:28,539::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:35:28,556::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00025719 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:35:28,821::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:35:28,821::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:35:28,828::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:35:29,002::task::579::TaskManager.Task::(_updateState) Task=`e4f7696c-8677-49f0-a0c1-32a88851c684`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:35:29,002::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:35:29,002::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:35:29,002::task::1168::TaskManager.Task::(prepare) Task=`e4f7696c-8677-49f0-a0c1-32a88851c684`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:35:29,003::task::579::TaskManager.Task::(_updateState) Task=`e4f7696c-8677-49f0-a0c1-32a88851c684`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:35:29,003::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:35:29,003::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:35:29,004::task::974::TaskManager.Task::(_decref) Task=`e4f7696c-8677-49f0-a0c1-32a88851c684`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:35:29,014::task::579::TaskManager.Task::(_updateState) Task=`d5dbc288-579b-4347-a97a-3a813fb9a1ad`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:35:29,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:35:29,015::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:35:29,015::task::1168::TaskManager.Task::(prepare) Task=`d5dbc288-579b-4347-a97a-3a813fb9a1ad`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:35:29,015::task::579::TaskManager.Task::(_updateState) Task=`d5dbc288-579b-4347-a97a-3a813fb9a1ad`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:35:29,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:35:29,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:35:29,016::task::974::TaskManager.Task::(_decref) Task=`d5dbc288-579b-4347-a97a-3a813fb9a1ad`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:29,491::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:29,829::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:30,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:35:30,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:31,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:35:31,493::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:31,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:32,494::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:35:32,494::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:35:32,494::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:35:32,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:33,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:35:33,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:35:33,496::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:33,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:33,832::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:35:34,003::task::579::TaskManager.Task::(_updateState) Task=`0b0c0c09-fab5-421a-a2e3-a9f7fce5456b`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:35:34,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:35:34,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:35:34,004::task::1168::TaskManager.Task::(prepare) Task=`0b0c0c09-fab5-421a-a2e3-a9f7fce5456b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:35:34,004::task::579::TaskManager.Task::(_updateState) Task=`0b0c0c09-fab5-421a-a2e3-a9f7fce5456b`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:35:34,004::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:35:34,004::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:35:34,004::task::974::TaskManager.Task::(_decref) Task=`0b0c0c09-fab5-421a-a2e3-a9f7fce5456b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:34,497::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:35:34,497::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:35:34,646::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 3221225472, capacity: 10737418240, allocated: 2780823040, physical: 3221225472) >Thread-221160::DEBUG::2014-01-16 16:35:34,647::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 4096, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:34,647::task::579::TaskManager.Task::(_updateState) Task=`96ebb22c-f38e-4d0c-a4cf-5c4a16321c3b`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:34,647::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 4096, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=4294967296, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:34,648::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:34,648::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-33::DEBUG::2014-01-16 16:35:34,648::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000100000000000000' >Thread-221160::DEBUG::2014-01-16 16:35:34,648::task::1168::TaskManager.Task::(prepare) Task=`96ebb22c-f38e-4d0c-a4cf-5c4a16321c3b`::finished: None >Thread-33::DEBUG::2014-01-16 16:35:34,648::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-221160::DEBUG::2014-01-16 16:35:34,649::task::579::TaskManager.Task::(_updateState) Task=`96ebb22c-f38e-4d0c-a4cf-5c4a16321c3b`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:34,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:34,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:34,662::task::974::TaskManager.Task::(_decref) Task=`96ebb22c-f38e-4d0c-a4cf-5c4a16321c3b`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:35:34,731::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0686825 s, 59.6 kB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:35:34,731::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:35:34,732::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:35:35,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:35:35,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:35:35,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:35:35,500::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:35:35,744::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.001 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:35:35,838::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >libvirtEventLoop::INFO::2014-01-16 16:35:36,158::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::DEBUG::2014-01-16 16:35:36,158::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 2 opaque None >libvirtEventLoop::INFO::2014-01-16 16:35:36,162::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:36,162::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:36,162::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:36,163::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:36,163::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >VM Channels Listener::DEBUG::2014-01-16 16:35:36,500::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:35:36,513::task::579::TaskManager.Task::(_updateState) Task=`2727f7d0-0155-4234-a0f1-ea98f195ef68`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:35:36,513::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:35:36,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:35:36,514::task::1168::TaskManager.Task::(prepare) Task=`2727f7d0-0155-4234-a0f1-ea98f195ef68`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:35:36,514::task::579::TaskManager.Task::(_updateState) Task=`2727f7d0-0155-4234-a0f1-ea98f195ef68`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:35:36,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:35:36,514::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:35:36,514::task::974::TaskManager.Task::(_decref) Task=`2727f7d0-0155-4234-a0f1-ea98f195ef68`::ref 0 aborting False >Thread-221160::INFO::2014-01-16 16:35:36,672::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 3221225472, capacity: 10737418240, allocated: 3221252096, physical: 3221225472) >Thread-221160::DEBUG::2014-01-16 16:35:36,672::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 4096, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:36,673::task::579::TaskManager.Task::(_updateState) Task=`7adb3273-f870-4e83-8ee9-222820b5ed0e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:36,673::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 4096, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=4294967296, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:36,673::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:36,673::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:36,674::task::1168::TaskManager.Task::(prepare) Task=`7adb3273-f870-4e83-8ee9-222820b5ed0e`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:36,674::task::579::TaskManager.Task::(_updateState) Task=`7adb3273-f870-4e83-8ee9-222820b5ed0e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:36,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:36,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:36,674::task::974::TaskManager.Task::(_decref) Task=`7adb3273-f870-4e83-8ee9-222820b5ed0e`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:35:37,312::task::579::TaskManager.Task::(_updateState) Task=`7b62b504-9023-48b0-9495-2ab19651ed51`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:35:37,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:35:37,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:35:37,313::task::1168::TaskManager.Task::(prepare) Task=`7b62b504-9023-48b0-9495-2ab19651ed51`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:35:37,313::task::579::TaskManager.Task::(_updateState) Task=`7b62b504-9023-48b0-9495-2ab19651ed51`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:35:37,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:35:37,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:35:37,313::task::974::TaskManager.Task::(_decref) Task=`7b62b504-9023-48b0-9495-2ab19651ed51`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:35:37,352::task::579::TaskManager.Task::(_updateState) Task=`1070fe78-0b1f-48c6-9d71-fd6f4b3eaa97`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:35:37,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:35:37,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:35:37,352::task::1168::TaskManager.Task::(prepare) Task=`1070fe78-0b1f-48c6-9d71-fd6f4b3eaa97`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:35:37,352::task::579::TaskManager.Task::(_updateState) Task=`1070fe78-0b1f-48c6-9d71-fd6f4b3eaa97`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:35:37,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:35:37,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:35:37,353::task::974::TaskManager.Task::(_decref) Task=`1070fe78-0b1f-48c6-9d71-fd6f4b3eaa97`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:35:37,399::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:37,417::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319326 s, 12.8 MB/s\n'; <rc> = 0 >Thread-69607::DEBUG::2014-01-16 16:35:37,458::task::579::TaskManager.Task::(_updateState) Task=`9d6ec007-e3a0-455f-a06b-f62525d2bed1`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:35:37,458::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:35:37,459::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:35:37,459::task::1168::TaskManager.Task::(prepare) Task=`9d6ec007-e3a0-455f-a06b-f62525d2bed1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:35:37,459::task::579::TaskManager.Task::(_updateState) Task=`9d6ec007-e3a0-455f-a06b-f62525d2bed1`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:35:37,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:35:37,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:35:37,460::task::974::TaskManager.Task::(_decref) Task=`9d6ec007-e3a0-455f-a06b-f62525d2bed1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:37,502::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:35:37,502::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:35:37,502::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:35:37,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:37,503::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:35:37,503::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-286800::DEBUG::2014-01-16 16:35:37,595::task::579::TaskManager.Task::(_updateState) Task=`c3e1c71c-3ed9-429b-92e2-fa207934d509`::moving from state init -> state preparing >Thread-286800::INFO::2014-01-16 16:35:37,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286800::INFO::2014-01-16 16:35:37,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025719', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319326', 'lastCheck': '0.2', 'valid': True}} >Thread-286800::DEBUG::2014-01-16 16:35:37,596::task::1168::TaskManager.Task::(prepare) Task=`c3e1c71c-3ed9-429b-92e2-fa207934d509`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025719', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319326', 'lastCheck': '0.2', 'valid': True}} >Thread-286800::DEBUG::2014-01-16 16:35:37,596::task::579::TaskManager.Task::(_updateState) Task=`c3e1c71c-3ed9-429b-92e2-fa207934d509`::moving from state preparing -> state finished >Thread-286800::DEBUG::2014-01-16 16:35:37,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286800::DEBUG::2014-01-16 16:35:37,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286800::DEBUG::2014-01-16 16:35:37,597::task::974::TaskManager.Task::(_decref) Task=`c3e1c71c-3ed9-429b-92e2-fa207934d509`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:35:37,747::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f459011b9e0> >Thread-33::DEBUG::2014-01-16 16:35:37,748::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:37,764::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00136266 s, 3.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:35:37,764::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000100000000000000' >12310bb7-9905-4118-870c-20bd87c959ae::DEBUG::2014-01-16 16:35:37,765::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-33::INFO::2014-01-16 16:35:37,765::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:37,767::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 43659425-27c7-47b7-8e05-ab8cb20a74a1 running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 4096, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:35:37,768::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:37,780::task::579::TaskManager.Task::(_updateState) Task=`14b5515e-3904-4f0b-a653-aafc64e5a970`::moving from state init -> state preparing >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:37,783::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:37,784::task::579::TaskManager.Task::(_updateState) Task=`72450071-e1ed-4185-b510-2d4708d8a67c`::moving from state init -> state preparing >43659425-27c7-47b7-8e05-ab8cb20a74a1::INFO::2014-01-16 16:35:37,784::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:37,784::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:37,785::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:35:37,841::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,016::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 16:35:38,289::task::579::TaskManager.Task::(_updateState) Task=`7ba68161-424b-4236-9003-b2c5f478e344`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:35:38,292::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:35:38,296::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:35:38,299::task::1168::TaskManager.Task::(prepare) Task=`7ba68161-424b-4236-9003-b2c5f478e344`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:35:38,302::task::579::TaskManager.Task::(_updateState) Task=`7ba68161-424b-4236-9003-b2c5f478e344`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:35:38,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:35:38,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:35:38,309::task::974::TaskManager.Task::(_decref) Task=`7ba68161-424b-4236-9003-b2c5f478e344`::ref 0 aborting False >43659425-27c7-47b7-8e05-ab8cb20a74a1::WARNING::2014-01-16 16:35:38,350::lvm::472::Storage.LVM::(_reloadlvs) Removing stale lv: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/f85e4854-92cc-4797-b412-ad84cd419919 >43659425-27c7-47b7-8e05-ab8cb20a74a1::WARNING::2014-01-16 16:35:38,352::lvm::472::Storage.LVM::(_reloadlvs) Removing stale lv: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/bc82d0e0-3711-4cbb-bc56-d58f40f574e8 >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,353::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,353::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,354::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:35:38,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:35:38,568::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:35:38,584::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000253249 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:35:38,619::task::579::TaskManager.Task::(_updateState) Task=`fb7b2062-3969-4236-9e2a-39688a824273`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:35:38,620::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:35:38,620::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:35:38,621::task::1168::TaskManager.Task::(prepare) Task=`fb7b2062-3969-4236-9e2a-39688a824273`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:35:38,621::task::579::TaskManager.Task::(_updateState) Task=`fb7b2062-3969-4236-9e2a-39688a824273`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:35:38,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:35:38,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:35:38,621::task::974::TaskManager.Task::(_decref) Task=`fb7b2062-3969-4236-9e2a-39688a824273`::ref 0 aborting False >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,628::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,629::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,629::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >43659425-27c7-47b7-8e05-ab8cb20a74a1::INFO::2014-01-16 16:35:38,630::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,630::task::1168::TaskManager.Task::(prepare) Task=`72450071-e1ed-4185-b510-2d4708d8a67c`::finished: None >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,630::task::579::TaskManager.Task::(_updateState) Task=`72450071-e1ed-4185-b510-2d4708d8a67c`::moving from state preparing -> state finished >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,630::task::974::TaskManager.Task::(_decref) Task=`72450071-e1ed-4185-b510-2d4708d8a67c`::ref 0 aborting False >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,631::task::579::TaskManager.Task::(_updateState) Task=`83d0f6bf-3af5-4922-ad43-1fb5bacf356d`::moving from state init -> state preparing >43659425-27c7-47b7-8e05-ab8cb20a74a1::INFO::2014-01-16 16:35:38,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >43659425-27c7-47b7-8e05-ab8cb20a74a1::INFO::2014-01-16 16:35:38,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,631::task::1168::TaskManager.Task::(prepare) Task=`83d0f6bf-3af5-4922-ad43-1fb5bacf356d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,632::task::579::TaskManager.Task::(_updateState) Task=`83d0f6bf-3af5-4922-ad43-1fb5bacf356d`::moving from state preparing -> state finished >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,632::task::974::TaskManager.Task::(_decref) Task=`83d0f6bf-3af5-4922-ad43-1fb5bacf356d`::ref 0 aborting False >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,633::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 4294967296, current size 4294967296 >libvirtEventLoop::DEBUG::2014-01-16 16:35:38,665::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,666::task::1168::TaskManager.Task::(prepare) Task=`14b5515e-3904-4f0b-a653-aafc64e5a970`::finished: None >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,666::task::579::TaskManager.Task::(_updateState) Task=`14b5515e-3904-4f0b-a653-aafc64e5a970`::moving from state preparing -> state finished >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:35:38,667::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,668::task::974::TaskManager.Task::(_decref) Task=`14b5515e-3904-4f0b-a653-aafc64e5a970`::ref 0 aborting False >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:38,669::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-33::DEBUG::2014-01-16 16:35:38,785::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00509 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:35:38,843::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:39,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:35:39,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:35:39,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:39,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:40,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:35:40,508::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:35:40,508::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:35:40,683::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 4294967296, capacity: 10737418240, allocated: 3800235520, physical: 4294967296) >Thread-221160::DEBUG::2014-01-16 16:35:40,684::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:40,685::task::579::TaskManager.Task::(_updateState) Task=`3d82ff46-348c-4537-86f3-fe9517a32ecd`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:40,685::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=5368709120, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:40,685::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:40,685::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:40,686::task::1168::TaskManager.Task::(prepare) Task=`3d82ff46-348c-4537-86f3-fe9517a32ecd`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:40,686::task::579::TaskManager.Task::(_updateState) Task=`3d82ff46-348c-4537-86f3-fe9517a32ecd`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:40,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:40,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:40,686::task::974::TaskManager.Task::(_decref) Task=`3d82ff46-348c-4537-86f3-fe9517a32ecd`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:35:40,787::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 128, end: 192, len: 4096, message(2/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000140000000000000' >Thread-33::DEBUG::2014-01-16 16:35:40,787::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:40,808::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00659007 s, 622 kB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:35:40,808::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:35:40,809::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-286803::DEBUG::2014-01-16 16:35:41,205::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('6b03257a-90ec-4a1e-b285-d462b8e8c277',) {} >Thread-286803::DEBUG::2014-01-16 16:35:41,207::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23174', 'displayIp': '0', 'displayPort': u'5954', 'session': 'Unknown', 'displaySecurePort': u'5955', 'timeOffset': '0', 'hash': '2903861395083110923', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '2097152'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet30': {'macAddr': '00:1a:4a:22:39:8d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet30'}}, 'vmId': '6b03257a-90ec-4a1e-b285-d462b8e8c277', 'displayType': 'qxl', 'cpuUser': '17.29', 'disks': {u'vda': {'readLatency': '1337016', 'apparentsize': '4294967296', 'writeLatency': '1690252', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'flushLatency': '0', 'readRate': '42487.45', 'truesize': '4294967296', 'writeRate': '178661.69'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.53', 'elapsedTime': '170753', 'vmType': 'kvm', 'cpuSys': '9.97', 'appsList': [], 'guestIPs': ''}]} >Thread-84377::DEBUG::2014-01-16 16:35:41,263::task::579::TaskManager.Task::(_updateState) Task=`8507f9f9-78df-4229-a5f1-6ba2b730ff8b`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:35:41,264::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:35:41,264::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:35:41,264::task::1168::TaskManager.Task::(prepare) Task=`8507f9f9-78df-4229-a5f1-6ba2b730ff8b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:35:41,264::task::579::TaskManager.Task::(_updateState) Task=`8507f9f9-78df-4229-a5f1-6ba2b730ff8b`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:35:41,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:35:41,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:35:41,265::task::974::TaskManager.Task::(_decref) Task=`8507f9f9-78df-4229-a5f1-6ba2b730ff8b`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:35:41,265::task::579::TaskManager.Task::(_updateState) Task=`4db1f5ff-251f-4bac-9948-ef7085f11d1e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:35:41,265::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:35:41,266::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:35:41,266::task::1168::TaskManager.Task::(prepare) Task=`4db1f5ff-251f-4bac-9948-ef7085f11d1e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:35:41,266::task::579::TaskManager.Task::(_updateState) Task=`4db1f5ff-251f-4bac-9948-ef7085f11d1e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:35:41,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:35:41,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:35:41,266::task::974::TaskManager.Task::(_decref) Task=`4db1f5ff-251f-4bac-9948-ef7085f11d1e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:35:41,267::task::579::TaskManager.Task::(_updateState) Task=`42d65005-c97f-4130-b70d-68f4aafbe03e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:35:41,267::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:35:41,267::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:35:41,267::task::1168::TaskManager.Task::(prepare) Task=`42d65005-c97f-4130-b70d-68f4aafbe03e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:35:41,267::task::579::TaskManager.Task::(_updateState) Task=`42d65005-c97f-4130-b70d-68f4aafbe03e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:35:41,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:35:41,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:35:41,268::task::974::TaskManager.Task::(_decref) Task=`42d65005-c97f-4130-b70d-68f4aafbe03e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:41,509::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:35:41,509::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:35:41,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:35:41,510::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:35:41,821::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00126 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:35:41,846::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:42,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:35:42,692::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 4294967296, capacity: 10737418240, allocated: 3975872000, physical: 4294967296) >Thread-221160::DEBUG::2014-01-16 16:35:42,692::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:42,693::task::579::TaskManager.Task::(_updateState) Task=`6fcd3241-645f-48d2-add0-4908e59fe74d`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:42,693::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=5368709120, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:42,693::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:42,694::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:42,694::task::1168::TaskManager.Task::(prepare) Task=`6fcd3241-645f-48d2-add0-4908e59fe74d`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:42,694::task::579::TaskManager.Task::(_updateState) Task=`6fcd3241-645f-48d2-add0-4908e59fe74d`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:42,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:42,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:42,694::task::974::TaskManager.Task::(_decref) Task=`6fcd3241-645f-48d2-add0-4908e59fe74d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:43,512::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:35:43,513::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:35:43,822::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f459010f2d8> >Thread-33::DEBUG::2014-01-16 16:35:43,823::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:43,839::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00212112 s, 1.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:35:43,839::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000140000000000000' >Thread-33::INFO::2014-01-16 16:35:43,840::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >0489320c-d240-4204-aeba-0ef580b2fb28::DEBUG::2014-01-16 16:35:43,841::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-33::DEBUG::2014-01-16 16:35:43,843::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:43,843::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 86fac15f-3dcf-4c76-ad25-d60158006d37 running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-189817::DEBUG::2014-01-16 16:35:43,860::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:43,861::task::579::TaskManager.Task::(_updateState) Task=`9c63aba0-41e4-4caa-963d-50b0534d312b`::moving from state init -> state preparing >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:43,865::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >Thread-189817::DEBUG::2014-01-16 16:35:43,866::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:35:43,868::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:35:43,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >libvirtEventLoop::DEBUG::2014-01-16 16:35:43,874::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >libvirtEventLoop::DEBUG::2014-01-16 16:35:43,876::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:43,877::task::579::TaskManager.Task::(_updateState) Task=`5775b982-09e7-4e42-b7a0-6b4ad9c55402`::moving from state init -> state preparing >86fac15f-3dcf-4c76-ad25-d60158006d37::INFO::2014-01-16 16:35:43,877::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:43,878::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:43,879::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,088::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-286805::DEBUG::2014-01-16 16:35:44,333::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('6b03257a-90ec-4a1e-b285-d462b8e8c277',) {} >Thread-286805::DEBUG::2014-01-16 16:35:44,338::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Paused', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23174', 'displayIp': '0', 'displayPort': u'5954', 'session': 'Unknown', 'displaySecurePort': u'5955', 'timeOffset': '0', 'hash': '2903861395083110923', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '2097152'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet30': {'macAddr': '00:1a:4a:22:39:8d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet30'}}, 'vmId': '6b03257a-90ec-4a1e-b285-d462b8e8c277', 'displayType': 'qxl', 'cpuUser': '17.29', 'disks': {u'vda': {'readLatency': '1337016', 'apparentsize': '4294967296', 'writeLatency': '1690252', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'flushLatency': '0', 'readRate': '42487.45', 'truesize': '4294967296', 'writeRate': '178661.69'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.65', 'elapsedTime': '170756', 'vmType': 'kvm', 'cpuSys': '9.97', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:35:44,514::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,534::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,534::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,535::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >Thread-221160::INFO::2014-01-16 16:35:44,698::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 4294967296, capacity: 10737418240, allocated: 4128636416, physical: 4294967296) >Thread-221160::DEBUG::2014-01-16 16:35:44,699::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:44,700::task::579::TaskManager.Task::(_updateState) Task=`e37656b5-dd8b-44db-a342-3dc3439b792d`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:44,700::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=5368709120, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:44,700::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:44,700::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:44,700::task::1168::TaskManager.Task::(prepare) Task=`e37656b5-dd8b-44db-a342-3dc3439b792d`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:44,701::task::579::TaskManager.Task::(_updateState) Task=`e37656b5-dd8b-44db-a342-3dc3439b792d`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:44,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:44,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:44,701::task::974::TaskManager.Task::(_decref) Task=`e37656b5-dd8b-44db-a342-3dc3439b792d`::ref 0 aborting False >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,750::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,750::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,750::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >86fac15f-3dcf-4c76-ad25-d60158006d37::INFO::2014-01-16 16:35:44,751::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,751::task::1168::TaskManager.Task::(prepare) Task=`5775b982-09e7-4e42-b7a0-6b4ad9c55402`::finished: None >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,751::task::579::TaskManager.Task::(_updateState) Task=`5775b982-09e7-4e42-b7a0-6b4ad9c55402`::moving from state preparing -> state finished >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,752::task::974::TaskManager.Task::(_decref) Task=`5775b982-09e7-4e42-b7a0-6b4ad9c55402`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 16:35:44,770::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >libvirtEventLoop::DEBUG::2014-01-16 16:35:44,772::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,772::task::579::TaskManager.Task::(_updateState) Task=`aeb89dd2-fe14-4f57-8fc9-b29643ca2082`::moving from state init -> state preparing >86fac15f-3dcf-4c76-ad25-d60158006d37::INFO::2014-01-16 16:35:44,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >86fac15f-3dcf-4c76-ad25-d60158006d37::INFO::2014-01-16 16:35:44,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,774::task::1168::TaskManager.Task::(prepare) Task=`aeb89dd2-fe14-4f57-8fc9-b29643ca2082`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,774::task::579::TaskManager.Task::(_updateState) Task=`aeb89dd2-fe14-4f57-8fc9-b29643ca2082`::moving from state preparing -> state finished >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,774::task::974::TaskManager.Task::(_decref) Task=`aeb89dd2-fe14-4f57-8fc9-b29643ca2082`::ref 0 aborting False >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,775::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 5368709120, current size 5368709120 >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,778::task::1168::TaskManager.Task::(prepare) Task=`9c63aba0-41e4-4caa-963d-50b0534d312b`::finished: None >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,778::task::579::TaskManager.Task::(_updateState) Task=`9c63aba0-41e4-4caa-963d-50b0534d312b`::moving from state preparing -> state finished >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,779::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,779::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,779::task::974::TaskManager.Task::(_decref) Task=`9c63aba0-41e4-4caa-963d-50b0534d312b`::ref 0 aborting False >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:35:44,779::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-33::DEBUG::2014-01-16 16:35:44,867::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.0115 s, 4.0 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:45,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:45,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:35:46,303::task::579::TaskManager.Task::(_updateState) Task=`21528a9c-b78b-4fb1-9b1a-fd10abb2fb2b`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:35:46,304::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:35:46,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:35:46,304::task::1168::TaskManager.Task::(prepare) Task=`21528a9c-b78b-4fb1-9b1a-fd10abb2fb2b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:35:46,304::task::579::TaskManager.Task::(_updateState) Task=`21528a9c-b78b-4fb1-9b1a-fd10abb2fb2b`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:35:46,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:35:46,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:35:46,304::task::974::TaskManager.Task::(_decref) Task=`21528a9c-b78b-4fb1-9b1a-fd10abb2fb2b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:35:46,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:35:46,869::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(2/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000140000000000000' >Thread-33::DEBUG::2014-01-16 16:35:46,870::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:46,886::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0016262 s, 2.5 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:35:46,887::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:35:46,887::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:47,425::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:47,470::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00021284 s, 19.2 MB/s\n'; <rc> = 0 >Thread-286807::DEBUG::2014-01-16 16:35:47,509::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('6b03257a-90ec-4a1e-b285-d462b8e8c277',) {} >Thread-286807::DEBUG::2014-01-16 16:35:47,511::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23174', 'displayIp': '0', 'displayPort': u'5954', 'session': 'Unknown', 'displaySecurePort': u'5955', 'timeOffset': '0', 'hash': '2903861395083110923', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '2097152'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet30': {'macAddr': '00:1a:4a:22:39:8d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet30'}}, 'vmId': '6b03257a-90ec-4a1e-b285-d462b8e8c277', 'displayType': 'qxl', 'cpuUser': '17.29', 'disks': {u'vda': {'readLatency': '1337016', 'apparentsize': '5368709120', 'writeLatency': '1690252', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'flushLatency': '0', 'readRate': '42487.45', 'truesize': '5368709120', 'writeRate': '178661.69'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.81', 'elapsedTime': '170759', 'vmType': 'kvm', 'cpuSys': '9.97', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:35:47,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:47,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:35:47,900::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00139 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:48,522::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:35:48,593::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:35:48,611::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000294904 s, 1.2 MB/s\n'; <rc> = 0 >Thread-221160::INFO::2014-01-16 16:35:48,710::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 5368709120, capacity: 10737418240, allocated: 4859690496, physical: 5368709120) >Thread-221160::DEBUG::2014-01-16 16:35:48,711::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:48,711::task::579::TaskManager.Task::(_updateState) Task=`30a46452-5c94-41f2-8e17-af6b9adf6e30`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:48,711::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:48,712::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:48,712::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:48,712::task::1168::TaskManager.Task::(prepare) Task=`30a46452-5c94-41f2-8e17-af6b9adf6e30`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:48,712::task::579::TaskManager.Task::(_updateState) Task=`30a46452-5c94-41f2-8e17-af6b9adf6e30`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:48,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:48,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:48,713::task::974::TaskManager.Task::(_decref) Task=`30a46452-5c94-41f2-8e17-af6b9adf6e30`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:35:48,875::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:49,523::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:35:49,524::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:49,877::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:35:49,902::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 128, end: 192, len: 4096, message(2/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000180000000000000' >Thread-33::DEBUG::2014-01-16 16:35:49,902::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:49,919::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00103403 s, 4.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:35:49,920::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(2/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000140000000000000' >43659425-27c7-47b7-8e05-ab8cb20a74a1::DEBUG::2014-01-16 16:35:49,920::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-33::INFO::2014-01-16 16:35:49,922::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:49,924::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: d19df475-3e6f-4141-a4bf-64e7479a3fb2 running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 5120, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:35:49,926::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:49,926::task::579::TaskManager.Task::(_updateState) Task=`01419b76-b697-4063-9688-2b26ad27be16`::moving from state init -> state preparing >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:49,941::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >libvirtEventLoop::DEBUG::2014-01-16 16:35:49,950::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >libvirtEventLoop::DEBUG::2014-01-16 16:35:49,953::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:49,953::task::579::TaskManager.Task::(_updateState) Task=`1320540e-bfbb-4e91-a95a-797d18368f8d`::moving from state init -> state preparing >d19df475-3e6f-4141-a4bf-64e7479a3fb2::INFO::2014-01-16 16:35:49,954::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:49,954::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:49,955::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,146::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,473::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,473::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,474::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:35:50,525::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,679::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,680::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,680::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >d19df475-3e6f-4141-a4bf-64e7479a3fb2::INFO::2014-01-16 16:35:50,680::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,681::task::1168::TaskManager.Task::(prepare) Task=`1320540e-bfbb-4e91-a95a-797d18368f8d`::finished: None >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,682::task::579::TaskManager.Task::(_updateState) Task=`1320540e-bfbb-4e91-a95a-797d18368f8d`::moving from state preparing -> state finished >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,682::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,682::task::974::TaskManager.Task::(_decref) Task=`1320540e-bfbb-4e91-a95a-797d18368f8d`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 16:35:50,696::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,699::task::579::TaskManager.Task::(_updateState) Task=`8cfcd6e5-c7cd-4f3f-a36b-459341e75b63`::moving from state init -> state preparing >libvirtEventLoop::DEBUG::2014-01-16 16:35:50,699::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >d19df475-3e6f-4141-a4bf-64e7479a3fb2::INFO::2014-01-16 16:35:50,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >d19df475-3e6f-4141-a4bf-64e7479a3fb2::INFO::2014-01-16 16:35:50,701::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,701::task::1168::TaskManager.Task::(prepare) Task=`8cfcd6e5-c7cd-4f3f-a36b-459341e75b63`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,702::task::579::TaskManager.Task::(_updateState) Task=`8cfcd6e5-c7cd-4f3f-a36b-459341e75b63`::moving from state preparing -> state finished >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,702::task::974::TaskManager.Task::(_decref) Task=`8cfcd6e5-c7cd-4f3f-a36b-459341e75b63`::ref 0 aborting False >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,702::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 5368709120, current size 5368709120 >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,706::task::1168::TaskManager.Task::(prepare) Task=`01419b76-b697-4063-9688-2b26ad27be16`::finished: None >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,706::task::579::TaskManager.Task::(_updateState) Task=`01419b76-b697-4063-9688-2b26ad27be16`::moving from state preparing -> state finished >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,706::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,707::task::974::TaskManager.Task::(_decref) Task=`01419b76-b697-4063-9688-2b26ad27be16`::ref 0 aborting False >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:50,707::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-221160::INFO::2014-01-16 16:35:50,717::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 5368709120, capacity: 10737418240, allocated: 4859690496, physical: 5368709120) >Thread-221160::DEBUG::2014-01-16 16:35:50,717::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:50,717::task::579::TaskManager.Task::(_updateState) Task=`4c4d3ec9-3644-4f8e-8566-9db33fb9c6d4`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:50,718::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:50,718::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:50,718::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:50,718::task::1168::TaskManager.Task::(prepare) Task=`4c4d3ec9-3644-4f8e-8566-9db33fb9c6d4`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:50,718::task::579::TaskManager.Task::(_updateState) Task=`4c4d3ec9-3644-4f8e-8566-9db33fb9c6d4`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:50,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:50,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:50,719::task::974::TaskManager.Task::(_decref) Task=`4c4d3ec9-3644-4f8e-8566-9db33fb9c6d4`::ref 0 aborting False >Thread-221160::DEBUG::2014-01-16 16:35:50,719::task::579::TaskManager.Task::(_updateState) Task=`898f3c86-c989-4ca6-af1e-150deb636a0a`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:50,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:35:50,720::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-221160::DEBUG::2014-01-16 16:35:50,720::task::1168::TaskManager.Task::(prepare) Task=`898f3c86-c989-4ca6-af1e-150deb636a0a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-221160::DEBUG::2014-01-16 16:35:50,720::task::579::TaskManager.Task::(_updateState) Task=`898f3c86-c989-4ca6-af1e-150deb636a0a`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:50,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:50,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:50,720::task::974::TaskManager.Task::(_decref) Task=`898f3c86-c989-4ca6-af1e-150deb636a0a`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:35:50,945::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00537 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:51,526::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:51,878::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:52,528::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:35:52,756::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 5368709120, capacity: 10737418240, allocated: 5318901248, physical: 5368709120) >Thread-221160::DEBUG::2014-01-16 16:35:52,757::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:52,757::task::579::TaskManager.Task::(_updateState) Task=`04bd3aea-c5ef-4c71-b6f8-9e1ad021e05e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:52,757::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:52,758::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:52,758::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:35:52,758::task::1168::TaskManager.Task::(prepare) Task=`04bd3aea-c5ef-4c71-b6f8-9e1ad021e05e`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:52,758::task::579::TaskManager.Task::(_updateState) Task=`04bd3aea-c5ef-4c71-b6f8-9e1ad021e05e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:35:52,758::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:52,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:52,759::task::974::TaskManager.Task::(_decref) Task=`04bd3aea-c5ef-4c71-b6f8-9e1ad021e05e`::ref 0 aborting False >libvirtEventLoop::INFO::2014-01-16 16:35:52,931::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::DEBUG::2014-01-16 16:35:52,932::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 2 opaque None >libvirtEventLoop::INFO::2014-01-16 16:35:52,932::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,932::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,932::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,933::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,933::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,933::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,933::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,934::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,934::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >libvirtEventLoop::INFO::2014-01-16 16:35:52,934::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error eother >Thread-33::DEBUG::2014-01-16 16:35:52,946::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f4590106050> >Thread-33::DEBUG::2014-01-16 16:35:52,946::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f455063ecb0> >Thread-33::DEBUG::2014-01-16 16:35:52,947::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:52,962::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.000952025 s, 4.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:35:52,963::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000180000000000000' >Thread-33::INFO::2014-01-16 16:35:52,963::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >d19df475-3e6f-4141-a4bf-64e7479a3fb2::DEBUG::2014-01-16 16:35:52,964::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:52,967::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 9859e176-78f0-4475-bd60-6caf61485ef2 running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 6144, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:35:52,968::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:52,982::task::579::TaskManager.Task::(_updateState) Task=`00029028-d7e3-4f7b-b7e2-fb5b1db87269`::moving from state init -> state preparing >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:52,985::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:52,986::task::579::TaskManager.Task::(_updateState) Task=`26e67d9f-bd0a-4c9a-836d-de0dec07beb5`::moving from state init -> state preparing >9859e176-78f0-4475-bd60-6caf61485ef2::INFO::2014-01-16 16:35:52,987::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:52,987::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:52,988::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,183::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,529::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,529::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >VM Channels Listener::DEBUG::2014-01-16 16:35:53,530::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,536::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,758::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,759::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,759::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9859e176-78f0-4475-bd60-6caf61485ef2::INFO::2014-01-16 16:35:53,760::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,760::task::1168::TaskManager.Task::(prepare) Task=`26e67d9f-bd0a-4c9a-836d-de0dec07beb5`::finished: None >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,760::task::579::TaskManager.Task::(_updateState) Task=`26e67d9f-bd0a-4c9a-836d-de0dec07beb5`::moving from state preparing -> state finished >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,761::task::974::TaskManager.Task::(_decref) Task=`26e67d9f-bd0a-4c9a-836d-de0dec07beb5`::ref 0 aborting False >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,762::task::579::TaskManager.Task::(_updateState) Task=`55113e45-7a04-4d4e-b001-8f46faefd9a1`::moving from state init -> state preparing >9859e176-78f0-4475-bd60-6caf61485ef2::INFO::2014-01-16 16:35:53,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >9859e176-78f0-4475-bd60-6caf61485ef2::INFO::2014-01-16 16:35:53,763::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,763::task::1168::TaskManager.Task::(prepare) Task=`55113e45-7a04-4d4e-b001-8f46faefd9a1`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,763::task::579::TaskManager.Task::(_updateState) Task=`55113e45-7a04-4d4e-b001-8f46faefd9a1`::moving from state preparing -> state finished >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,763::task::974::TaskManager.Task::(_decref) Task=`55113e45-7a04-4d4e-b001-8f46faefd9a1`::ref 0 aborting False >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,764::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 6442450944, current size 6442450944 >libvirtEventLoop::DEBUG::2014-01-16 16:35:53,787::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,789::task::1168::TaskManager.Task::(prepare) Task=`00029028-d7e3-4f7b-b7e2-fb5b1db87269`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:35:53,789::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,790::task::579::TaskManager.Task::(_updateState) Task=`00029028-d7e3-4f7b-b7e2-fb5b1db87269`::moving from state preparing -> state finished >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,791::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,791::task::974::TaskManager.Task::(_decref) Task=`00029028-d7e3-4f7b-b7e2-fb5b1db87269`::ref 0 aborting False >9859e176-78f0-4475-bd60-6caf61485ef2::DEBUG::2014-01-16 16:35:53,791::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-286809::DEBUG::2014-01-16 16:35:53,810::task::579::TaskManager.Task::(_updateState) Task=`7fc7c976-1d9e-495d-8d82-371cfe84ab41`::moving from state init -> state preparing >Thread-286809::INFO::2014-01-16 16:35:53,810::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286809::INFO::2014-01-16 16:35:53,810::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294904', 'lastCheck': '5.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021284', 'lastCheck': '6.3', 'valid': True}} >Thread-286809::DEBUG::2014-01-16 16:35:53,811::task::1168::TaskManager.Task::(prepare) Task=`7fc7c976-1d9e-495d-8d82-371cfe84ab41`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294904', 'lastCheck': '5.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021284', 'lastCheck': '6.3', 'valid': True}} >Thread-286809::DEBUG::2014-01-16 16:35:53,811::task::579::TaskManager.Task::(_updateState) Task=`7fc7c976-1d9e-495d-8d82-371cfe84ab41`::moving from state preparing -> state finished >Thread-286809::DEBUG::2014-01-16 16:35:53,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286809::DEBUG::2014-01-16 16:35:53,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286809::DEBUG::2014-01-16 16:35:53,811::task::974::TaskManager.Task::(_decref) Task=`7fc7c976-1d9e-495d-8d82-371cfe84ab41`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:35:53,882::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:35:53,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:35:53,988::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00699 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:54,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:35:54,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:35:54,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:35:55,539::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:35:55,539::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:55,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:35:55,989::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:35:56,006::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.000906519 s, 4.5 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:35:56,007::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:35:56,007::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:35:56,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:35:56,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:35:56,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:35:57,023::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00089 s, 4.1 kB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:35:57,474::task::579::TaskManager.Task::(_updateState) Task=`7ff3e1eb-0f68-4d62-a9fd-5d33557bb4d5`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:35:57,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:35:57,481::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:35:57,483::task::1168::TaskManager.Task::(prepare) Task=`7ff3e1eb-0f68-4d62-a9fd-5d33557bb4d5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:35:57,485::task::579::TaskManager.Task::(_updateState) Task=`7ff3e1eb-0f68-4d62-a9fd-5d33557bb4d5`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:35:57,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:35:57,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:35:57,491::task::974::TaskManager.Task::(_decref) Task=`7ff3e1eb-0f68-4d62-a9fd-5d33557bb4d5`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:35:57,494::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:35:57,513::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000206553 s, 19.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:35:57,542::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:35:57,543::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:35:57,895::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:58,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:35:58,544::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:35:58,621::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:35:58,641::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000247367 s, 1.5 MB/s\n'; <rc> = 0 >Thread-221160::INFO::2014-01-16 16:35:58,772::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 6442450944, capacity: 10737418240, allocated: 6046809600, physical: 6442450944) >Thread-221160::DEBUG::2014-01-16 16:35:58,772::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 7168, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:35:58,773::task::579::TaskManager.Task::(_updateState) Task=`404186c3-b7bf-4ed8-905e-6eded5748ce2`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:35:58,773::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 7168, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=7516192768, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:35:58,773::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:35:58,774::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-33::DEBUG::2014-01-16 16:35:58,774::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$0000000000001c0000000000000' >Thread-221160::DEBUG::2014-01-16 16:35:58,775::task::1168::TaskManager.Task::(prepare) Task=`404186c3-b7bf-4ed8-905e-6eded5748ce2`::finished: None >Thread-221160::DEBUG::2014-01-16 16:35:58,776::task::579::TaskManager.Task::(_updateState) Task=`404186c3-b7bf-4ed8-905e-6eded5748ce2`::moving from state preparing -> state finished >Thread-33::DEBUG::2014-01-16 16:35:58,778::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-221160::DEBUG::2014-01-16 16:35:58,778::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:35:58,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:35:58,798::task::974::TaskManager.Task::(_decref) Task=`404186c3-b7bf-4ed8-905e-6eded5748ce2`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:35:58,801::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00169719 s, 2.4 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:35:58,801::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:35:58,801::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:35:58,897::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:35:58,897::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:35:58,899::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:35:59,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:35:59,813::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00023 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:35:59,900::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:00,547::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:36:00,547::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:36:00,804::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 6442450944, capacity: 10737418240, allocated: 6233390592, physical: 6442450944) >Thread-221160::DEBUG::2014-01-16 16:36:00,804::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 7168, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:00,804::task::579::TaskManager.Task::(_updateState) Task=`56b49cac-2b37-433c-8e1b-08415ea02b17`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:00,805::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 7168, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=7516192768, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:00,805::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:00,805::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:36:00,805::task::1168::TaskManager.Task::(prepare) Task=`56b49cac-2b37-433c-8e1b-08415ea02b17`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:00,806::task::579::TaskManager.Task::(_updateState) Task=`56b49cac-2b37-433c-8e1b-08415ea02b17`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:00,806::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:36:00,806::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:00,806::task::974::TaskManager.Task::(_decref) Task=`56b49cac-2b37-433c-8e1b-08415ea02b17`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:36:01,084::task::579::TaskManager.Task::(_updateState) Task=`66e0d02b-828a-423f-a8ca-fb9d92b6e6e5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:36:01,084::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:36:01,084::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:36:01,085::task::1168::TaskManager.Task::(prepare) Task=`66e0d02b-828a-423f-a8ca-fb9d92b6e6e5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:36:01,085::task::579::TaskManager.Task::(_updateState) Task=`66e0d02b-828a-423f-a8ca-fb9d92b6e6e5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:36:01,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:36:01,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:36:01,085::task::974::TaskManager.Task::(_decref) Task=`66e0d02b-828a-423f-a8ca-fb9d92b6e6e5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:36:01,086::task::579::TaskManager.Task::(_updateState) Task=`398150ca-a619-4225-9e1a-652ec56826c9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:36:01,086::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:36:01,086::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:36:01,086::task::1168::TaskManager.Task::(prepare) Task=`398150ca-a619-4225-9e1a-652ec56826c9`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:36:01,086::task::579::TaskManager.Task::(_updateState) Task=`398150ca-a619-4225-9e1a-652ec56826c9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:36:01,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:36:01,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:36:01,087::task::974::TaskManager.Task::(_decref) Task=`398150ca-a619-4225-9e1a-652ec56826c9`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:36:01,087::task::579::TaskManager.Task::(_updateState) Task=`157ac0d1-fa59-4624-8f75-f32032cb6d80`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:36:01,087::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:36:01,088::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:36:01,088::task::1168::TaskManager.Task::(prepare) Task=`157ac0d1-fa59-4624-8f75-f32032cb6d80`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:36:01,088::task::579::TaskManager.Task::(_updateState) Task=`157ac0d1-fa59-4624-8f75-f32032cb6d80`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:36:01,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:36:01,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:36:01,088::task::974::TaskManager.Task::(_decref) Task=`157ac0d1-fa59-4624-8f75-f32032cb6d80`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:01,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:36:01,550::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:01,816::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f453027aab8> >Thread-33::DEBUG::2014-01-16 16:36:01,816::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:01,834::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00103992 s, 3.9 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:36:01,835::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$0000000000001c0000000000000' >Thread-33::INFO::2014-01-16 16:36:01,835::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >86fac15f-3dcf-4c76-ad25-d60158006d37::DEBUG::2014-01-16 16:36:01,835::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:01,837::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 192e03f0-b713-4cb7-874e-91f5b0a668ea running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 7168, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:36:01,837::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:01,854::task::579::TaskManager.Task::(_updateState) Task=`f0baadfd-c2f9-47b7-83f8-8e71f929f13a`::moving from state init -> state preparing >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:01,856::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >libvirtEventLoop::DEBUG::2014-01-16 16:36:01,868::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:01,872::task::579::TaskManager.Task::(_updateState) Task=`f644ec26-8bc6-45bb-969f-d78cda59e537`::moving from state init -> state preparing >libvirtEventLoop::DEBUG::2014-01-16 16:36:01,872::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >192e03f0-b713-4cb7-874e-91f5b0a668ea::INFO::2014-01-16 16:36:01,873::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:01,873::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:01,874::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:36:01,901::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,074::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,399::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,399::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,400::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:02,550::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:36:02,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:36:02,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:36:02,551::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:36:02,553::task::579::TaskManager.Task::(_updateState) Task=`85a969fb-c553-45f3-b496-283e1ced7ad5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:36:02,553::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:36:02,554::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:36:02,554::task::1168::TaskManager.Task::(prepare) Task=`85a969fb-c553-45f3-b496-283e1ced7ad5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:36:02,554::task::579::TaskManager.Task::(_updateState) Task=`85a969fb-c553-45f3-b496-283e1ced7ad5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:36:02,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:36:02,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:36:02,555::task::974::TaskManager.Task::(_decref) Task=`85a969fb-c553-45f3-b496-283e1ced7ad5`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:36:02,555::task::579::TaskManager.Task::(_updateState) Task=`9a0537f1-5112-4c65-a101-5a8dd5cc5865`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:36:02,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:36:02,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:36:02,556::task::1168::TaskManager.Task::(prepare) Task=`9a0537f1-5112-4c65-a101-5a8dd5cc5865`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:36:02,556::task::579::TaskManager.Task::(_updateState) Task=`9a0537f1-5112-4c65-a101-5a8dd5cc5865`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:36:02,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:36:02,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:36:02,556::task::974::TaskManager.Task::(_decref) Task=`9a0537f1-5112-4c65-a101-5a8dd5cc5865`::ref 0 aborting False >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,648::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,649::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,649::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >192e03f0-b713-4cb7-874e-91f5b0a668ea::INFO::2014-01-16 16:36:02,650::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,650::task::1168::TaskManager.Task::(prepare) Task=`f644ec26-8bc6-45bb-969f-d78cda59e537`::finished: None >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,650::task::579::TaskManager.Task::(_updateState) Task=`f644ec26-8bc6-45bb-969f-d78cda59e537`::moving from state preparing -> state finished >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,650::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,650::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,650::task::974::TaskManager.Task::(_decref) Task=`f644ec26-8bc6-45bb-969f-d78cda59e537`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 16:36:02,669::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,670::task::579::TaskManager.Task::(_updateState) Task=`235a259a-923c-4241-aa0a-65c34806432b`::moving from state init -> state preparing >192e03f0-b713-4cb7-874e-91f5b0a668ea::INFO::2014-01-16 16:36:02,671::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >libvirtEventLoop::DEBUG::2014-01-16 16:36:02,671::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >192e03f0-b713-4cb7-874e-91f5b0a668ea::INFO::2014-01-16 16:36:02,672::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,672::task::1168::TaskManager.Task::(prepare) Task=`235a259a-923c-4241-aa0a-65c34806432b`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,672::task::579::TaskManager.Task::(_updateState) Task=`235a259a-923c-4241-aa0a-65c34806432b`::moving from state preparing -> state finished >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,673::task::974::TaskManager.Task::(_decref) Task=`235a259a-923c-4241-aa0a-65c34806432b`::ref 0 aborting False >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,673::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 7516192768, current size 7516192768 >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,677::task::1168::TaskManager.Task::(prepare) Task=`f0baadfd-c2f9-47b7-83f8-8e71f929f13a`::finished: None >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,678::task::579::TaskManager.Task::(_updateState) Task=`f0baadfd-c2f9-47b7-83f8-8e71f929f13a`::moving from state preparing -> state finished >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,678::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,678::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,678::task::974::TaskManager.Task::(_decref) Task=`f0baadfd-c2f9-47b7-83f8-8e71f929f13a`::ref 0 aborting False >192e03f0-b713-4cb7-874e-91f5b0a668ea::DEBUG::2014-01-16 16:36:02,679::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-33::DEBUG::2014-01-16 16:36:02,859::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00443 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:03,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:36:03,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:36:03,553::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:03,903::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:03,904::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:36:04,537::task::579::TaskManager.Task::(_updateState) Task=`836ba67d-8a67-401f-878c-367b773ba79d`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:36:04,538::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:36:04,538::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:36:04,538::task::1168::TaskManager.Task::(prepare) Task=`836ba67d-8a67-401f-878c-367b773ba79d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:36:04,538::task::579::TaskManager.Task::(_updateState) Task=`836ba67d-8a67-401f-878c-367b773ba79d`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:36:04,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:36:04,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:36:04,539::task::974::TaskManager.Task::(_decref) Task=`836ba67d-8a67-401f-878c-367b773ba79d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:04,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:36:04,554::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:04,862::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:04,881::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00136787 s, 3.0 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:04,882::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:04,882::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-53040::DEBUG::2014-01-16 16:36:05,251::task::579::TaskManager.Task::(_updateState) Task=`8210787e-7fa6-4b99-bf25-8ded7c347227`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:36:05,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 16:36:05,253::task::579::TaskManager.Task::(_updateState) Task=`02c03d92-007d-43d9-84ec-6e940360f64c`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:36:05,253::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:36:05,254::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:36:05,255::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:36:05,256::task::1168::TaskManager.Task::(prepare) Task=`8210787e-7fa6-4b99-bf25-8ded7c347227`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:36:05,256::task::1168::TaskManager.Task::(prepare) Task=`02c03d92-007d-43d9-84ec-6e940360f64c`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:36:05,257::task::579::TaskManager.Task::(_updateState) Task=`8210787e-7fa6-4b99-bf25-8ded7c347227`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:36:05,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:36:05,258::task::579::TaskManager.Task::(_updateState) Task=`02c03d92-007d-43d9-84ec-6e940360f64c`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:36:05,259::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:36:05,260::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:36:05,261::task::974::TaskManager.Task::(_decref) Task=`8210787e-7fa6-4b99-bf25-8ded7c347227`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:36:05,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:36:05,262::task::974::TaskManager.Task::(_decref) Task=`02c03d92-007d-43d9-84ec-6e940360f64c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:05,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:36:05,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:36:05,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:36:05,556::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:05,895::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00051 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:05,906::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:06,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:36:06,695::task::579::TaskManager.Task::(_updateState) Task=`060f61f3-8255-447c-ba0c-ea40c4b4d168`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:36:06,696::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:36:06,697::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:36:06,697::task::1168::TaskManager.Task::(prepare) Task=`060f61f3-8255-447c-ba0c-ea40c4b4d168`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:36:06,697::task::579::TaskManager.Task::(_updateState) Task=`060f61f3-8255-447c-ba0c-ea40c4b4d168`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:36:06,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:36:06,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:36:06,698::task::974::TaskManager.Task::(_decref) Task=`060f61f3-8255-447c-ba0c-ea40c4b4d168`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:36:06,698::task::579::TaskManager.Task::(_updateState) Task=`f9a017e7-e80b-4b1e-bb17-81c67b39bd4c`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:36:06,698::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:36:06,699::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:36:06,699::task::1168::TaskManager.Task::(prepare) Task=`f9a017e7-e80b-4b1e-bb17-81c67b39bd4c`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:36:06,699::task::579::TaskManager.Task::(_updateState) Task=`f9a017e7-e80b-4b1e-bb17-81c67b39bd4c`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:36:06,699::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:36:06,699::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:36:06,700::task::974::TaskManager.Task::(_decref) Task=`f9a017e7-e80b-4b1e-bb17-81c67b39bd4c`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:36:07,519::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:36:07,537::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000295552 s, 13.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:07,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:36:07,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:36:07,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:36:07,559::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:36:07,559::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:36:07,561::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:36:07,907::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:08,562::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:36:08,617::task::579::TaskManager.Task::(_updateState) Task=`cacc126b-fb8a-4ea8-a626-05b066b90b9e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:36:08,617::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:36:08,618::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:36:08,618::task::1168::TaskManager.Task::(prepare) Task=`cacc126b-fb8a-4ea8-a626-05b066b90b9e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:36:08,618::task::579::TaskManager.Task::(_updateState) Task=`cacc126b-fb8a-4ea8-a626-05b066b90b9e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:36:08,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:36:08,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:36:08,619::task::974::TaskManager.Task::(_decref) Task=`cacc126b-fb8a-4ea8-a626-05b066b90b9e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:36:08,619::task::579::TaskManager.Task::(_updateState) Task=`7ae262e0-b626-45d3-8e16-89f0e79b41f2`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:36:08,620::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:36:08,620::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:36:08,621::task::1168::TaskManager.Task::(prepare) Task=`7ae262e0-b626-45d3-8e16-89f0e79b41f2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:36:08,621::task::579::TaskManager.Task::(_updateState) Task=`7ae262e0-b626-45d3-8e16-89f0e79b41f2`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:36:08,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:36:08,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:36:08,621::task::974::TaskManager.Task::(_decref) Task=`7ae262e0-b626-45d3-8e16-89f0e79b41f2`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:36:08,643::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:36:08,650::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:36:08,652::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:36:08,657::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:36:08,659::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:36:08,659::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:36:08,659::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:36:08,665::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:36:08,683::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000249029 s, 1.5 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:36:08,692::task::579::TaskManager.Task::(_updateState) Task=`037e93e9-53f5-4187-83a1-02d29b47374b`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:36:08,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:36:08,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:36:08,693::task::1168::TaskManager.Task::(prepare) Task=`037e93e9-53f5-4187-83a1-02d29b47374b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:36:08,693::task::579::TaskManager.Task::(_updateState) Task=`037e93e9-53f5-4187-83a1-02d29b47374b`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:36:08,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:36:08,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:36:08,694::task::974::TaskManager.Task::(_decref) Task=`037e93e9-53f5-4187-83a1-02d29b47374b`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:36:08,787::task::579::TaskManager.Task::(_updateState) Task=`4c48610e-435a-4e89-b62c-ba236dbe88ef`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:36:08,788::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:36:08,788::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:36:08,788::task::1168::TaskManager.Task::(prepare) Task=`4c48610e-435a-4e89-b62c-ba236dbe88ef`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:36:08,788::task::579::TaskManager.Task::(_updateState) Task=`4c48610e-435a-4e89-b62c-ba236dbe88ef`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:36:08,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:36:08,789::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:36:08,789::task::974::TaskManager.Task::(_decref) Task=`4c48610e-435a-4e89-b62c-ba236dbe88ef`::ref 0 aborting False >Thread-221160::INFO::2014-01-16 16:36:08,831::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 7516192768, capacity: 10737418240, allocated: 6992689152, physical: 7516192768) >Thread-221160::DEBUG::2014-01-16 16:36:08,832::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 8192, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:08,832::task::579::TaskManager.Task::(_updateState) Task=`9274d148-dbbb-4e4b-8a0c-13b19e76b41c`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:08,832::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 8192, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=8589934592, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:08,833::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:08,833::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-33::DEBUG::2014-01-16 16:36:08,834::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000200000000000000' >Thread-221160::DEBUG::2014-01-16 16:36:08,835::task::1168::TaskManager.Task::(prepare) Task=`9274d148-dbbb-4e4b-8a0c-13b19e76b41c`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:08,836::task::579::TaskManager.Task::(_updateState) Task=`9274d148-dbbb-4e4b-8a0c-13b19e76b41c`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:08,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2014-01-16 16:36:08,838::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-221160::DEBUG::2014-01-16 16:36:08,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:08,854::task::974::TaskManager.Task::(_decref) Task=`9274d148-dbbb-4e4b-8a0c-13b19e76b41c`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:36:08,857::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.000854027 s, 4.8 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:08,857::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:08,858::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:36:08,909::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286816::DEBUG::2014-01-16 16:36:09,540::task::579::TaskManager.Task::(_updateState) Task=`d87538f0-dbcb-4fe2-9f1c-7f2fb78e4aa1`::moving from state init -> state preparing >Thread-286816::INFO::2014-01-16 16:36:09,541::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286816::INFO::2014-01-16 16:36:09,541::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249029', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295552', 'lastCheck': '2.0', 'valid': True}} >Thread-286816::DEBUG::2014-01-16 16:36:09,541::task::1168::TaskManager.Task::(prepare) Task=`d87538f0-dbcb-4fe2-9f1c-7f2fb78e4aa1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000249029', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295552', 'lastCheck': '2.0', 'valid': True}} >Thread-286816::DEBUG::2014-01-16 16:36:09,542::task::579::TaskManager.Task::(_updateState) Task=`d87538f0-dbcb-4fe2-9f1c-7f2fb78e4aa1`::moving from state preparing -> state finished >Thread-286816::DEBUG::2014-01-16 16:36:09,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286816::DEBUG::2014-01-16 16:36:09,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286816::DEBUG::2014-01-16 16:36:09,542::task::974::TaskManager.Task::(_decref) Task=`d87538f0-dbcb-4fe2-9f1c-7f2fb78e4aa1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:09,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:36:09,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:36:09,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:09,871::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00132 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:09,918::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:36:09,983::task::579::TaskManager.Task::(_updateState) Task=`0fedf305-3a9c-4e2d-ac70-5e2d829adf6a`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:36:09,983::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:36:09,984::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:36:09,984::task::1168::TaskManager.Task::(prepare) Task=`0fedf305-3a9c-4e2d-ac70-5e2d829adf6a`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:36:09,984::task::579::TaskManager.Task::(_updateState) Task=`0fedf305-3a9c-4e2d-ac70-5e2d829adf6a`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:36:09,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:36:09,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:36:09,984::task::974::TaskManager.Task::(_decref) Task=`0fedf305-3a9c-4e2d-ac70-5e2d829adf6a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:10,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:36:10,566::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:36:10,566::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:36:10,861::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 7516192768, capacity: 10737418240, allocated: 7334133248, physical: 7516192768) >Thread-221160::DEBUG::2014-01-16 16:36:10,861::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 8192, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:10,862::task::579::TaskManager.Task::(_updateState) Task=`113abbf0-ab8b-447c-977e-475ae1c95223`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:10,862::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 8192, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=8589934592, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:10,862::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:10,862::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:36:10,862::task::1168::TaskManager.Task::(prepare) Task=`113abbf0-ab8b-447c-977e-475ae1c95223`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:10,862::task::579::TaskManager.Task::(_updateState) Task=`113abbf0-ab8b-447c-977e-475ae1c95223`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:10,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:36:10,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:10,863::task::974::TaskManager.Task::(_decref) Task=`113abbf0-ab8b-447c-977e-475ae1c95223`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 16:36:11,013::task::579::TaskManager.Task::(_updateState) Task=`0ebeb6ee-410a-456c-8a0b-0c6c44d7fcc2`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:36:11,014::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:36:11,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:36:11,014::task::1168::TaskManager.Task::(prepare) Task=`0ebeb6ee-410a-456c-8a0b-0c6c44d7fcc2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:36:11,014::task::579::TaskManager.Task::(_updateState) Task=`0ebeb6ee-410a-456c-8a0b-0c6c44d7fcc2`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:36:11,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:36:11,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:36:11,015::task::974::TaskManager.Task::(_decref) Task=`0ebeb6ee-410a-456c-8a0b-0c6c44d7fcc2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:11,567::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:36:11,568::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:36:11,568::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:36:11,568::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:11,873::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f45981525f0> >Thread-33::DEBUG::2014-01-16 16:36:11,873::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:11,889::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00116058 s, 3.5 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:36:11,890::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000200000000000000' >Thread-33::INFO::2014-01-16 16:36:11,890::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-28::DEBUG::2014-01-16 16:36:11,891::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:11,893::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 39fc396b-3baf-4e13-a220-a57baae6370d running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 8192, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:36:11,894::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:11,907::task::579::TaskManager.Task::(_updateState) Task=`97f63733-0096-46fc-9ab8-5f13537510f3`::moving from state init -> state preparing >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:11,910::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >libvirtEventLoop::DEBUG::2014-01-16 16:36:11,921::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:11,925::task::579::TaskManager.Task::(_updateState) Task=`1e24248c-26f5-4a01-88a4-3d2d7e9dc108`::moving from state init -> state preparing >Thread-189817::DEBUG::2014-01-16 16:36:11,929::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >39fc396b-3baf-4e13-a220-a57baae6370d::INFO::2014-01-16 16:36:11,930::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >libvirtEventLoop::DEBUG::2014-01-16 16:36:11,931::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:11,933::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:11,933::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,188::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,512::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,512::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,513::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:12,569::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,785::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,786::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,786::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >39fc396b-3baf-4e13-a220-a57baae6370d::INFO::2014-01-16 16:36:12,786::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,786::task::1168::TaskManager.Task::(prepare) Task=`1e24248c-26f5-4a01-88a4-3d2d7e9dc108`::finished: None >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,786::task::579::TaskManager.Task::(_updateState) Task=`1e24248c-26f5-4a01-88a4-3d2d7e9dc108`::moving from state preparing -> state finished >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,787::task::974::TaskManager.Task::(_decref) Task=`1e24248c-26f5-4a01-88a4-3d2d7e9dc108`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 16:36:12,814::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >libvirtEventLoop::DEBUG::2014-01-16 16:36:12,817::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,817::task::579::TaskManager.Task::(_updateState) Task=`4b5107ab-6e89-445f-8c92-8c1118f06b59`::moving from state init -> state preparing >39fc396b-3baf-4e13-a220-a57baae6370d::INFO::2014-01-16 16:36:12,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >39fc396b-3baf-4e13-a220-a57baae6370d::INFO::2014-01-16 16:36:12,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,819::task::1168::TaskManager.Task::(prepare) Task=`4b5107ab-6e89-445f-8c92-8c1118f06b59`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,819::task::579::TaskManager.Task::(_updateState) Task=`4b5107ab-6e89-445f-8c92-8c1118f06b59`::moving from state preparing -> state finished >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,820::task::974::TaskManager.Task::(_decref) Task=`4b5107ab-6e89-445f-8c92-8c1118f06b59`::ref 0 aborting False >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,820::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 8589934592, current size 8589934592 >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,824::task::1168::TaskManager.Task::(prepare) Task=`97f63733-0096-46fc-9ab8-5f13537510f3`::finished: None >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,824::task::579::TaskManager.Task::(_updateState) Task=`97f63733-0096-46fc-9ab8-5f13537510f3`::moving from state preparing -> state finished >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,825::task::974::TaskManager.Task::(_decref) Task=`97f63733-0096-46fc-9ab8-5f13537510f3`::ref 0 aborting False >39fc396b-3baf-4e13-a220-a57baae6370d::DEBUG::2014-01-16 16:36:12,825::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-33::DEBUG::2014-01-16 16:36:12,914::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.0069 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:13,571::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:36:13,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:13,932::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:13,933::task::579::TaskManager.Task::(_updateState) Task=`465dd549-6195-4cb6-b4a3-58b8dd39f254`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:36:13,933::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:36:13,934::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:36:13,934::task::1168::TaskManager.Task::(prepare) Task=`465dd549-6195-4cb6-b4a3-58b8dd39f254`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:36:13,934::task::579::TaskManager.Task::(_updateState) Task=`465dd549-6195-4cb6-b4a3-58b8dd39f254`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:36:13,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:36:13,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:36:13,934::task::974::TaskManager.Task::(_decref) Task=`465dd549-6195-4cb6-b4a3-58b8dd39f254`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:36:13,936::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:36:13,936::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:36:13,938::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:13,940::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:13,941::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:36:14,137::task::579::TaskManager.Task::(_updateState) Task=`6150ce11-8737-4f69-b0d2-845f8decf539`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:36:14,137::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:36:14,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:36:14,137::task::1168::TaskManager.Task::(prepare) Task=`6150ce11-8737-4f69-b0d2-845f8decf539`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:36:14,138::task::579::TaskManager.Task::(_updateState) Task=`6150ce11-8737-4f69-b0d2-845f8decf539`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:36:14,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:36:14,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:36:14,138::task::974::TaskManager.Task::(_decref) Task=`6150ce11-8737-4f69-b0d2-845f8decf539`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:14,572::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:14,915::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:14,932::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00174814 s, 2.3 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:14,932::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:14,932::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:15,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:15,942::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:36:15,945::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00089 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:16,575::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 16:36:16,578::task::579::TaskManager.Task::(_updateState) Task=`484b91b5-af2c-4ceb-8468-1818c2882a11`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:36:16,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:36:16,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:36:16,580::task::1168::TaskManager.Task::(prepare) Task=`484b91b5-af2c-4ceb-8468-1818c2882a11`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:36:16,580::task::579::TaskManager.Task::(_updateState) Task=`484b91b5-af2c-4ceb-8468-1818c2882a11`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:36:16,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:36:16,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:36:16,580::task::974::TaskManager.Task::(_decref) Task=`484b91b5-af2c-4ceb-8468-1818c2882a11`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 16:36:17,542::task::579::TaskManager.Task::(_updateState) Task=`153e3382-b5c0-4fa8-8b92-7b587a82c24f`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:36:17,542::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:36:17,543::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:36:17,544::task::1168::TaskManager.Task::(prepare) Task=`153e3382-b5c0-4fa8-8b92-7b587a82c24f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-22::DEBUG::2014-01-16 16:36:17,544::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-49313::DEBUG::2014-01-16 16:36:17,545::task::579::TaskManager.Task::(_updateState) Task=`153e3382-b5c0-4fa8-8b92-7b587a82c24f`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:36:17,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:36:17,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:36:17,568::task::974::TaskManager.Task::(_decref) Task=`153e3382-b5c0-4fa8-8b92-7b587a82c24f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:36:17,572::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00025719 s, 15.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:17,576::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:17,944::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:18,577::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:36:18,692::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:36:18,711::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026265 s, 1.4 MB/s\n'; <rc> = 0 >Thread-221160::INFO::2014-01-16 16:36:18,886::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8237135872, physical: 8589934592) >Thread-221160::DEBUG::2014-01-16 16:36:18,886::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:18,887::task::579::TaskManager.Task::(_updateState) Task=`20ffc4f4-9aa1-4bee-a3ab-d59ca4792a1f`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:18,887::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:18,887::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:18,888::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-33::DEBUG::2014-01-16 16:36:18,888::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000240000000000000' >Thread-221160::DEBUG::2014-01-16 16:36:18,889::task::1168::TaskManager.Task::(prepare) Task=`20ffc4f4-9aa1-4bee-a3ab-d59ca4792a1f`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:18,890::task::579::TaskManager.Task::(_updateState) Task=`20ffc4f4-9aa1-4bee-a3ab-d59ca4792a1f`::moving from state preparing -> state finished >Thread-33::DEBUG::2014-01-16 16:36:18,891::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-221160::DEBUG::2014-01-16 16:36:18,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:36:18,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:18,908::task::974::TaskManager.Task::(_decref) Task=`20ffc4f4-9aa1-4bee-a3ab-d59ca4792a1f`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:36:18,910::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00188288 s, 2.2 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:18,911::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:18,911::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:36:18,945::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:19,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:36:19,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:19,924::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00118 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:19,947::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:20,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:36:20,914::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8578399744, physical: 8589934592) >Thread-221160::DEBUG::2014-01-16 16:36:20,914::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:20,915::task::579::TaskManager.Task::(_updateState) Task=`f2443cc1-297e-45df-b473-b304fcdf0359`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:20,915::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:20,916::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:20,916::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:36:20,916::task::1168::TaskManager.Task::(prepare) Task=`f2443cc1-297e-45df-b473-b304fcdf0359`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:20,916::task::579::TaskManager.Task::(_updateState) Task=`f2443cc1-297e-45df-b473-b304fcdf0359`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:20,917::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:36:20,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:20,917::task::974::TaskManager.Task::(_decref) Task=`f2443cc1-297e-45df-b473-b304fcdf0359`::ref 0 aborting False >libvirtEventLoop::INFO::2014-01-16 16:36:21,139::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error enospc >libvirtEventLoop::INFO::2014-01-16 16:36:21,144::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8590130688, physical: 8589934592) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,144::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,145::task::579::TaskManager.Task::(_updateState) Task=`7f6e3a8f-cd0f-43ba-926b-94afc166836c`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-01-16 16:36:21,145::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,146::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >libvirtEventLoop::INFO::2014-01-16 16:36:21,146::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,146::task::1168::TaskManager.Task::(prepare) Task=`7f6e3a8f-cd0f-43ba-926b-94afc166836c`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,147::task::579::TaskManager.Task::(_updateState) Task=`7f6e3a8f-cd0f-43ba-926b-94afc166836c`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,147::task::974::TaskManager.Task::(_decref) Task=`7f6e3a8f-cd0f-43ba-926b-94afc166836c`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,148::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 2 opaque None >libvirtEventLoop::INFO::2014-01-16 16:36:21,148::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error enospc >libvirtEventLoop::INFO::2014-01-16 16:36:21,152::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8590130688, physical: 8589934592) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,153::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,153::task::579::TaskManager.Task::(_updateState) Task=`18b82a54-c65f-4c76-90d4-cf64e7393359`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-01-16 16:36:21,153::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,154::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >libvirtEventLoop::INFO::2014-01-16 16:36:21,154::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,154::task::1168::TaskManager.Task::(prepare) Task=`18b82a54-c65f-4c76-90d4-cf64e7393359`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,154::task::579::TaskManager.Task::(_updateState) Task=`18b82a54-c65f-4c76-90d4-cf64e7393359`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,155::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,155::task::974::TaskManager.Task::(_decref) Task=`18b82a54-c65f-4c76-90d4-cf64e7393359`::ref 0 aborting False >libvirtEventLoop::INFO::2014-01-16 16:36:21,156::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error enospc >libvirtEventLoop::INFO::2014-01-16 16:36:21,160::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8590130688, physical: 8589934592) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,160::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,160::task::579::TaskManager.Task::(_updateState) Task=`06a2c090-cbd0-4ecb-a803-380fdb6ccd08`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-01-16 16:36:21,160::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,161::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >libvirtEventLoop::INFO::2014-01-16 16:36:21,161::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,161::task::1168::TaskManager.Task::(prepare) Task=`06a2c090-cbd0-4ecb-a803-380fdb6ccd08`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,161::task::579::TaskManager.Task::(_updateState) Task=`06a2c090-cbd0-4ecb-a803-380fdb6ccd08`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,162::task::974::TaskManager.Task::(_decref) Task=`06a2c090-cbd0-4ecb-a803-380fdb6ccd08`::ref 0 aborting False >libvirtEventLoop::INFO::2014-01-16 16:36:21,162::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error enospc >libvirtEventLoop::INFO::2014-01-16 16:36:21,166::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8590130688, physical: 8589934592) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,166::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,166::task::579::TaskManager.Task::(_updateState) Task=`bb0a691b-032e-4da3-9989-9706574ddb92`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-01-16 16:36:21,166::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,166::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >libvirtEventLoop::INFO::2014-01-16 16:36:21,167::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,167::task::1168::TaskManager.Task::(prepare) Task=`bb0a691b-032e-4da3-9989-9706574ddb92`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,167::task::579::TaskManager.Task::(_updateState) Task=`bb0a691b-032e-4da3-9989-9706574ddb92`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,167::task::974::TaskManager.Task::(_decref) Task=`bb0a691b-032e-4da3-9989-9706574ddb92`::ref 0 aborting False >libvirtEventLoop::INFO::2014-01-16 16:36:21,168::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error enospc >libvirtEventLoop::INFO::2014-01-16 16:36:21,172::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8590130688, physical: 8589934592) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,172::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,172::task::579::TaskManager.Task::(_updateState) Task=`7cddeb07-69b8-4f55-81b2-33661dc30370`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-01-16 16:36:21,173::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,173::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >libvirtEventLoop::INFO::2014-01-16 16:36:21,173::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,173::task::1168::TaskManager.Task::(prepare) Task=`7cddeb07-69b8-4f55-81b2-33661dc30370`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,173::task::579::TaskManager.Task::(_updateState) Task=`7cddeb07-69b8-4f55-81b2-33661dc30370`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,174::task::974::TaskManager.Task::(_decref) Task=`7cddeb07-69b8-4f55-81b2-33661dc30370`::ref 0 aborting False >libvirtEventLoop::INFO::2014-01-16 16:36:21,174::vm::4369::vm.Vm::(_onAbnormalStop) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::abnormal vm stop device virtio-disk0 error enospc >libvirtEventLoop::INFO::2014-01-16 16:36:21,178::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 8589934592, capacity: 10737418240, allocated: 8590130688, physical: 8589934592) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,178::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,179::task::579::TaskManager.Task::(_updateState) Task=`2864491e-74d4-42c8-b3d5-0db9cdb945b7`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-01-16 16:36:21,179::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=9663676416, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,179::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >libvirtEventLoop::INFO::2014-01-16 16:36:21,180::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,180::task::1168::TaskManager.Task::(prepare) Task=`2864491e-74d4-42c8-b3d5-0db9cdb945b7`::finished: None >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,180::task::579::TaskManager.Task::(_updateState) Task=`2864491e-74d4-42c8-b3d5-0db9cdb945b7`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:21,180::task::974::TaskManager.Task::(_decref) Task=`2864491e-74d4-42c8-b3d5-0db9cdb945b7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:21,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:21,925::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f4550444ef0> >Thread-33::DEBUG::2014-01-16 16:36:21,925::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f459011d9e0> >Thread-33::DEBUG::2014-01-16 16:36:21,926::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f44bc0f4998> >Thread-33::DEBUG::2014-01-16 16:36:21,926::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f459011dc20> >Thread-33::DEBUG::2014-01-16 16:36:21,926::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f44e42441b8> >Thread-33::DEBUG::2014-01-16 16:36:21,926::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f44bc0fcc20> >Thread-33::DEBUG::2014-01-16 16:36:21,927::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f44e4244128> >Thread-33::DEBUG::2014-01-16 16:36:21,927::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:21,943::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0012573 s, 3.3 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:36:21,943::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000240000000000000' >Thread-33::INFO::2014-01-16 16:36:21,944::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >163c4892-0d44-4874-87f5-6ece49e46a3e::DEBUG::2014-01-16 16:36:21,944::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:21,946::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 319d7a81-0c26-4d64-aef6-95c58e394fe9 running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 9216, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:36:21,947::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:36:21,961::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:21,964::task::579::TaskManager.Task::(_updateState) Task=`9f4b7330-f2d6-47da-a0d3-c10419e412c3`::moving from state init -> state preparing >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:21,968::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:21,970::task::579::TaskManager.Task::(_updateState) Task=`76f55adf-1831-45e5-afc2-36c917e143de`::moving from state init -> state preparing >319d7a81-0c26-4d64-aef6-95c58e394fe9::INFO::2014-01-16 16:36:21,970::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:21,971::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:21,972::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:22,170::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-286822::DEBUG::2014-01-16 16:36:22,334::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('6b03257a-90ec-4a1e-b285-d462b8e8c277',) {} >Thread-286822::DEBUG::2014-01-16 16:36:22,341::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Paused', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23174', 'displayIp': '0', 'displayPort': u'5954', 'session': 'Unknown', 'displaySecurePort': u'5955', 'timeOffset': '0', 'hash': '2903861395083110923', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '2097152'}, 'pauseCode': 'ENOSPC', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet30': {'macAddr': '00:1a:4a:22:39:8d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet30'}}, 'vmId': '6b03257a-90ec-4a1e-b285-d462b8e8c277', 'displayType': 'qxl', 'cpuUser': '38.95', 'disks': {u'vda': {'readLatency': '4671986', 'apparentsize': '8589934592', 'writeLatency': '3309794', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'flushLatency': '0', 'readRate': '2108.48', 'truesize': '8589934592', 'writeRate': '39998771.08'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.43', 'elapsedTime': '170794', 'vmType': 'kvm', 'cpuSys': '14.57', 'appsList': [], 'guestIPs': ''}]} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:22,544::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:22,545::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:22,545::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:22,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:22,971::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00842 s, 4.1 kB/s\n'; <rc> = 0 >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,051::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,052::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,052::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >319d7a81-0c26-4d64-aef6-95c58e394fe9::INFO::2014-01-16 16:36:23,053::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,053::task::1168::TaskManager.Task::(prepare) Task=`76f55adf-1831-45e5-afc2-36c917e143de`::finished: None >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,053::task::579::TaskManager.Task::(_updateState) Task=`76f55adf-1831-45e5-afc2-36c917e143de`::moving from state preparing -> state finished >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,054::task::974::TaskManager.Task::(_decref) Task=`76f55adf-1831-45e5-afc2-36c917e143de`::ref 0 aborting False >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,055::task::579::TaskManager.Task::(_updateState) Task=`64a1e8a0-cc9c-4e67-bacb-cf3a3cb5d8eb`::moving from state init -> state preparing >319d7a81-0c26-4d64-aef6-95c58e394fe9::INFO::2014-01-16 16:36:23,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >319d7a81-0c26-4d64-aef6-95c58e394fe9::INFO::2014-01-16 16:36:23,057::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '9663676416', 'apparentsize': '9663676416'} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,057::task::1168::TaskManager.Task::(prepare) Task=`64a1e8a0-cc9c-4e67-bacb-cf3a3cb5d8eb`::finished: {'truesize': '9663676416', 'apparentsize': '9663676416'} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,057::task::579::TaskManager.Task::(_updateState) Task=`64a1e8a0-cc9c-4e67-bacb-cf3a3cb5d8eb`::moving from state preparing -> state finished >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,058::task::974::TaskManager.Task::(_decref) Task=`64a1e8a0-cc9c-4e67-bacb-cf3a3cb5d8eb`::ref 0 aborting False >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,058::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 9663676416, current size 9663676416 >libvirtEventLoop::DEBUG::2014-01-16 16:36:23,077::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,078::task::1168::TaskManager.Task::(prepare) Task=`9f4b7330-f2d6-47da-a0d3-c10419e412c3`::finished: None >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,078::task::579::TaskManager.Task::(_updateState) Task=`9f4b7330-f2d6-47da-a0d3-c10419e412c3`::moving from state preparing -> state finished >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-01-16 16:36:23,079::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,080::task::974::TaskManager.Task::(_decref) Task=`9f4b7330-f2d6-47da-a0d3-c10419e412c3`::ref 0 aborting False >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:23,081::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:23,583::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:23,968::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:23,969::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:24,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:36:24,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:36:24,584::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:36:24,709::task::579::TaskManager.Task::(_updateState) Task=`e126e15c-ea75-4e09-a609-7c218d7cf0ec`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:36:24,710::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:36:24,710::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:36:24,710::task::1168::TaskManager.Task::(prepare) Task=`e126e15c-ea75-4e09-a609-7c218d7cf0ec`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:36:24,710::task::579::TaskManager.Task::(_updateState) Task=`e126e15c-ea75-4e09-a609-7c218d7cf0ec`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:36:24,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:36:24,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:36:24,711::task::974::TaskManager.Task::(_decref) Task=`e126e15c-ea75-4e09-a609-7c218d7cf0ec`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:36:24,711::task::579::TaskManager.Task::(_updateState) Task=`8d4997bb-ccc2-487b-869f-a6749b61ca18`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:36:24,711::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:36:24,712::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:36:24,712::task::1168::TaskManager.Task::(prepare) Task=`8d4997bb-ccc2-487b-869f-a6749b61ca18`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:36:24,712::task::579::TaskManager.Task::(_updateState) Task=`8d4997bb-ccc2-487b-869f-a6749b61ca18`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:36:24,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:36:24,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:36:24,712::task::974::TaskManager.Task::(_decref) Task=`8d4997bb-ccc2-487b-869f-a6749b61ca18`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:36:24,810::task::579::TaskManager.Task::(_updateState) Task=`be4c12c7-3c2d-4113-8562-c6921f362f43`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:36:24,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:36:24,812::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:36:24,812::task::1168::TaskManager.Task::(prepare) Task=`be4c12c7-3c2d-4113-8562-c6921f362f43`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:36:24,812::task::579::TaskManager.Task::(_updateState) Task=`be4c12c7-3c2d-4113-8562-c6921f362f43`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:36:24,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:36:24,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:36:24,813::task::974::TaskManager.Task::(_decref) Task=`be4c12c7-3c2d-4113-8562-c6921f362f43`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:36:24,973::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:24,990::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00121338 s, 3.4 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:24,990::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:24,991::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-286823::DEBUG::2014-01-16 16:36:25,472::task::579::TaskManager.Task::(_updateState) Task=`e85fc733-c2d0-49d4-88f7-2618b2ec8001`::moving from state init -> state preparing >Thread-286823::INFO::2014-01-16 16:36:25,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286823::INFO::2014-01-16 16:36:25,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026265', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025719', 'lastCheck': '7.9', 'valid': True}} >Thread-286823::DEBUG::2014-01-16 16:36:25,473::task::1168::TaskManager.Task::(prepare) Task=`e85fc733-c2d0-49d4-88f7-2618b2ec8001`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026265', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025719', 'lastCheck': '7.9', 'valid': True}} >Thread-286823::DEBUG::2014-01-16 16:36:25,473::task::579::TaskManager.Task::(_updateState) Task=`e85fc733-c2d0-49d4-88f7-2618b2ec8001`::moving from state preparing -> state finished >Thread-286823::DEBUG::2014-01-16 16:36:25,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286823::DEBUG::2014-01-16 16:36:25,473::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286823::DEBUG::2014-01-16 16:36:25,473::task::974::TaskManager.Task::(_decref) Task=`e85fc733-c2d0-49d4-88f7-2618b2ec8001`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:25,586::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:36:25,586::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:36:25,614::task::579::TaskManager.Task::(_updateState) Task=`ed6c21d0-8097-466d-aa77-ade0dace9a1e`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:36:25,615::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:36:25,615::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:36:25,615::task::1168::TaskManager.Task::(prepare) Task=`ed6c21d0-8097-466d-aa77-ade0dace9a1e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:36:25,615::task::579::TaskManager.Task::(_updateState) Task=`ed6c21d0-8097-466d-aa77-ade0dace9a1e`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:36:25,615::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:36:25,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:36:25,616::task::974::TaskManager.Task::(_decref) Task=`ed6c21d0-8097-466d-aa77-ade0dace9a1e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:36:25,970::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:36:26,003::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00063 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:26,587::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:36:26,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:36:26,588::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:36:27,579::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:27,598::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:36:27,600::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:36:27,602::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000222655 s, 18.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:27,972::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:28,601::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:36:28,602::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:36:28,719::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:36:28,738::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000287878 s, 1.3 MB/s\n'; <rc> = 0 >Thread-221160::INFO::2014-01-16 16:36:28,938::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 9663676416, capacity: 10737418240, allocated: 9437969920, physical: 9663676416) >Thread-221160::DEBUG::2014-01-16 16:36:28,939::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 10240, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:28,939::task::579::TaskManager.Task::(_updateState) Task=`496d5747-3d67-4eb6-8859-ec5955b6f0a0`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:28,939::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 10240, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=10737418240, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:28,940::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:28,940::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-33::DEBUG::2014-01-16 16:36:28,940::storage_mailbox::428::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000280000000000000' >Thread-221160::DEBUG::2014-01-16 16:36:28,941::task::1168::TaskManager.Task::(prepare) Task=`496d5747-3d67-4eb6-8859-ec5955b6f0a0`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:28,942::task::579::TaskManager.Task::(_updateState) Task=`496d5747-3d67-4eb6-8859-ec5955b6f0a0`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:28,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2014-01-16 16:36:28,943::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-221160::DEBUG::2014-01-16 16:36:28,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:28,958::task::974::TaskManager.Task::(_decref) Task=`496d5747-3d67-4eb6-8859-ec5955b6f0a0`::ref 0 aborting False >Thread-33::DEBUG::2014-01-16 16:36:28,968::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.000839158 s, 4.9 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:28,970::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:28,972::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:36:28,987::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:36:28,989::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:36:28,998::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:36:29,196::task::579::TaskManager.Task::(_updateState) Task=`8a360d09-9376-46e3-ab4f-697d1039d2c1`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:36:29,196::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:36:29,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:36:29,197::task::1168::TaskManager.Task::(prepare) Task=`8a360d09-9376-46e3-ab4f-697d1039d2c1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:36:29,197::task::579::TaskManager.Task::(_updateState) Task=`8a360d09-9376-46e3-ab4f-697d1039d2c1`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:36:29,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:36:29,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:36:29,197::task::974::TaskManager.Task::(_decref) Task=`8a360d09-9376-46e3-ab4f-697d1039d2c1`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:36:29,213::task::579::TaskManager.Task::(_updateState) Task=`9b5c7278-dc7d-41f3-b86b-9fe8c313c643`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:36:29,213::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:36:29,213::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:36:29,213::task::1168::TaskManager.Task::(prepare) Task=`9b5c7278-dc7d-41f3-b86b-9fe8c313c643`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:36:29,213::task::579::TaskManager.Task::(_updateState) Task=`9b5c7278-dc7d-41f3-b86b-9fe8c313c643`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:36:29,214::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:36:29,214::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:36:29,214::task::974::TaskManager.Task::(_decref) Task=`9b5c7278-dc7d-41f3-b86b-9fe8c313c643`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:29,603::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:29,993::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00666 s, 4.1 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:29,999::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:30,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:36:30,605::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::INFO::2014-01-16 16:36:30,964::vm::2355::vm.Vm::(extendDrivesIfNeeded) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f on domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (apparent: 9663676416, capacity: 10737418240, allocated: 9437969920, physical: 9663676416) >Thread-221160::DEBUG::2014-01-16 16:36:30,964::vm::2439::vm.Vm::(__extendDriveVolume) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Requesting an extension for the volume: {'newSize': 10240, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'} >Thread-221160::DEBUG::2014-01-16 16:36:30,965::task::579::TaskManager.Task::(_updateState) Task=`acb24934-b05c-458d-91cd-3af2f324c856`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:30,965::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', volDict={'newSize': 10240, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}, newSize=10737418240, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>) >Thread-221160::DEBUG::2014-01-16 16:36:30,965::storage_mailbox::125::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volume: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f >Thread-221160::INFO::2014-01-16 16:36:30,965::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-221160::DEBUG::2014-01-16 16:36:30,965::task::1168::TaskManager.Task::(prepare) Task=`acb24934-b05c-458d-91cd-3af2f324c856`::finished: None >Thread-221160::DEBUG::2014-01-16 16:36:30,965::task::579::TaskManager.Task::(_updateState) Task=`acb24934-b05c-458d-91cd-3af2f324c856`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:30,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:36:30,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:30,966::task::974::TaskManager.Task::(_decref) Task=`acb24934-b05c-458d-91cd-3af2f324c856`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:31,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:36:31,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:31,996::storage_mailbox::411::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f44e4244dd0> >Thread-33::DEBUG::2014-01-16 16:36:31,996::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:36:32,012::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:36:32,014::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00109781 s, 3.7 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-01-16 16:36:32,014::storage_mailbox::344::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x02j\x05\xc0S\x0e\xaa\x8c\xf4N\xbf}\xfbt\x8b\xa0\x0f\xff|,ljv\x9b\xf1K\xb6\xe8[\x05p$000000000000280000000000000' >Thread-33::INFO::2014-01-16 16:36:32,014::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >319d7a81-0c26-4d64-aef6-95c58e394fe9::DEBUG::2014-01-16 16:36:32,015::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,017::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 98591118-667d-4233-b4e1-0fbc469f839a running: <function runTask at 0x1cc92a8> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f44e4239290>>, {'newSize': 10240, 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'name': u'vda', 'volumeID': '2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c'}) >Thread-33::DEBUG::2014-01-16 16:36:32,018::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,032::task::579::TaskManager.Task::(_updateState) Task=`42d4bbe8-1d82-49dc-b425-35e727fb7b70`::moving from state init -> state preparing >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,035::vm::2398::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Refreshing drive volume for vda (domainID: a08b74fb-7dbf-4ef4-8caa-0e53c0056a02, volumeID: 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f) >libvirtEventLoop::DEBUG::2014-01-16 16:36:32,044::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >libvirtEventLoop::DEBUG::2014-01-16 16:36:32,048::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Suspended detail 0 opaque None >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,049::task::579::TaskManager.Task::(_updateState) Task=`25abb138-e729-4fda-8a6c-d6e2ad3b4f79`::moving from state init -> state preparing >98591118-667d-4233-b4e1-0fbc469f839a::INFO::2014-01-16 16:36:32,054::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f') >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,058::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,065::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-286827::DEBUG::2014-01-16 16:36:32,126::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('6b03257a-90ec-4a1e-b285-d462b8e8c277',) {} >Thread-286827::DEBUG::2014-01-16 16:36:32,128::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Paused', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23174', 'displayIp': '0', 'displayPort': u'5954', 'session': 'Unknown', 'displaySecurePort': u'5955', 'timeOffset': '0', 'hash': '2903861395083110923', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '2097152'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet30': {'macAddr': '00:1a:4a:22:39:8d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet30'}}, 'vmId': '6b03257a-90ec-4a1e-b285-d462b8e8c277', 'displayType': 'qxl', 'cpuUser': '38.95', 'disks': {u'vda': {'readLatency': '4671986', 'apparentsize': '9663676416', 'writeLatency': '3309794', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'flushLatency': '0', 'readRate': '2108.48', 'truesize': '9663676416', 'writeRate': '39998771.08'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.17', 'elapsedTime': '170804', 'vmType': 'kvm', 'cpuSys': '14.57', 'appsList': [], 'guestIPs': ''}]} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,270::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:32,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:36:32,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:36:32,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:36:32,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,680::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,680::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,681::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f' (cwd None) >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,915::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,916::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,921::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >98591118-667d-4233-b4e1-0fbc469f839a::INFO::2014-01-16 16:36:32,922::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,922::task::1168::TaskManager.Task::(prepare) Task=`25abb138-e729-4fda-8a6c-d6e2ad3b4f79`::finished: None >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,922::task::579::TaskManager.Task::(_updateState) Task=`25abb138-e729-4fda-8a6c-d6e2ad3b4f79`::moving from state preparing -> state finished >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,923::task::974::TaskManager.Task::(_decref) Task=`25abb138-e729-4fda-8a6c-d6e2ad3b4f79`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 16:36:32,937::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >libvirtEventLoop::DEBUG::2014-01-16 16:36:32,939::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::event Resumed detail 0 opaque None >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,941::task::579::TaskManager.Task::(_updateState) Task=`92f67a9b-d647-4138-9b43-6a285a8f1876`::moving from state init -> state preparing >98591118-667d-4233-b4e1-0fbc469f839a::INFO::2014-01-16 16:36:32,941::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >98591118-667d-4233-b4e1-0fbc469f839a::INFO::2014-01-16 16:36:32,942::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,942::task::1168::TaskManager.Task::(prepare) Task=`92f67a9b-d647-4138-9b43-6a285a8f1876`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,942::task::579::TaskManager.Task::(_updateState) Task=`92f67a9b-d647-4138-9b43-6a285a8f1876`::moving from state preparing -> state finished >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,942::task::974::TaskManager.Task::(_decref) Task=`92f67a9b-d647-4138-9b43-6a285a8f1876`::ref 0 aborting False >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,943::vm::2418::vm.Vm::(__verifyVolumeExtension) vmId=`6b03257a-90ec-4a1e-b285-d462b8e8c277`::Verifying extension for volume 2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f, requested size 10737418240, current size 10737418240 >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,946::task::1168::TaskManager.Task::(prepare) Task=`42d4bbe8-1d82-49dc-b425-35e727fb7b70`::finished: None >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,947::task::579::TaskManager.Task::(_updateState) Task=`42d4bbe8-1d82-49dc-b425-35e727fb7b70`::moving from state preparing -> state finished >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,947::task::974::TaskManager.Task::(_decref) Task=`42d4bbe8-1d82-49dc-b425-35e727fb7b70`::ref 0 aborting False >98591118-667d-4233-b4e1-0fbc469f839a::DEBUG::2014-01-16 16:36:32,947::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-33::DEBUG::2014-01-16 16:36:33,036::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00567 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:33,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:36:33,617::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:36:33,617::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:34,015::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:34,016::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:36:34,204::task::579::TaskManager.Task::(_updateState) Task=`eee38fa6-4e63-4cf4-91cb-69b6bff0c76c`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:36:34,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:36:34,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:36:34,205::task::1168::TaskManager.Task::(prepare) Task=`eee38fa6-4e63-4cf4-91cb-69b6bff0c76c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:36:34,205::task::579::TaskManager.Task::(_updateState) Task=`eee38fa6-4e63-4cf4-91cb-69b6bff0c76c`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:36:34,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:36:34,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:36:34,205::task::974::TaskManager.Task::(_decref) Task=`eee38fa6-4e63-4cf4-91cb-69b6bff0c76c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:34,618::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:36:34,618::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-33::DEBUG::2014-01-16 16:36:35,039::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24' (cwd None) >Thread-33::DEBUG::2014-01-16 16:36:35,054::storage_mailbox::375::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00116208 s, 3.5 MB/s\n'; <rc> = 0 >Thread-33::INFO::2014-01-16 16:36:35,055::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24'] >Thread-33::DEBUG::2014-01-16 16:36:35,055::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/b3088fcc-d291-11e1-933a-0015c5f4698c/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24' (cwd None) >Thread-286829::DEBUG::2014-01-16 16:36:35,242::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('6b03257a-90ec-4a1e-b285-d462b8e8c277',) {} >Thread-286829::DEBUG::2014-01-16 16:36:35,244::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23174', 'displayIp': '0', 'displayPort': u'5954', 'session': 'Unknown', 'displaySecurePort': u'5955', 'timeOffset': '0', 'hash': '2903861395083110923', 'balloonInfo': {'balloon_max': '2097152', 'balloon_target': '2097152', 'balloon_cur': '2097152', 'balloon_min': '2097152'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet30': {'macAddr': '00:1a:4a:22:39:8d', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet30'}}, 'vmId': '6b03257a-90ec-4a1e-b285-d462b8e8c277', 'displayType': 'qxl', 'cpuUser': '38.95', 'disks': {u'vda': {'readLatency': '4671986', 'apparentsize': '10737418240', 'writeLatency': '3309794', 'imageID': 'b3484273-2e7d-4b8f-b83c-03f8ce41e220', 'flushLatency': '0', 'readRate': '2108.48', 'truesize': '10737418240', 'writeRate': '39998771.08'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.27', 'elapsedTime': '170807', 'vmType': 'kvm', 'cpuSys': '14.57', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:36:35,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:36:35,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:36:35,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:36:35,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:36,018::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-33::DEBUG::2014-01-16 16:36:36,068::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00141 s, 4.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:36,621::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:36:36,704::task::579::TaskManager.Task::(_updateState) Task=`b92141e5-3ded-4e47-a4a4-17923d205c6f`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:36:36,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:36:36,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:36:36,705::task::1168::TaskManager.Task::(prepare) Task=`b92141e5-3ded-4e47-a4a4-17923d205c6f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:36:36,705::task::579::TaskManager.Task::(_updateState) Task=`b92141e5-3ded-4e47-a4a4-17923d205c6f`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:36:36,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:36:36,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:36:36,705::task::974::TaskManager.Task::(_decref) Task=`b92141e5-3ded-4e47-a4a4-17923d205c6f`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:36:37,494::task::579::TaskManager.Task::(_updateState) Task=`f35d0052-8453-4f23-8d46-f897e5cecbce`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:36:37,495::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:36:37,495::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:36:37,495::task::1168::TaskManager.Task::(prepare) Task=`f35d0052-8453-4f23-8d46-f897e5cecbce`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:36:37,495::task::579::TaskManager.Task::(_updateState) Task=`f35d0052-8453-4f23-8d46-f897e5cecbce`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:36:37,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:36:37,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:36:37,496::task::974::TaskManager.Task::(_decref) Task=`f35d0052-8453-4f23-8d46-f897e5cecbce`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:36:37,539::task::579::TaskManager.Task::(_updateState) Task=`79434489-4cb5-4c23-b483-bf7b46eb3136`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:36:37,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:36:37,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:36:37,539::task::1168::TaskManager.Task::(prepare) Task=`79434489-4cb5-4c23-b483-bf7b46eb3136`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:36:37,539::task::579::TaskManager.Task::(_updateState) Task=`79434489-4cb5-4c23-b483-bf7b46eb3136`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:36:37,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:36:37,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:36:37,540::task::974::TaskManager.Task::(_decref) Task=`79434489-4cb5-4c23-b483-bf7b46eb3136`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:36:37,607::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:37,623::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:36:37,625::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:36:37,626::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:36:37,627::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:36:37,628::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >Thread-22::DEBUG::2014-01-16 16:36:37,630::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000309264 s, 13.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:36:37,631::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-69607::DEBUG::2014-01-16 16:36:37,682::task::579::TaskManager.Task::(_updateState) Task=`6319efb5-d718-4ad8-bcd6-55225935276a`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:36:37,682::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:36:37,682::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:36:37,683::task::1168::TaskManager.Task::(prepare) Task=`6319efb5-d718-4ad8-bcd6-55225935276a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:36:37,683::task::579::TaskManager.Task::(_updateState) Task=`6319efb5-d718-4ad8-bcd6-55225935276a`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:36:37,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:36:37,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:36:37,683::task::974::TaskManager.Task::(_decref) Task=`6319efb5-d718-4ad8-bcd6-55225935276a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:36:38,019::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:36:38,609::task::579::TaskManager.Task::(_updateState) Task=`4f18cbe1-c59e-40e5-9749-21ba77818141`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:36:38,609::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:36:38,609::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:36:38,610::task::1168::TaskManager.Task::(prepare) Task=`4f18cbe1-c59e-40e5-9749-21ba77818141`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:36:38,610::task::579::TaskManager.Task::(_updateState) Task=`4f18cbe1-c59e-40e5-9749-21ba77818141`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:36:38,610::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:36:38,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:36:38,610::task::974::TaskManager.Task::(_decref) Task=`4f18cbe1-c59e-40e5-9749-21ba77818141`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:38,632::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:36:38,749::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:36:38,765::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000347736 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:36:38,798::task::579::TaskManager.Task::(_updateState) Task=`caf67823-bc31-431f-a9a3-a79ab3027157`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:36:38,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:36:38,799::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:36:38,799::task::1168::TaskManager.Task::(prepare) Task=`caf67823-bc31-431f-a9a3-a79ab3027157`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:36:38,800::task::579::TaskManager.Task::(_updateState) Task=`caf67823-bc31-431f-a9a3-a79ab3027157`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:36:38,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:36:38,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:36:38,800::task::974::TaskManager.Task::(_decref) Task=`caf67823-bc31-431f-a9a3-a79ab3027157`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:36:39,021::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:39,634::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:36:39,634::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:36:39,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:40,022::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:40,635::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:36:40,636::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:36:40,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286831::DEBUG::2014-01-16 16:36:41,398::task::579::TaskManager.Task::(_updateState) Task=`f40a4171-cce2-4a57-b4d0-c4bf41492516`::moving from state init -> state preparing >Thread-286831::INFO::2014-01-16 16:36:41,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286831::INFO::2014-01-16 16:36:41,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347736', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309264', 'lastCheck': '3.8', 'valid': True}} >Thread-286831::DEBUG::2014-01-16 16:36:41,399::task::1168::TaskManager.Task::(prepare) Task=`f40a4171-cce2-4a57-b4d0-c4bf41492516`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000347736', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309264', 'lastCheck': '3.8', 'valid': True}} >Thread-286831::DEBUG::2014-01-16 16:36:41,399::task::579::TaskManager.Task::(_updateState) Task=`f40a4171-cce2-4a57-b4d0-c4bf41492516`::moving from state preparing -> state finished >Thread-286831::DEBUG::2014-01-16 16:36:41,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286831::DEBUG::2014-01-16 16:36:41,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286831::DEBUG::2014-01-16 16:36:41,400::task::974::TaskManager.Task::(_decref) Task=`f40a4171-cce2-4a57-b4d0-c4bf41492516`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:36:41,558::task::579::TaskManager.Task::(_updateState) Task=`7993f8db-1d3a-4514-9b27-3300e64f2021`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:36:41,558::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:36:41,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:36:41,559::task::1168::TaskManager.Task::(prepare) Task=`7993f8db-1d3a-4514-9b27-3300e64f2021`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:36:41,559::task::579::TaskManager.Task::(_updateState) Task=`7993f8db-1d3a-4514-9b27-3300e64f2021`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:36:41,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:36:41,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:36:41,559::task::974::TaskManager.Task::(_decref) Task=`7993f8db-1d3a-4514-9b27-3300e64f2021`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:36:41,560::task::579::TaskManager.Task::(_updateState) Task=`3b44af3d-d327-4377-825c-9b1ff0f20c09`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:36:41,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:36:41,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:36:41,560::task::1168::TaskManager.Task::(prepare) Task=`3b44af3d-d327-4377-825c-9b1ff0f20c09`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:36:41,560::task::579::TaskManager.Task::(_updateState) Task=`3b44af3d-d327-4377-825c-9b1ff0f20c09`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:36:41,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:36:41,561::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:36:41,561::task::974::TaskManager.Task::(_decref) Task=`3b44af3d-d327-4377-825c-9b1ff0f20c09`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:36:41,561::task::579::TaskManager.Task::(_updateState) Task=`67102934-cbb6-49c4-8085-13837437355f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:36:41,561::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:36:41,561::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:36:41,562::task::1168::TaskManager.Task::(prepare) Task=`67102934-cbb6-49c4-8085-13837437355f`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:36:41,562::task::579::TaskManager.Task::(_updateState) Task=`67102934-cbb6-49c4-8085-13837437355f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:36:41,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:36:41,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:36:41,562::task::974::TaskManager.Task::(_decref) Task=`67102934-cbb6-49c4-8085-13837437355f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:41,636::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:36:41,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:36:41,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:36:41,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:42,023::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:42,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:36:43,638::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:36:43,638::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:44,025::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:44,027::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:36:44,027::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:36:44,028::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:44,640::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:36:45,641::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:46,030::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:36:46,484::task::579::TaskManager.Task::(_updateState) Task=`8431dc88-9b18-4fb1-b799-4f7315926c96`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:36:46,484::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:36:46,484::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:36:46,484::task::1168::TaskManager.Task::(prepare) Task=`8431dc88-9b18-4fb1-b799-4f7315926c96`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:36:46,484::task::579::TaskManager.Task::(_updateState) Task=`8431dc88-9b18-4fb1-b799-4f7315926c96`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:36:46,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:36:46,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:36:46,485::task::974::TaskManager.Task::(_decref) Task=`8431dc88-9b18-4fb1-b799-4f7315926c96`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:46,641::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:36:47,637::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:36:47,652::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:36:47,665::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000245651 s, 16.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:48,031::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:48,657::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:36:48,776::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:36:48,795::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000256034 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:49,032::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:49,658::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:36:49,658::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:50,033::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:50,660::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:36:51,019::task::579::TaskManager.Task::(_updateState) Task=`1ae9e09a-5f9f-4e50-911d-e3fd66e3226a`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:36:51,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:36:51,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:36:51,020::task::1168::TaskManager.Task::(prepare) Task=`1ae9e09a-5f9f-4e50-911d-e3fd66e3226a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:36:51,020::task::579::TaskManager.Task::(_updateState) Task=`1ae9e09a-5f9f-4e50-911d-e3fd66e3226a`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:36:51,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:36:51,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:36:51,021::task::974::TaskManager.Task::(_decref) Task=`1ae9e09a-5f9f-4e50-911d-e3fd66e3226a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:51,661::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:52,035::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:52,662::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:36:53,663::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:54,036::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:36:54,037::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:54,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:36:54,664::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:36:54,664::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:36:55,665::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:36:55,665::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:36:56,038::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:56,666::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:36:56,667::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:36:56,667::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286837::DEBUG::2014-01-16 16:36:57,392::task::579::TaskManager.Task::(_updateState) Task=`12a0f22b-7ff4-4c71-8620-a5ccc00e3a55`::moving from state init -> state preparing >Thread-286837::INFO::2014-01-16 16:36:57,393::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286837::INFO::2014-01-16 16:36:57,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256034', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245651', 'lastCheck': '9.7', 'valid': True}} >Thread-286837::DEBUG::2014-01-16 16:36:57,393::task::1168::TaskManager.Task::(prepare) Task=`12a0f22b-7ff4-4c71-8620-a5ccc00e3a55`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256034', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245651', 'lastCheck': '9.7', 'valid': True}} >Thread-286837::DEBUG::2014-01-16 16:36:57,393::task::579::TaskManager.Task::(_updateState) Task=`12a0f22b-7ff4-4c71-8620-a5ccc00e3a55`::moving from state preparing -> state finished >Thread-286837::DEBUG::2014-01-16 16:36:57,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286837::DEBUG::2014-01-16 16:36:57,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286837::DEBUG::2014-01-16 16:36:57,394::task::974::TaskManager.Task::(_decref) Task=`12a0f22b-7ff4-4c71-8620-a5ccc00e3a55`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:36:57,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:36:57,668::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:36:57,671::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:36:57,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000282603 s, 14.5 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:36:57,707::task::579::TaskManager.Task::(_updateState) Task=`0438fcba-6daa-4d9b-b542-613f884e02e4`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:36:57,707::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:36:57,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:36:57,708::task::1168::TaskManager.Task::(prepare) Task=`0438fcba-6daa-4d9b-b542-613f884e02e4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:36:57,708::task::579::TaskManager.Task::(_updateState) Task=`0438fcba-6daa-4d9b-b542-613f884e02e4`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:36:57,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:36:57,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:36:57,708::task::974::TaskManager.Task::(_decref) Task=`0438fcba-6daa-4d9b-b542-613f884e02e4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:36:58,040::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:58,669::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:36:58,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:36:58,803::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:36:58,819::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257272 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:36:59,042::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:36:59,042::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:36:59,044::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:36:59,671::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:00,045::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:00,673::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:37:00,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:01,673::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:37:01,674::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:37:01,680::task::579::TaskManager.Task::(_updateState) Task=`7b11c4b2-ff31-411f-8d74-8afe98cac022`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:37:01,680::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:37:01,681::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:37:01,681::task::1168::TaskManager.Task::(prepare) Task=`7b11c4b2-ff31-411f-8d74-8afe98cac022`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:37:01,681::task::579::TaskManager.Task::(_updateState) Task=`7b11c4b2-ff31-411f-8d74-8afe98cac022`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:37:01,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:37:01,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:37:01,681::task::974::TaskManager.Task::(_decref) Task=`7b11c4b2-ff31-411f-8d74-8afe98cac022`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:37:01,682::task::579::TaskManager.Task::(_updateState) Task=`9590ebe5-357f-4137-b2f9-8956cf4cdf54`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:37:01,682::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:37:01,682::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:37:01,682::task::1168::TaskManager.Task::(prepare) Task=`9590ebe5-357f-4137-b2f9-8956cf4cdf54`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:37:01,682::task::579::TaskManager.Task::(_updateState) Task=`9590ebe5-357f-4137-b2f9-8956cf4cdf54`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:37:01,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:37:01,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:37:01,683::task::974::TaskManager.Task::(_decref) Task=`9590ebe5-357f-4137-b2f9-8956cf4cdf54`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:37:01,683::task::579::TaskManager.Task::(_updateState) Task=`0a4b847d-7d67-4a05-a5d1-93ba8070be98`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:37:01,683::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:37:01,683::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:37:01,683::task::1168::TaskManager.Task::(prepare) Task=`0a4b847d-7d67-4a05-a5d1-93ba8070be98`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:37:01,684::task::579::TaskManager.Task::(_updateState) Task=`0a4b847d-7d67-4a05-a5d1-93ba8070be98`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:37:01,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:37:01,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:37:01,684::task::974::TaskManager.Task::(_decref) Task=`0a4b847d-7d67-4a05-a5d1-93ba8070be98`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:02,046::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:02,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:37:02,675::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:37:02,675::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:37:02,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:37:02,832::task::579::TaskManager.Task::(_updateState) Task=`26d87aac-a5ae-4c8a-a21e-2754d0b12939`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:37:02,832::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:37:02,833::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:37:02,833::task::1168::TaskManager.Task::(prepare) Task=`26d87aac-a5ae-4c8a-a21e-2754d0b12939`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:37:02,833::task::579::TaskManager.Task::(_updateState) Task=`26d87aac-a5ae-4c8a-a21e-2754d0b12939`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:37:02,833::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:37:02,833::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:37:02,833::task::974::TaskManager.Task::(_decref) Task=`26d87aac-a5ae-4c8a-a21e-2754d0b12939`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:37:02,834::task::579::TaskManager.Task::(_updateState) Task=`b637cf32-0a98-4ff1-ad01-d427b4c3dfed`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:37:02,834::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:37:02,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:37:02,834::task::1168::TaskManager.Task::(prepare) Task=`b637cf32-0a98-4ff1-ad01-d427b4c3dfed`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:37:02,834::task::579::TaskManager.Task::(_updateState) Task=`b637cf32-0a98-4ff1-ad01-d427b4c3dfed`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:37:02,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:37:02,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:37:02,835::task::974::TaskManager.Task::(_decref) Task=`b637cf32-0a98-4ff1-ad01-d427b4c3dfed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:03,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:37:03,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:37:03,677::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:04,047::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:04,048::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:04,678::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:37:04,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:37:04,737::task::579::TaskManager.Task::(_updateState) Task=`ccef4653-d8b2-4db6-9d37-f69f1de0470b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:37:04,737::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:37:04,737::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:37:04,738::task::1168::TaskManager.Task::(prepare) Task=`ccef4653-d8b2-4db6-9d37-f69f1de0470b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:37:04,738::task::579::TaskManager.Task::(_updateState) Task=`ccef4653-d8b2-4db6-9d37-f69f1de0470b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:37:04,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:37:04,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:37:04,738::task::974::TaskManager.Task::(_decref) Task=`ccef4653-d8b2-4db6-9d37-f69f1de0470b`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:37:05,339::task::579::TaskManager.Task::(_updateState) Task=`1058bbf0-e667-4ff4-b2ea-3c8852bb2691`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:37:05,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:37:05,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:37:05,341::task::1168::TaskManager.Task::(prepare) Task=`1058bbf0-e667-4ff4-b2ea-3c8852bb2691`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:37:05,341::task::579::TaskManager.Task::(_updateState) Task=`1058bbf0-e667-4ff4-b2ea-3c8852bb2691`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:37:05,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:37:05,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:37:05,342::task::974::TaskManager.Task::(_decref) Task=`1058bbf0-e667-4ff4-b2ea-3c8852bb2691`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:37:05,343::task::579::TaskManager.Task::(_updateState) Task=`b5c89870-273f-4dc7-bfb0-24836d45af71`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:37:05,343::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:37:05,344::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:37:05,344::task::1168::TaskManager.Task::(prepare) Task=`b5c89870-273f-4dc7-bfb0-24836d45af71`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:37:05,345::task::579::TaskManager.Task::(_updateState) Task=`b5c89870-273f-4dc7-bfb0-24836d45af71`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:37:05,345::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:37:05,345::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:37:05,345::task::974::TaskManager.Task::(_decref) Task=`b5c89870-273f-4dc7-bfb0-24836d45af71`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:05,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:37:05,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:37:05,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:37:05,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:06,050::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:06,681::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:37:06,802::task::579::TaskManager.Task::(_updateState) Task=`5448ed29-51e3-4b98-b72b-b23f5dcd7c86`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:37:06,802::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:37:06,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:37:06,804::task::1168::TaskManager.Task::(prepare) Task=`5448ed29-51e3-4b98-b72b-b23f5dcd7c86`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:37:06,804::task::579::TaskManager.Task::(_updateState) Task=`5448ed29-51e3-4b98-b72b-b23f5dcd7c86`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:37:06,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:37:06,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:37:06,804::task::974::TaskManager.Task::(_decref) Task=`5448ed29-51e3-4b98-b72b-b23f5dcd7c86`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:37:06,804::task::579::TaskManager.Task::(_updateState) Task=`c06ff894-d1f6-41d3-91a5-e1fe5af224f8`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:37:06,805::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:37:06,805::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:37:06,805::task::1168::TaskManager.Task::(prepare) Task=`c06ff894-d1f6-41d3-91a5-e1fe5af224f8`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:37:06,805::task::579::TaskManager.Task::(_updateState) Task=`c06ff894-d1f6-41d3-91a5-e1fe5af224f8`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:37:06,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:37:06,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:37:06,806::task::974::TaskManager.Task::(_decref) Task=`c06ff894-d1f6-41d3-91a5-e1fe5af224f8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:07,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:37:07,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:37:07,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:37:07,683::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:07,683::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:37:07,684::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-22::DEBUG::2014-01-16 16:37:07,702::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:37:07,726::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260813 s, 15.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:08,051::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:08,685::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:37:08,830::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:37:08,847::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266927 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:37:08,851::task::579::TaskManager.Task::(_updateState) Task=`6ce10c05-27f2-40c7-a317-33cb45b52f2e`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:37:08,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:37:08,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:37:08,853::task::1168::TaskManager.Task::(prepare) Task=`6ce10c05-27f2-40c7-a317-33cb45b52f2e`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:37:08,853::task::579::TaskManager.Task::(_updateState) Task=`6ce10c05-27f2-40c7-a317-33cb45b52f2e`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:37:08,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:37:08,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:37:08,854::task::974::TaskManager.Task::(_decref) Task=`6ce10c05-27f2-40c7-a317-33cb45b52f2e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:37:08,865::task::579::TaskManager.Task::(_updateState) Task=`db41fffb-81da-45f2-a32c-00f8fcbfecd7`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:37:08,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:37:08,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:37:08,866::task::1168::TaskManager.Task::(prepare) Task=`db41fffb-81da-45f2-a32c-00f8fcbfecd7`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:37:08,866::task::579::TaskManager.Task::(_updateState) Task=`db41fffb-81da-45f2-a32c-00f8fcbfecd7`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:37:08,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:37:08,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:37:08,866::task::974::TaskManager.Task::(_decref) Task=`db41fffb-81da-45f2-a32c-00f8fcbfecd7`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:37:08,867::task::579::TaskManager.Task::(_updateState) Task=`6141ba5e-9e74-4f9a-a4b0-8afb461724f8`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:37:08,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:37:08,867::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:37:08,867::task::1168::TaskManager.Task::(prepare) Task=`6141ba5e-9e74-4f9a-a4b0-8afb461724f8`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:37:08,867::task::579::TaskManager.Task::(_updateState) Task=`6141ba5e-9e74-4f9a-a4b0-8afb461724f8`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:37:08,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:37:08,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:37:08,868::task::974::TaskManager.Task::(_decref) Task=`6141ba5e-9e74-4f9a-a4b0-8afb461724f8`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:37:08,961::task::579::TaskManager.Task::(_updateState) Task=`ca93b1b5-2ba0-4cd5-b096-3f2e84bf2d96`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:37:08,961::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:37:08,961::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:37:08,961::task::1168::TaskManager.Task::(prepare) Task=`ca93b1b5-2ba0-4cd5-b096-3f2e84bf2d96`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:37:08,962::task::579::TaskManager.Task::(_updateState) Task=`ca93b1b5-2ba0-4cd5-b096-3f2e84bf2d96`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:37:08,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:37:08,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:37:08,962::task::974::TaskManager.Task::(_decref) Task=`ca93b1b5-2ba0-4cd5-b096-3f2e84bf2d96`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:09,053::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:09,687::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:37:09,687::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:37:09,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:10,054::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:37:10,177::task::579::TaskManager.Task::(_updateState) Task=`28f54339-c5b3-4f31-b377-3de6bef57ea9`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:37:10,177::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:37:10,177::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:37:10,177::task::1168::TaskManager.Task::(prepare) Task=`28f54339-c5b3-4f31-b377-3de6bef57ea9`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:37:10,178::task::579::TaskManager.Task::(_updateState) Task=`28f54339-c5b3-4f31-b377-3de6bef57ea9`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:37:10,178::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:37:10,178::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:37:10,178::task::974::TaskManager.Task::(_decref) Task=`28f54339-c5b3-4f31-b377-3de6bef57ea9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:10,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:37:10,689::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:37:10,689::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:37:11,188::task::579::TaskManager.Task::(_updateState) Task=`8f912bb1-a13c-409d-ae23-a1f500324a7e`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:37:11,188::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:37:11,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:37:11,188::task::1168::TaskManager.Task::(prepare) Task=`8f912bb1-a13c-409d-ae23-a1f500324a7e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:37:11,189::task::579::TaskManager.Task::(_updateState) Task=`8f912bb1-a13c-409d-ae23-a1f500324a7e`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:37:11,189::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:37:11,189::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:37:11,189::task::974::TaskManager.Task::(_decref) Task=`8f912bb1-a13c-409d-ae23-a1f500324a7e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:11,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:37:11,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:37:11,691::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:37:11,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:12,055::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:12,692::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286843::DEBUG::2014-01-16 16:37:13,108::task::579::TaskManager.Task::(_updateState) Task=`3060e87b-66da-46ba-8e29-48b4e261528b`::moving from state init -> state preparing >Thread-286843::INFO::2014-01-16 16:37:13,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286843::INFO::2014-01-16 16:37:13,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266927', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260813', 'lastCheck': '5.4', 'valid': True}} >Thread-286843::DEBUG::2014-01-16 16:37:13,109::task::1168::TaskManager.Task::(prepare) Task=`3060e87b-66da-46ba-8e29-48b4e261528b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266927', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260813', 'lastCheck': '5.4', 'valid': True}} >Thread-286843::DEBUG::2014-01-16 16:37:13,109::task::579::TaskManager.Task::(_updateState) Task=`3060e87b-66da-46ba-8e29-48b4e261528b`::moving from state preparing -> state finished >Thread-286843::DEBUG::2014-01-16 16:37:13,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286843::DEBUG::2014-01-16 16:37:13,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286843::DEBUG::2014-01-16 16:37:13,110::task::974::TaskManager.Task::(_decref) Task=`3060e87b-66da-46ba-8e29-48b4e261528b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:13,693::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:37:13,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:14,057::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:14,057::task::579::TaskManager.Task::(_updateState) Task=`73c47bb1-d634-4b61-aa48-8d6d3214c69b`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:37:14,057::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:37:14,058::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:37:14,058::task::1168::TaskManager.Task::(prepare) Task=`73c47bb1-d634-4b61-aa48-8d6d3214c69b`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:37:14,058::task::579::TaskManager.Task::(_updateState) Task=`73c47bb1-d634-4b61-aa48-8d6d3214c69b`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:37:14,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:37:14,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:37:14,058::task::974::TaskManager.Task::(_decref) Task=`73c47bb1-d634-4b61-aa48-8d6d3214c69b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:14,060::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:37:14,060::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:37:14,062::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:14,063::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:14,064::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:37:14,333::task::579::TaskManager.Task::(_updateState) Task=`ea9d6978-944e-4850-b16d-2755a54cb596`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:37:14,333::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:37:14,333::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:37:14,333::task::1168::TaskManager.Task::(prepare) Task=`ea9d6978-944e-4850-b16d-2755a54cb596`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:37:14,334::task::579::TaskManager.Task::(_updateState) Task=`ea9d6978-944e-4850-b16d-2755a54cb596`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:37:14,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:37:14,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:37:14,334::task::974::TaskManager.Task::(_decref) Task=`ea9d6978-944e-4850-b16d-2755a54cb596`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:14,694::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:15,695::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:16,065::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:37:16,674::task::579::TaskManager.Task::(_updateState) Task=`40383f94-c57d-44fd-9311-0c0c56fc6df2`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:37:16,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:37:16,675::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:37:16,675::task::1168::TaskManager.Task::(prepare) Task=`40383f94-c57d-44fd-9311-0c0c56fc6df2`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:37:16,675::task::579::TaskManager.Task::(_updateState) Task=`40383f94-c57d-44fd-9311-0c0c56fc6df2`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:37:16,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:37:16,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:37:16,675::task::974::TaskManager.Task::(_decref) Task=`40383f94-c57d-44fd-9311-0c0c56fc6df2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:16,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:17,697::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:37:17,733::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-49313::DEBUG::2014-01-16 16:37:17,759::task::579::TaskManager.Task::(_updateState) Task=`e2f438a4-e497-4a7c-9d71-eb5006f9f3a3`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:37:17,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:37:17,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:37:17,768::task::1168::TaskManager.Task::(prepare) Task=`e2f438a4-e497-4a7c-9d71-eb5006f9f3a3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:37:17,770::task::579::TaskManager.Task::(_updateState) Task=`e2f438a4-e497-4a7c-9d71-eb5006f9f3a3`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:37:17,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:37:17,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:37:17,773::task::974::TaskManager.Task::(_decref) Task=`e2f438a4-e497-4a7c-9d71-eb5006f9f3a3`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:37:17,775::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000262372 s, 15.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:18,067::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:18,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:37:18,859::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:37:18,876::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257957 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:19,068::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:19,700::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:37:19,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:20,070::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:20,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:21,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:22,071::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:22,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:23,705::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:24,073::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:24,074::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:24,707::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:37:24,707::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:37:24,707::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:37:24,879::task::579::TaskManager.Task::(_updateState) Task=`9d8c346e-ef16-43f9-85bb-b33841e8dd27`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:37:24,880::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:37:24,881::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:37:24,881::task::1168::TaskManager.Task::(prepare) Task=`9d8c346e-ef16-43f9-85bb-b33841e8dd27`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:37:24,881::task::579::TaskManager.Task::(_updateState) Task=`9d8c346e-ef16-43f9-85bb-b33841e8dd27`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:37:24,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:37:24,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:37:24,882::task::974::TaskManager.Task::(_decref) Task=`9d8c346e-ef16-43f9-85bb-b33841e8dd27`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:37:25,094::task::579::TaskManager.Task::(_updateState) Task=`26d81c21-617a-4c92-90eb-16cee3c21c27`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:37:25,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:37:25,094::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:37:25,094::task::1168::TaskManager.Task::(prepare) Task=`26d81c21-617a-4c92-90eb-16cee3c21c27`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:37:25,094::task::579::TaskManager.Task::(_updateState) Task=`26d81c21-617a-4c92-90eb-16cee3c21c27`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:37:25,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:37:25,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:37:25,095::task::974::TaskManager.Task::(_decref) Task=`26d81c21-617a-4c92-90eb-16cee3c21c27`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:37:25,095::task::579::TaskManager.Task::(_updateState) Task=`c833d18e-4f8a-4320-8d94-73420f00b71c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:37:25,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:37:25,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:37:25,096::task::1168::TaskManager.Task::(prepare) Task=`c833d18e-4f8a-4320-8d94-73420f00b71c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:37:25,096::task::579::TaskManager.Task::(_updateState) Task=`c833d18e-4f8a-4320-8d94-73420f00b71c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:37:25,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:37:25,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:37:25,096::task::974::TaskManager.Task::(_decref) Task=`c833d18e-4f8a-4320-8d94-73420f00b71c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:25,708::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:37:25,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:37:25,791::task::579::TaskManager.Task::(_updateState) Task=`46cfd4c4-4fb8-408a-aa24-9191b392cc01`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:37:25,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:37:25,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:37:25,792::task::1168::TaskManager.Task::(prepare) Task=`46cfd4c4-4fb8-408a-aa24-9191b392cc01`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:37:25,792::task::579::TaskManager.Task::(_updateState) Task=`46cfd4c4-4fb8-408a-aa24-9191b392cc01`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:37:25,792::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:37:25,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:37:25,793::task::974::TaskManager.Task::(_decref) Task=`46cfd4c4-4fb8-408a-aa24-9191b392cc01`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:26,075::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:26,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:37:26,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:37:26,709::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:27,710::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:37:27,711::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:37:27,781::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:37:27,811::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000306106 s, 13.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:28,076::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:28,711::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:37:28,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286849::DEBUG::2014-01-16 16:37:28,864::task::579::TaskManager.Task::(_updateState) Task=`1c9906db-5ede-4d84-a94c-99b330c19731`::moving from state init -> state preparing >Thread-286849::INFO::2014-01-16 16:37:28,864::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286849::INFO::2014-01-16 16:37:28,864::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257957', 'lastCheck': '10.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306106', 'lastCheck': '1.0', 'valid': True}} >Thread-286849::DEBUG::2014-01-16 16:37:28,864::task::1168::TaskManager.Task::(prepare) Task=`1c9906db-5ede-4d84-a94c-99b330c19731`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257957', 'lastCheck': '10.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306106', 'lastCheck': '1.0', 'valid': True}} >Thread-286849::DEBUG::2014-01-16 16:37:28,865::task::579::TaskManager.Task::(_updateState) Task=`1c9906db-5ede-4d84-a94c-99b330c19731`::moving from state preparing -> state finished >Thread-286849::DEBUG::2014-01-16 16:37:28,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286849::DEBUG::2014-01-16 16:37:28,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286849::DEBUG::2014-01-16 16:37:28,865::task::974::TaskManager.Task::(_decref) Task=`1c9906db-5ede-4d84-a94c-99b330c19731`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:37:28,887::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:37:28,903::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000319319 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:29,085::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:37:29,086::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:37:29,091::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:37:29,379::task::579::TaskManager.Task::(_updateState) Task=`79dad579-33e1-4b26-859f-7c2aff8c9ed8`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:37:29,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:37:29,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:37:29,380::task::1168::TaskManager.Task::(prepare) Task=`79dad579-33e1-4b26-859f-7c2aff8c9ed8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:37:29,380::task::579::TaskManager.Task::(_updateState) Task=`79dad579-33e1-4b26-859f-7c2aff8c9ed8`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:37:29,380::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:37:29,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:37:29,381::task::974::TaskManager.Task::(_decref) Task=`79dad579-33e1-4b26-859f-7c2aff8c9ed8`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:37:29,402::task::579::TaskManager.Task::(_updateState) Task=`3e34fcf8-a83e-4e30-a7ee-3b3d8df06ab5`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:37:29,402::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:37:29,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:37:29,402::task::1168::TaskManager.Task::(prepare) Task=`3e34fcf8-a83e-4e30-a7ee-3b3d8df06ab5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:37:29,402::task::579::TaskManager.Task::(_updateState) Task=`3e34fcf8-a83e-4e30-a7ee-3b3d8df06ab5`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:37:29,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:37:29,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:37:29,403::task::974::TaskManager.Task::(_decref) Task=`3e34fcf8-a83e-4e30-a7ee-3b3d8df06ab5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:29,713::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:30,093::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:30,715::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:37:30,715::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:31,716::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:37:31,717::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:32,094::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:32,717::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:37:32,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:37:32,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:37:32,718::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:33,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:37:33,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:37:33,719::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:34,095::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:34,096::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:37:34,380::task::579::TaskManager.Task::(_updateState) Task=`c98a5ee0-2044-4dc0-be1e-6fb06d40a8f2`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:37:34,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:37:34,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:37:34,381::task::1168::TaskManager.Task::(prepare) Task=`c98a5ee0-2044-4dc0-be1e-6fb06d40a8f2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:37:34,381::task::579::TaskManager.Task::(_updateState) Task=`c98a5ee0-2044-4dc0-be1e-6fb06d40a8f2`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:37:34,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:37:34,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:37:34,382::task::974::TaskManager.Task::(_decref) Task=`c98a5ee0-2044-4dc0-be1e-6fb06d40a8f2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:34,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:37:34,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:35,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:37:35,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:37:35,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:37:35,722::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:36,097::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:36,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:37:36,884::task::579::TaskManager.Task::(_updateState) Task=`97e13039-f733-4f58-a2ab-c61d14f4ac29`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:37:36,885::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:37:36,885::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:37:36,885::task::1168::TaskManager.Task::(prepare) Task=`97e13039-f733-4f58-a2ab-c61d14f4ac29`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:37:36,885::task::579::TaskManager.Task::(_updateState) Task=`97e13039-f733-4f58-a2ab-c61d14f4ac29`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:37:36,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:37:36,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:37:36,886::task::974::TaskManager.Task::(_decref) Task=`97e13039-f733-4f58-a2ab-c61d14f4ac29`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:37:37,661::task::579::TaskManager.Task::(_updateState) Task=`a0981ea8-6713-4332-847c-b363ef343025`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:37:37,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:37:37,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:37:37,662::task::1168::TaskManager.Task::(prepare) Task=`a0981ea8-6713-4332-847c-b363ef343025`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:37:37,662::task::579::TaskManager.Task::(_updateState) Task=`a0981ea8-6713-4332-847c-b363ef343025`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:37:37,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:37:37,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:37:37,663::task::974::TaskManager.Task::(_decref) Task=`a0981ea8-6713-4332-847c-b363ef343025`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:37:37,701::task::579::TaskManager.Task::(_updateState) Task=`a2ecb7a9-4915-4e95-b0f4-e6f2f19389e7`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:37:37,701::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:37:37,701::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:37:37,702::task::1168::TaskManager.Task::(prepare) Task=`a2ecb7a9-4915-4e95-b0f4-e6f2f19389e7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:37:37,702::task::579::TaskManager.Task::(_updateState) Task=`a2ecb7a9-4915-4e95-b0f4-e6f2f19389e7`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:37:37,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:37:37,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:37:37,702::task::974::TaskManager.Task::(_decref) Task=`a2ecb7a9-4915-4e95-b0f4-e6f2f19389e7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:37,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:37:37,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:37:37,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:37:37,725::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:37,725::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:37:37,726::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-22::DEBUG::2014-01-16 16:37:37,817::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:37:37,845::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000244918 s, 16.7 MB/s\n'; <rc> = 0 >Thread-69607::DEBUG::2014-01-16 16:37:37,856::task::579::TaskManager.Task::(_updateState) Task=`cd08097b-fb29-4377-89c2-1f63daf89dbe`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:37:37,856::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:37:37,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:37:37,857::task::1168::TaskManager.Task::(prepare) Task=`cd08097b-fb29-4377-89c2-1f63daf89dbe`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:37:37,857::task::579::TaskManager.Task::(_updateState) Task=`cd08097b-fb29-4377-89c2-1f63daf89dbe`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:37:37,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:37:37,857::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:37:37,858::task::974::TaskManager.Task::(_decref) Task=`cd08097b-fb29-4377-89c2-1f63daf89dbe`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:38,099::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:38,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:37:38,773::task::579::TaskManager.Task::(_updateState) Task=`0c2b1262-34b5-4f8f-816f-7611b5b66b84`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:37:38,774::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:37:38,774::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:37:38,774::task::1168::TaskManager.Task::(prepare) Task=`0c2b1262-34b5-4f8f-816f-7611b5b66b84`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:37:38,774::task::579::TaskManager.Task::(_updateState) Task=`0c2b1262-34b5-4f8f-816f-7611b5b66b84`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:37:38,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:37:38,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:37:38,775::task::974::TaskManager.Task::(_decref) Task=`0c2b1262-34b5-4f8f-816f-7611b5b66b84`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:37:38,914::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:37:38,933::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000259066 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:37:38,952::task::579::TaskManager.Task::(_updateState) Task=`56e28147-4ab4-40a7-b073-2ba6ea3842a9`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:37:38,953::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:37:38,953::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:37:38,953::task::1168::TaskManager.Task::(prepare) Task=`56e28147-4ab4-40a7-b073-2ba6ea3842a9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:37:38,954::task::579::TaskManager.Task::(_updateState) Task=`56e28147-4ab4-40a7-b073-2ba6ea3842a9`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:37:38,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:37:38,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:37:38,954::task::974::TaskManager.Task::(_decref) Task=`56e28147-4ab4-40a7-b073-2ba6ea3842a9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:39,100::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:39,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:37:39,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:37:39,729::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:40,101::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:40,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:37:40,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:37:40,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:41,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:37:41,732::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:37:41,732::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:37:41,732::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:37:41,857::task::579::TaskManager.Task::(_updateState) Task=`08606a98-4775-471f-adf8-31ff9907720c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:37:41,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:37:41,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:37:41,858::task::1168::TaskManager.Task::(prepare) Task=`08606a98-4775-471f-adf8-31ff9907720c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:37:41,858::task::579::TaskManager.Task::(_updateState) Task=`08606a98-4775-471f-adf8-31ff9907720c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:37:41,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:37:41,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:37:41,859::task::974::TaskManager.Task::(_decref) Task=`08606a98-4775-471f-adf8-31ff9907720c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:37:41,859::task::579::TaskManager.Task::(_updateState) Task=`e3b73796-4096-4f37-990f-26e5a02fc03c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:37:41,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:37:41,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:37:41,859::task::1168::TaskManager.Task::(prepare) Task=`e3b73796-4096-4f37-990f-26e5a02fc03c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:37:41,860::task::579::TaskManager.Task::(_updateState) Task=`e3b73796-4096-4f37-990f-26e5a02fc03c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:37:41,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:37:41,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:37:41,860::task::974::TaskManager.Task::(_decref) Task=`e3b73796-4096-4f37-990f-26e5a02fc03c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:37:41,860::task::579::TaskManager.Task::(_updateState) Task=`c1146244-9a79-4f4c-aa63-6f0c7f573d94`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:37:41,861::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:37:41,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:37:41,861::task::1168::TaskManager.Task::(prepare) Task=`c1146244-9a79-4f4c-aa63-6f0c7f573d94`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:37:41,861::task::579::TaskManager.Task::(_updateState) Task=`c1146244-9a79-4f4c-aa63-6f0c7f573d94`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:37:41,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:37:41,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:37:41,862::task::974::TaskManager.Task::(_decref) Task=`c1146244-9a79-4f4c-aa63-6f0c7f573d94`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:37:42,103::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:42,733::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:43,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:37:43,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:44,104::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:44,106::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:37:44,106::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:37:44,107::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286855::DEBUG::2014-01-16 16:37:44,674::task::579::TaskManager.Task::(_updateState) Task=`7d93a5d1-db5a-4a72-bfac-4551b9a0d49c`::moving from state init -> state preparing >Thread-286855::INFO::2014-01-16 16:37:44,674::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286855::INFO::2014-01-16 16:37:44,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259066', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244918', 'lastCheck': '6.8', 'valid': True}} >Thread-286855::DEBUG::2014-01-16 16:37:44,675::task::1168::TaskManager.Task::(prepare) Task=`7d93a5d1-db5a-4a72-bfac-4551b9a0d49c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259066', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244918', 'lastCheck': '6.8', 'valid': True}} >Thread-286855::DEBUG::2014-01-16 16:37:44,675::task::579::TaskManager.Task::(_updateState) Task=`7d93a5d1-db5a-4a72-bfac-4551b9a0d49c`::moving from state preparing -> state finished >Thread-286855::DEBUG::2014-01-16 16:37:44,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286855::DEBUG::2014-01-16 16:37:44,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286855::DEBUG::2014-01-16 16:37:44,676::task::974::TaskManager.Task::(_decref) Task=`7d93a5d1-db5a-4a72-bfac-4551b9a0d49c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:44,737::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:45,738::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:46,109::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:37:46,642::task::579::TaskManager.Task::(_updateState) Task=`67196f6b-a725-4770-ad12-1afccdddd0ac`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:37:46,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:37:46,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:37:46,643::task::1168::TaskManager.Task::(prepare) Task=`67196f6b-a725-4770-ad12-1afccdddd0ac`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:37:46,643::task::579::TaskManager.Task::(_updateState) Task=`67196f6b-a725-4770-ad12-1afccdddd0ac`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:37:46,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:37:46,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:37:46,644::task::974::TaskManager.Task::(_decref) Task=`67196f6b-a725-4770-ad12-1afccdddd0ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:46,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:47,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:37:47,851::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:37:47,876::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000247209 s, 16.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:48,110::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:48,741::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:37:48,943::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:37:48,961::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000277811 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:49,112::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:49,743::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:37:49,743::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:50,114::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:50,744::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:37:51,209::task::579::TaskManager.Task::(_updateState) Task=`f2872a20-761d-4cb5-a543-f75005b4cf42`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:37:51,209::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:37:51,210::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:37:51,210::task::1168::TaskManager.Task::(prepare) Task=`f2872a20-761d-4cb5-a543-f75005b4cf42`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:37:51,210::task::579::TaskManager.Task::(_updateState) Task=`f2872a20-761d-4cb5-a543-f75005b4cf42`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:37:51,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:37:51,210::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:37:51,211::task::974::TaskManager.Task::(_decref) Task=`f2872a20-761d-4cb5-a543-f75005b4cf42`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:37:51,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:52,115::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:52,747::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:53,748::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:54,116::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:37:54,117::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:54,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:37:54,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:37:54,750::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:55,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:37:55,751::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:37:56,118::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:56,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:37:56,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:37:56,753::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:37:57,754::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:37:57,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:37:57,882::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-84941::DEBUG::2014-01-16 16:37:57,908::task::579::TaskManager.Task::(_updateState) Task=`0e3ed806-d132-4291-aebf-bc6c0590935b`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:37:57,914::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:37:57,918::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:37:57,920::task::1168::TaskManager.Task::(prepare) Task=`0e3ed806-d132-4291-aebf-bc6c0590935b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:37:57,922::task::579::TaskManager.Task::(_updateState) Task=`0e3ed806-d132-4291-aebf-bc6c0590935b`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:37:57,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:37:57,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:37:57,927::task::974::TaskManager.Task::(_decref) Task=`0e3ed806-d132-4291-aebf-bc6c0590935b`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:37:57,928::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241535 s, 17.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:58,120::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:58,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:37:58,755::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:37:58,968::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:37:58,986::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000269401 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:37:59,122::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:37:59,122::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:37:59,124::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:37:59,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:00,125::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286861::DEBUG::2014-01-16 16:38:00,555::task::579::TaskManager.Task::(_updateState) Task=`bf25b5ae-722d-4c80-82e9-b0dba72e0dc8`::moving from state init -> state preparing >Thread-286861::INFO::2014-01-16 16:38:00,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286861::INFO::2014-01-16 16:38:00,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269401', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241535', 'lastCheck': '2.6', 'valid': True}} >Thread-286861::DEBUG::2014-01-16 16:38:00,556::task::1168::TaskManager.Task::(prepare) Task=`bf25b5ae-722d-4c80-82e9-b0dba72e0dc8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269401', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241535', 'lastCheck': '2.6', 'valid': True}} >Thread-286861::DEBUG::2014-01-16 16:38:00,556::task::579::TaskManager.Task::(_updateState) Task=`bf25b5ae-722d-4c80-82e9-b0dba72e0dc8`::moving from state preparing -> state finished >Thread-286861::DEBUG::2014-01-16 16:38:00,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286861::DEBUG::2014-01-16 16:38:00,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286861::DEBUG::2014-01-16 16:38:00,556::task::974::TaskManager.Task::(_decref) Task=`bf25b5ae-722d-4c80-82e9-b0dba72e0dc8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:00,757::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:38:00,757::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:01,759::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:38:01,759::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:02,126::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:38:02,248::task::579::TaskManager.Task::(_updateState) Task=`60645c2e-44e6-495a-831b-66841a5a7961`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:38:02,248::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:38:02,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:38:02,249::task::1168::TaskManager.Task::(prepare) Task=`60645c2e-44e6-495a-831b-66841a5a7961`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:38:02,249::task::579::TaskManager.Task::(_updateState) Task=`60645c2e-44e6-495a-831b-66841a5a7961`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:38:02,249::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:38:02,249::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:38:02,250::task::974::TaskManager.Task::(_decref) Task=`60645c2e-44e6-495a-831b-66841a5a7961`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:38:02,250::task::579::TaskManager.Task::(_updateState) Task=`e07bb6b3-27d5-4cb4-a2a1-f5d5ceb434c2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:38:02,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:38:02,250::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:38:02,250::task::1168::TaskManager.Task::(prepare) Task=`e07bb6b3-27d5-4cb4-a2a1-f5d5ceb434c2`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:38:02,250::task::579::TaskManager.Task::(_updateState) Task=`e07bb6b3-27d5-4cb4-a2a1-f5d5ceb434c2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:38:02,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:38:02,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:38:02,251::task::974::TaskManager.Task::(_decref) Task=`e07bb6b3-27d5-4cb4-a2a1-f5d5ceb434c2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:38:02,251::task::579::TaskManager.Task::(_updateState) Task=`cf262e90-78b0-4816-9d8b-6c2692257eef`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:38:02,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:38:02,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:38:02,252::task::1168::TaskManager.Task::(prepare) Task=`cf262e90-78b0-4816-9d8b-6c2692257eef`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:38:02,252::task::579::TaskManager.Task::(_updateState) Task=`cf262e90-78b0-4816-9d8b-6c2692257eef`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:38:02,252::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:38:02,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:38:02,252::task::974::TaskManager.Task::(_decref) Task=`cf262e90-78b0-4816-9d8b-6c2692257eef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:02,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:38:02,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:38:02,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:38:02,761::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:38:03,056::task::579::TaskManager.Task::(_updateState) Task=`77f924a4-2081-450a-8ff4-556d0fd302bc`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:38:03,057::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:38:03,057::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:38:03,057::task::1168::TaskManager.Task::(prepare) Task=`77f924a4-2081-450a-8ff4-556d0fd302bc`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:38:03,057::task::579::TaskManager.Task::(_updateState) Task=`77f924a4-2081-450a-8ff4-556d0fd302bc`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:38:03,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:38:03,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:38:03,058::task::974::TaskManager.Task::(_decref) Task=`77f924a4-2081-450a-8ff4-556d0fd302bc`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:38:03,058::task::579::TaskManager.Task::(_updateState) Task=`17e1e8dc-3f01-4f87-8cd6-9f54bc77a254`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:38:03,058::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:38:03,058::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:38:03,059::task::1168::TaskManager.Task::(prepare) Task=`17e1e8dc-3f01-4f87-8cd6-9f54bc77a254`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:38:03,059::task::579::TaskManager.Task::(_updateState) Task=`17e1e8dc-3f01-4f87-8cd6-9f54bc77a254`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:38:03,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:38:03,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:38:03,059::task::974::TaskManager.Task::(_decref) Task=`17e1e8dc-3f01-4f87-8cd6-9f54bc77a254`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:03,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:38:03,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:38:03,762::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:04,127::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:04,128::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:04,763::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:38:04,764::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:38:04,902::task::579::TaskManager.Task::(_updateState) Task=`acd34045-7b60-4a49-832d-658af6c82ed1`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:38:04,903::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:38:04,903::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:38:04,903::task::1168::TaskManager.Task::(prepare) Task=`acd34045-7b60-4a49-832d-658af6c82ed1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:38:04,903::task::579::TaskManager.Task::(_updateState) Task=`acd34045-7b60-4a49-832d-658af6c82ed1`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:38:04,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:38:04,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:38:04,904::task::974::TaskManager.Task::(_decref) Task=`acd34045-7b60-4a49-832d-658af6c82ed1`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:38:05,425::task::579::TaskManager.Task::(_updateState) Task=`07b3c407-3401-4e71-aa81-77e4fd1335fa`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:38:05,426::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:38:05,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:38:05,427::task::1168::TaskManager.Task::(prepare) Task=`07b3c407-3401-4e71-aa81-77e4fd1335fa`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:38:05,427::task::579::TaskManager.Task::(_updateState) Task=`07b3c407-3401-4e71-aa81-77e4fd1335fa`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:38:05,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:38:05,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:38:05,427::task::974::TaskManager.Task::(_decref) Task=`07b3c407-3401-4e71-aa81-77e4fd1335fa`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:38:05,431::task::579::TaskManager.Task::(_updateState) Task=`4de6004d-2704-4c9d-bfcb-8e3b9e16238c`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:38:05,431::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:38:05,432::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:38:05,432::task::1168::TaskManager.Task::(prepare) Task=`4de6004d-2704-4c9d-bfcb-8e3b9e16238c`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:38:05,432::task::579::TaskManager.Task::(_updateState) Task=`4de6004d-2704-4c9d-bfcb-8e3b9e16238c`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:38:05,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:38:05,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:38:05,432::task::974::TaskManager.Task::(_decref) Task=`4de6004d-2704-4c9d-bfcb-8e3b9e16238c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:05,765::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:38:05,765::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:38:05,765::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:38:05,765::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:06,129::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:06,766::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:38:06,901::task::579::TaskManager.Task::(_updateState) Task=`f6db99ec-b8c8-4910-8918-2ee465aa334d`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:38:06,902::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:38:06,903::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:38:06,903::task::1168::TaskManager.Task::(prepare) Task=`f6db99ec-b8c8-4910-8918-2ee465aa334d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:38:06,903::task::579::TaskManager.Task::(_updateState) Task=`f6db99ec-b8c8-4910-8918-2ee465aa334d`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:38:06,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:38:06,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:38:06,904::task::974::TaskManager.Task::(_decref) Task=`f6db99ec-b8c8-4910-8918-2ee465aa334d`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:38:06,904::task::579::TaskManager.Task::(_updateState) Task=`de6a4b3a-ea73-419d-9541-57aaa753b2d6`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:38:06,904::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:38:06,904::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:38:06,905::task::1168::TaskManager.Task::(prepare) Task=`de6a4b3a-ea73-419d-9541-57aaa753b2d6`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:38:06,905::task::579::TaskManager.Task::(_updateState) Task=`de6a4b3a-ea73-419d-9541-57aaa753b2d6`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:38:06,905::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:38:06,905::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:38:06,905::task::974::TaskManager.Task::(_decref) Task=`de6a4b3a-ea73-419d-9541-57aaa753b2d6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:07,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:38:07,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:38:07,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:38:07,768::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:07,769::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:38:07,769::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-22::DEBUG::2014-01-16 16:38:07,935::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:38:07,952::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000201489 s, 20.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:08,131::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:08,771::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:38:08,996::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:38:09,013::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264549 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:38:09,018::task::579::TaskManager.Task::(_updateState) Task=`f93631ad-b29a-47d5-98db-b866527c625a`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:38:09,020::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:38:09,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:38:09,020::task::1168::TaskManager.Task::(prepare) Task=`f93631ad-b29a-47d5-98db-b866527c625a`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:38:09,021::task::579::TaskManager.Task::(_updateState) Task=`f93631ad-b29a-47d5-98db-b866527c625a`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:38:09,021::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:38:09,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:38:09,021::task::974::TaskManager.Task::(_decref) Task=`f93631ad-b29a-47d5-98db-b866527c625a`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:38:09,091::task::579::TaskManager.Task::(_updateState) Task=`98957262-7130-4a9b-afd2-c1da6720e62d`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:38:09,091::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:38:09,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:38:09,092::task::1168::TaskManager.Task::(prepare) Task=`98957262-7130-4a9b-afd2-c1da6720e62d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:38:09,092::task::579::TaskManager.Task::(_updateState) Task=`98957262-7130-4a9b-afd2-c1da6720e62d`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:38:09,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:38:09,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:38:09,092::task::974::TaskManager.Task::(_decref) Task=`98957262-7130-4a9b-afd2-c1da6720e62d`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:38:09,093::task::579::TaskManager.Task::(_updateState) Task=`a17bbb99-831a-421e-ac74-b061680b2f86`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:38:09,093::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:38:09,093::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:38:09,093::task::1168::TaskManager.Task::(prepare) Task=`a17bbb99-831a-421e-ac74-b061680b2f86`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:38:09,094::task::579::TaskManager.Task::(_updateState) Task=`a17bbb99-831a-421e-ac74-b061680b2f86`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:38:09,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:38:09,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:38:09,094::task::974::TaskManager.Task::(_decref) Task=`a17bbb99-831a-421e-ac74-b061680b2f86`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:38:09,121::task::579::TaskManager.Task::(_updateState) Task=`d8ac3657-c57c-40b4-9cee-610cfbef5892`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:38:09,121::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:38:09,122::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:38:09,122::task::1168::TaskManager.Task::(prepare) Task=`d8ac3657-c57c-40b4-9cee-610cfbef5892`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:38:09,122::task::579::TaskManager.Task::(_updateState) Task=`d8ac3657-c57c-40b4-9cee-610cfbef5892`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:38:09,122::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:38:09,122::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:38:09,123::task::974::TaskManager.Task::(_decref) Task=`d8ac3657-c57c-40b4-9cee-610cfbef5892`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:09,133::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:09,772::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:38:09,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:38:09,773::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:10,134::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:38:10,348::task::579::TaskManager.Task::(_updateState) Task=`4c595461-4f37-4fcd-b0dd-3867b335d892`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:38:10,349::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:38:10,349::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:38:10,349::task::1168::TaskManager.Task::(prepare) Task=`4c595461-4f37-4fcd-b0dd-3867b335d892`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:38:10,349::task::579::TaskManager.Task::(_updateState) Task=`4c595461-4f37-4fcd-b0dd-3867b335d892`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:38:10,349::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:38:10,349::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:38:10,350::task::974::TaskManager.Task::(_decref) Task=`4c595461-4f37-4fcd-b0dd-3867b335d892`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:10,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:38:10,774::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:38:10,774::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:38:11,363::task::579::TaskManager.Task::(_updateState) Task=`4aab849b-d709-40d6-a34f-e796f07209c9`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:38:11,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:38:11,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:38:11,363::task::1168::TaskManager.Task::(prepare) Task=`4aab849b-d709-40d6-a34f-e796f07209c9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:38:11,364::task::579::TaskManager.Task::(_updateState) Task=`4aab849b-d709-40d6-a34f-e796f07209c9`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:38:11,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:38:11,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:38:11,364::task::974::TaskManager.Task::(_decref) Task=`4aab849b-d709-40d6-a34f-e796f07209c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:11,775::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:38:11,775::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:38:11,775::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:38:11,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:12,135::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:12,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:13,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:38:13,779::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:14,137::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:14,137::task::579::TaskManager.Task::(_updateState) Task=`b12f6cca-335f-49b6-80ad-e4ce81786f43`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:38:14,137::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:38:14,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:38:14,138::task::1168::TaskManager.Task::(prepare) Task=`b12f6cca-335f-49b6-80ad-e4ce81786f43`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:38:14,138::task::579::TaskManager.Task::(_updateState) Task=`b12f6cca-335f-49b6-80ad-e4ce81786f43`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:38:14,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:38:14,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:38:14,138::task::974::TaskManager.Task::(_decref) Task=`b12f6cca-335f-49b6-80ad-e4ce81786f43`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:14,140::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:38:14,140::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:38:14,141::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:14,143::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:14,144::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:38:14,519::task::579::TaskManager.Task::(_updateState) Task=`b89e0c70-f4f5-4c0f-b15b-b5399d64230c`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:38:14,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:38:14,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:38:14,520::task::1168::TaskManager.Task::(prepare) Task=`b89e0c70-f4f5-4c0f-b15b-b5399d64230c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:38:14,520::task::579::TaskManager.Task::(_updateState) Task=`b89e0c70-f4f5-4c0f-b15b-b5399d64230c`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:38:14,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:38:14,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:38:14,521::task::974::TaskManager.Task::(_decref) Task=`b89e0c70-f4f5-4c0f-b15b-b5399d64230c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:14,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:15,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:16,145::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286867::DEBUG::2014-01-16 16:38:16,386::task::579::TaskManager.Task::(_updateState) Task=`39e51b12-4e1b-461c-8781-c2c133ceb037`::moving from state init -> state preparing >Thread-286867::INFO::2014-01-16 16:38:16,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286867::INFO::2014-01-16 16:38:16,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264549', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201489', 'lastCheck': '8.4', 'valid': True}} >Thread-286867::DEBUG::2014-01-16 16:38:16,386::task::1168::TaskManager.Task::(prepare) Task=`39e51b12-4e1b-461c-8781-c2c133ceb037`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264549', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201489', 'lastCheck': '8.4', 'valid': True}} >Thread-286867::DEBUG::2014-01-16 16:38:16,387::task::579::TaskManager.Task::(_updateState) Task=`39e51b12-4e1b-461c-8781-c2c133ceb037`::moving from state preparing -> state finished >Thread-286867::DEBUG::2014-01-16 16:38:16,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286867::DEBUG::2014-01-16 16:38:16,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286867::DEBUG::2014-01-16 16:38:16,387::task::974::TaskManager.Task::(_decref) Task=`39e51b12-4e1b-461c-8781-c2c133ceb037`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:38:16,760::task::579::TaskManager.Task::(_updateState) Task=`f658a05a-4cf3-4ef3-a667-598a8cdbb21b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:38:16,760::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:38:16,761::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:38:16,761::task::1168::TaskManager.Task::(prepare) Task=`f658a05a-4cf3-4ef3-a667-598a8cdbb21b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:38:16,761::task::579::TaskManager.Task::(_updateState) Task=`f658a05a-4cf3-4ef3-a667-598a8cdbb21b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:38:16,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:38:16,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:38:16,762::task::974::TaskManager.Task::(_decref) Task=`f658a05a-4cf3-4ef3-a667-598a8cdbb21b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:16,782::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:17,783::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:38:17,959::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:38:17,977::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304806 s, 13.4 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:38:17,982::task::579::TaskManager.Task::(_updateState) Task=`8e719827-6d72-436c-8fa2-bd5c48731055`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:38:17,985::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:38:17,989::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:38:17,991::task::1168::TaskManager.Task::(prepare) Task=`8e719827-6d72-436c-8fa2-bd5c48731055`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:38:17,993::task::579::TaskManager.Task::(_updateState) Task=`8e719827-6d72-436c-8fa2-bd5c48731055`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:38:17,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:38:17,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:38:17,999::task::974::TaskManager.Task::(_decref) Task=`8e719827-6d72-436c-8fa2-bd5c48731055`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:18,147::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:18,785::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:38:19,026::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:38:19,043::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267635 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:19,148::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:19,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:38:19,786::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:20,150::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:20,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:21,789::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:22,151::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:22,790::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:23,791::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:24,152::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:24,153::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:24,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:38:24,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:38:24,793::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:38:24,958::task::579::TaskManager.Task::(_updateState) Task=`3dd40241-f1c1-4494-b512-1ca376461e9a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:38:24,958::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:38:24,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:38:24,959::task::1168::TaskManager.Task::(prepare) Task=`3dd40241-f1c1-4494-b512-1ca376461e9a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:38:24,959::task::579::TaskManager.Task::(_updateState) Task=`3dd40241-f1c1-4494-b512-1ca376461e9a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:38:24,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:38:24,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:38:24,959::task::974::TaskManager.Task::(_decref) Task=`3dd40241-f1c1-4494-b512-1ca376461e9a`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:38:25,446::task::579::TaskManager.Task::(_updateState) Task=`4323aba4-6d44-4c5a-8ee4-9faa6d63e6ba`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:38:25,446::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:38:25,447::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:38:25,447::task::1168::TaskManager.Task::(prepare) Task=`4323aba4-6d44-4c5a-8ee4-9faa6d63e6ba`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:38:25,447::task::579::TaskManager.Task::(_updateState) Task=`4323aba4-6d44-4c5a-8ee4-9faa6d63e6ba`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:38:25,447::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:38:25,447::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:38:25,447::task::974::TaskManager.Task::(_decref) Task=`4323aba4-6d44-4c5a-8ee4-9faa6d63e6ba`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:38:25,448::task::579::TaskManager.Task::(_updateState) Task=`2a56f5f3-3687-4c34-b78f-a5dca9cdb2e1`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:38:25,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:38:25,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:38:25,448::task::1168::TaskManager.Task::(prepare) Task=`2a56f5f3-3687-4c34-b78f-a5dca9cdb2e1`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:38:25,448::task::579::TaskManager.Task::(_updateState) Task=`2a56f5f3-3687-4c34-b78f-a5dca9cdb2e1`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:38:25,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:38:25,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:38:25,449::task::974::TaskManager.Task::(_decref) Task=`2a56f5f3-3687-4c34-b78f-a5dca9cdb2e1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:25,795::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:38:25,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:38:25,963::task::579::TaskManager.Task::(_updateState) Task=`e35170e8-6eea-4a9d-8cc0-6105a3f6000b`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:38:25,963::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:38:25,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:38:25,963::task::1168::TaskManager.Task::(prepare) Task=`e35170e8-6eea-4a9d-8cc0-6105a3f6000b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:38:25,963::task::579::TaskManager.Task::(_updateState) Task=`e35170e8-6eea-4a9d-8cc0-6105a3f6000b`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:38:25,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:38:25,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:38:25,964::task::974::TaskManager.Task::(_decref) Task=`e35170e8-6eea-4a9d-8cc0-6105a3f6000b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:26,154::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:26,795::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:38:26,796::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:38:26,796::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:27,797::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:38:27,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:38:28,001::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:38:28,018::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235876 s, 17.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:28,156::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:28,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:38:28,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:38:29,051::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:38:29,068::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292352 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:29,158::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:38:29,159::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:38:29,160::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:38:29,542::task::579::TaskManager.Task::(_updateState) Task=`66aafa83-7a36-458a-a892-11c6ec03d413`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:38:29,543::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:38:29,543::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:38:29,543::task::1168::TaskManager.Task::(prepare) Task=`66aafa83-7a36-458a-a892-11c6ec03d413`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:38:29,543::task::579::TaskManager.Task::(_updateState) Task=`66aafa83-7a36-458a-a892-11c6ec03d413`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:38:29,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:38:29,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:38:29,544::task::974::TaskManager.Task::(_decref) Task=`66aafa83-7a36-458a-a892-11c6ec03d413`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:38:29,571::task::579::TaskManager.Task::(_updateState) Task=`9e2036a3-9160-47a0-be06-ffcb1505c7f5`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:38:29,571::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:38:29,571::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:38:29,571::task::1168::TaskManager.Task::(prepare) Task=`9e2036a3-9160-47a0-be06-ffcb1505c7f5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:38:29,572::task::579::TaskManager.Task::(_updateState) Task=`9e2036a3-9160-47a0-be06-ffcb1505c7f5`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:38:29,572::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:38:29,572::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:38:29,572::task::974::TaskManager.Task::(_decref) Task=`9e2036a3-9160-47a0-be06-ffcb1505c7f5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:29,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:30,161::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:30,801::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:38:30,802::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:31,803::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:38:31,803::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:32,162::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286873::DEBUG::2014-01-16 16:38:32,616::task::579::TaskManager.Task::(_updateState) Task=`34887257-eab6-4d9d-98a9-b77963d8e624`::moving from state init -> state preparing >Thread-286873::INFO::2014-01-16 16:38:32,616::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286873::INFO::2014-01-16 16:38:32,617::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292352', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235876', 'lastCheck': '4.6', 'valid': True}} >Thread-286873::DEBUG::2014-01-16 16:38:32,617::task::1168::TaskManager.Task::(prepare) Task=`34887257-eab6-4d9d-98a9-b77963d8e624`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292352', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235876', 'lastCheck': '4.6', 'valid': True}} >Thread-286873::DEBUG::2014-01-16 16:38:32,617::task::579::TaskManager.Task::(_updateState) Task=`34887257-eab6-4d9d-98a9-b77963d8e624`::moving from state preparing -> state finished >Thread-286873::DEBUG::2014-01-16 16:38:32,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286873::DEBUG::2014-01-16 16:38:32,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286873::DEBUG::2014-01-16 16:38:32,617::task::974::TaskManager.Task::(_decref) Task=`34887257-eab6-4d9d-98a9-b77963d8e624`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:32,805::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:38:32,808::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:38:32,809::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:38:32,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:33,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:38:33,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:38:33,811::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:34,163::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:34,164::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:38:34,553::task::579::TaskManager.Task::(_updateState) Task=`711d7306-ee86-4c58-8b57-8d5fb568efaa`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:38:34,554::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:38:34,554::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:38:34,554::task::1168::TaskManager.Task::(prepare) Task=`711d7306-ee86-4c58-8b57-8d5fb568efaa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:38:34,554::task::579::TaskManager.Task::(_updateState) Task=`711d7306-ee86-4c58-8b57-8d5fb568efaa`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:38:34,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:38:34,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:38:34,555::task::974::TaskManager.Task::(_decref) Task=`711d7306-ee86-4c58-8b57-8d5fb568efaa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:34,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:38:34,813::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:35,814::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:38:35,814::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:38:35,814::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:38:35,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:36,165::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:36,815::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:38:37,085::task::579::TaskManager.Task::(_updateState) Task=`4afd7203-37e2-45ab-9092-ea106927bc29`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:38:37,086::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:38:37,086::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:38:37,086::task::1168::TaskManager.Task::(prepare) Task=`4afd7203-37e2-45ab-9092-ea106927bc29`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:38:37,086::task::579::TaskManager.Task::(_updateState) Task=`4afd7203-37e2-45ab-9092-ea106927bc29`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:38:37,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:38:37,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:38:37,087::task::974::TaskManager.Task::(_decref) Task=`4afd7203-37e2-45ab-9092-ea106927bc29`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:37,816::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:38:37,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:38:37,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:38:37,817::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:37,817::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:38:37,817::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-16393::DEBUG::2014-01-16 16:38:37,818::task::579::TaskManager.Task::(_updateState) Task=`b0e8acb3-598f-4b69-84a5-8d199c87fbcb`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:38:37,819::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:38:37,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:38:37,819::task::1168::TaskManager.Task::(prepare) Task=`b0e8acb3-598f-4b69-84a5-8d199c87fbcb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:38:37,820::task::579::TaskManager.Task::(_updateState) Task=`b0e8acb3-598f-4b69-84a5-8d199c87fbcb`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:38:37,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:38:37,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:38:37,820::task::974::TaskManager.Task::(_decref) Task=`b0e8acb3-598f-4b69-84a5-8d199c87fbcb`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:38:37,857::task::579::TaskManager.Task::(_updateState) Task=`fa8e2adc-0782-4813-85a4-9b7332960969`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:38:37,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:38:37,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:38:37,858::task::1168::TaskManager.Task::(prepare) Task=`fa8e2adc-0782-4813-85a4-9b7332960969`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:38:37,858::task::579::TaskManager.Task::(_updateState) Task=`fa8e2adc-0782-4813-85a4-9b7332960969`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:38:37,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:38:37,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:38:37,858::task::974::TaskManager.Task::(_decref) Task=`fa8e2adc-0782-4813-85a4-9b7332960969`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:38:38,025::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:38:38,043::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267324 s, 15.3 MB/s\n'; <rc> = 0 >Thread-69607::DEBUG::2014-01-16 16:38:38,047::task::579::TaskManager.Task::(_updateState) Task=`cc91d812-6ef2-4ca0-829c-74110812a9b6`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:38:38,050::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:38:38,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:38:38,055::task::1168::TaskManager.Task::(prepare) Task=`cc91d812-6ef2-4ca0-829c-74110812a9b6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:38:38,057::task::579::TaskManager.Task::(_updateState) Task=`cc91d812-6ef2-4ca0-829c-74110812a9b6`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:38:38,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:38:38,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:38:38,062::task::974::TaskManager.Task::(_decref) Task=`cc91d812-6ef2-4ca0-829c-74110812a9b6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:38,167::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:38,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:38:38,930::task::579::TaskManager.Task::(_updateState) Task=`c10da38e-65ba-4324-a7fe-c8e25115c0d0`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:38:38,931::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:38:38,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:38:38,931::task::1168::TaskManager.Task::(prepare) Task=`c10da38e-65ba-4324-a7fe-c8e25115c0d0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:38:38,931::task::579::TaskManager.Task::(_updateState) Task=`c10da38e-65ba-4324-a7fe-c8e25115c0d0`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:38:38,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:38:38,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:38:38,932::task::974::TaskManager.Task::(_decref) Task=`c10da38e-65ba-4324-a7fe-c8e25115c0d0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:38:39,077::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:38:39,093::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000294945 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:38:39,105::task::579::TaskManager.Task::(_updateState) Task=`d6993940-015c-4ea5-a694-0c9bf8cdfb2f`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:38:39,106::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:38:39,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:38:39,106::task::1168::TaskManager.Task::(prepare) Task=`d6993940-015c-4ea5-a694-0c9bf8cdfb2f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:38:39,107::task::579::TaskManager.Task::(_updateState) Task=`d6993940-015c-4ea5-a694-0c9bf8cdfb2f`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:38:39,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:38:39,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:38:39,107::task::974::TaskManager.Task::(_decref) Task=`d6993940-015c-4ea5-a694-0c9bf8cdfb2f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:39,168::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:39,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:38:39,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:38:39,820::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:40,170::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:40,821::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:38:40,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:38:40,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:41,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:38:41,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:38:41,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:38:41,823::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:38:42,125::task::579::TaskManager.Task::(_updateState) Task=`30080cb1-7041-4ce5-b33e-fbaa8ef4243e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:38:42,126::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:38:42,126::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:38:42,126::task::1168::TaskManager.Task::(prepare) Task=`30080cb1-7041-4ce5-b33e-fbaa8ef4243e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:38:42,126::task::579::TaskManager.Task::(_updateState) Task=`30080cb1-7041-4ce5-b33e-fbaa8ef4243e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:38:42,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:38:42,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:38:42,127::task::974::TaskManager.Task::(_decref) Task=`30080cb1-7041-4ce5-b33e-fbaa8ef4243e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:38:42,127::task::579::TaskManager.Task::(_updateState) Task=`de8882ff-e410-4523-8fbe-7fbe9b5aa6b6`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:38:42,127::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:38:42,128::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:38:42,128::task::1168::TaskManager.Task::(prepare) Task=`de8882ff-e410-4523-8fbe-7fbe9b5aa6b6`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:38:42,128::task::579::TaskManager.Task::(_updateState) Task=`de8882ff-e410-4523-8fbe-7fbe9b5aa6b6`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:38:42,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:38:42,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:38:42,128::task::974::TaskManager.Task::(_decref) Task=`de8882ff-e410-4523-8fbe-7fbe9b5aa6b6`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:38:42,128::task::579::TaskManager.Task::(_updateState) Task=`7c3c83b4-5dbf-4fd2-ba90-41624f9590c5`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:38:42,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:38:42,129::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:38:42,129::task::1168::TaskManager.Task::(prepare) Task=`7c3c83b4-5dbf-4fd2-ba90-41624f9590c5`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:38:42,129::task::579::TaskManager.Task::(_updateState) Task=`7c3c83b4-5dbf-4fd2-ba90-41624f9590c5`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:38:42,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:38:42,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:38:42,129::task::974::TaskManager.Task::(_decref) Task=`7c3c83b4-5dbf-4fd2-ba90-41624f9590c5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:42,179::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:42,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:43,826::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:38:43,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:44,181::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:44,183::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:38:44,184::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:38:44,185::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:44,827::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:45,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:46,187::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:38:46,797::task::579::TaskManager.Task::(_updateState) Task=`481b7607-2886-40bb-97a4-3f1a09afee64`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:38:46,797::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:38:46,797::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:38:46,798::task::1168::TaskManager.Task::(prepare) Task=`481b7607-2886-40bb-97a4-3f1a09afee64`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:38:46,798::task::579::TaskManager.Task::(_updateState) Task=`481b7607-2886-40bb-97a4-3f1a09afee64`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:38:46,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:38:46,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:38:46,798::task::974::TaskManager.Task::(_decref) Task=`481b7607-2886-40bb-97a4-3f1a09afee64`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:46,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:47,830::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:38:48,068::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:38:48,087::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241376 s, 17.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:48,188::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286879::DEBUG::2014-01-16 16:38:48,592::task::579::TaskManager.Task::(_updateState) Task=`c4e7fe8c-6d90-43c5-a822-b7572aaf635a`::moving from state init -> state preparing >Thread-286879::INFO::2014-01-16 16:38:48,593::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286879::INFO::2014-01-16 16:38:48,593::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294945', 'lastCheck': '9.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241376', 'lastCheck': '0.5', 'valid': True}} >Thread-286879::DEBUG::2014-01-16 16:38:48,593::task::1168::TaskManager.Task::(prepare) Task=`c4e7fe8c-6d90-43c5-a822-b7572aaf635a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294945', 'lastCheck': '9.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241376', 'lastCheck': '0.5', 'valid': True}} >Thread-286879::DEBUG::2014-01-16 16:38:48,594::task::579::TaskManager.Task::(_updateState) Task=`c4e7fe8c-6d90-43c5-a822-b7572aaf635a`::moving from state preparing -> state finished >Thread-286879::DEBUG::2014-01-16 16:38:48,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286879::DEBUG::2014-01-16 16:38:48,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286879::DEBUG::2014-01-16 16:38:48,594::task::974::TaskManager.Task::(_decref) Task=`c4e7fe8c-6d90-43c5-a822-b7572aaf635a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:48,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:38:49,103::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:38:49,120::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266356 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:49,190::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:49,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:38:49,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:50,192::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:50,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:38:51,384::task::579::TaskManager.Task::(_updateState) Task=`434b4293-ffe8-49ca-a1c2-6da212479b6f`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:38:51,385::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:38:51,385::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:38:51,385::task::1168::TaskManager.Task::(prepare) Task=`434b4293-ffe8-49ca-a1c2-6da212479b6f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:38:51,385::task::579::TaskManager.Task::(_updateState) Task=`434b4293-ffe8-49ca-a1c2-6da212479b6f`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:38:51,386::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:38:51,386::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:38:51,386::task::974::TaskManager.Task::(_decref) Task=`434b4293-ffe8-49ca-a1c2-6da212479b6f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:38:51,835::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:52,193::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:52,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:53,837::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:54,195::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:38:54,196::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:54,838::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:38:54,838::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:38:54,839::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:55,840::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:38:55,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:38:56,198::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:56,841::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:38:56,841::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:38:56,841::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:38:57,842::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:38:57,842::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:38:58,093::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:38:58,110::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000203447 s, 20.1 MB/s\n'; <rc> = 0 >Thread-84941::DEBUG::2014-01-16 16:38:58,114::task::579::TaskManager.Task::(_updateState) Task=`5854f152-5785-4011-b890-be686aa90b75`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:38:58,117::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:38:58,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:38:58,122::task::1168::TaskManager.Task::(prepare) Task=`5854f152-5785-4011-b890-be686aa90b75`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:38:58,124::task::579::TaskManager.Task::(_updateState) Task=`5854f152-5785-4011-b890-be686aa90b75`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:38:58,125::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:38:58,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:38:58,129::task::974::TaskManager.Task::(_decref) Task=`5854f152-5785-4011-b890-be686aa90b75`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:38:58,199::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:58,843::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:38:58,843::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:38:59,127::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:38:59,143::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291218 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:38:59,201::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:38:59,202::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:38:59,203::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:38:59,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:00,205::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:00,846::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:39:00,846::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:01,847::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:39:01,847::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:02,206::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:39:02,818::task::579::TaskManager.Task::(_updateState) Task=`501f4640-8846-461b-915a-dd1a9226ec47`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:39:02,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:39:02,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:39:02,819::task::1168::TaskManager.Task::(prepare) Task=`501f4640-8846-461b-915a-dd1a9226ec47`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:39:02,819::task::579::TaskManager.Task::(_updateState) Task=`501f4640-8846-461b-915a-dd1a9226ec47`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:39:02,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:39:02,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:39:02,819::task::974::TaskManager.Task::(_decref) Task=`501f4640-8846-461b-915a-dd1a9226ec47`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:39:02,820::task::579::TaskManager.Task::(_updateState) Task=`1c727aea-e30d-4759-8918-1cce4a9b5dbe`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:39:02,820::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:39:02,820::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:39:02,820::task::1168::TaskManager.Task::(prepare) Task=`1c727aea-e30d-4759-8918-1cce4a9b5dbe`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:39:02,820::task::579::TaskManager.Task::(_updateState) Task=`1c727aea-e30d-4759-8918-1cce4a9b5dbe`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:39:02,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:39:02,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:39:02,821::task::974::TaskManager.Task::(_decref) Task=`1c727aea-e30d-4759-8918-1cce4a9b5dbe`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:39:02,821::task::579::TaskManager.Task::(_updateState) Task=`c9e18223-0ead-4c9a-aa6d-9af34136387c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:39:02,821::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:39:02,821::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:39:02,821::task::1168::TaskManager.Task::(prepare) Task=`c9e18223-0ead-4c9a-aa6d-9af34136387c`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:39:02,822::task::579::TaskManager.Task::(_updateState) Task=`c9e18223-0ead-4c9a-aa6d-9af34136387c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:39:02,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:39:02,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:39:02,822::task::974::TaskManager.Task::(_decref) Task=`c9e18223-0ead-4c9a-aa6d-9af34136387c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:02,849::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:39:02,849::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:39:02,849::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:39:02,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:39:03,288::task::579::TaskManager.Task::(_updateState) Task=`108cd5ad-f48a-43e7-a5f5-7206c23db606`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:39:03,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:39:03,288::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:39:03,288::task::1168::TaskManager.Task::(prepare) Task=`108cd5ad-f48a-43e7-a5f5-7206c23db606`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:39:03,289::task::579::TaskManager.Task::(_updateState) Task=`108cd5ad-f48a-43e7-a5f5-7206c23db606`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:39:03,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:39:03,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:39:03,289::task::974::TaskManager.Task::(_decref) Task=`108cd5ad-f48a-43e7-a5f5-7206c23db606`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:39:03,289::task::579::TaskManager.Task::(_updateState) Task=`0ebe4dd8-25ae-474b-830b-25b477c363ae`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:39:03,289::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:39:03,290::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:39:03,290::task::1168::TaskManager.Task::(prepare) Task=`0ebe4dd8-25ae-474b-830b-25b477c363ae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:39:03,290::task::579::TaskManager.Task::(_updateState) Task=`0ebe4dd8-25ae-474b-830b-25b477c363ae`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:39:03,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:39:03,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:39:03,290::task::974::TaskManager.Task::(_decref) Task=`0ebe4dd8-25ae-474b-830b-25b477c363ae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:03,850::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:39:03,850::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:39:03,850::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:04,207::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:04,208::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286885::DEBUG::2014-01-16 16:39:04,392::task::579::TaskManager.Task::(_updateState) Task=`7ab88c32-70aa-405a-a8c5-6e074178cb89`::moving from state init -> state preparing >Thread-286885::INFO::2014-01-16 16:39:04,392::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286885::INFO::2014-01-16 16:39:04,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291218', 'lastCheck': '5.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000203447', 'lastCheck': '6.3', 'valid': True}} >Thread-286885::DEBUG::2014-01-16 16:39:04,393::task::1168::TaskManager.Task::(prepare) Task=`7ab88c32-70aa-405a-a8c5-6e074178cb89`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291218', 'lastCheck': '5.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000203447', 'lastCheck': '6.3', 'valid': True}} >Thread-286885::DEBUG::2014-01-16 16:39:04,393::task::579::TaskManager.Task::(_updateState) Task=`7ab88c32-70aa-405a-a8c5-6e074178cb89`::moving from state preparing -> state finished >Thread-286885::DEBUG::2014-01-16 16:39:04,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286885::DEBUG::2014-01-16 16:39:04,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286885::DEBUG::2014-01-16 16:39:04,393::task::974::TaskManager.Task::(_decref) Task=`7ab88c32-70aa-405a-a8c5-6e074178cb89`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:04,851::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:39:04,851::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:39:05,064::task::579::TaskManager.Task::(_updateState) Task=`998fbe12-8265-4403-a27e-4b9ffa6495d1`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:39:05,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:39:05,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:39:05,064::task::1168::TaskManager.Task::(prepare) Task=`998fbe12-8265-4403-a27e-4b9ffa6495d1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:39:05,064::task::579::TaskManager.Task::(_updateState) Task=`998fbe12-8265-4403-a27e-4b9ffa6495d1`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:39:05,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:39:05,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:39:05,065::task::974::TaskManager.Task::(_decref) Task=`998fbe12-8265-4403-a27e-4b9ffa6495d1`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:39:05,507::task::579::TaskManager.Task::(_updateState) Task=`e74360eb-c706-44a9-8ba8-918180cc4593`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:39:05,507::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:39:05,508::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:39:05,508::task::1168::TaskManager.Task::(prepare) Task=`e74360eb-c706-44a9-8ba8-918180cc4593`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:39:05,508::task::579::TaskManager.Task::(_updateState) Task=`e74360eb-c706-44a9-8ba8-918180cc4593`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:39:05,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:39:05,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:39:05,508::task::974::TaskManager.Task::(_decref) Task=`e74360eb-c706-44a9-8ba8-918180cc4593`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:39:05,510::task::579::TaskManager.Task::(_updateState) Task=`bcba2364-d07f-495c-9386-8d9d9714100e`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:39:05,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:39:05,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:39:05,511::task::1168::TaskManager.Task::(prepare) Task=`bcba2364-d07f-495c-9386-8d9d9714100e`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:39:05,511::task::579::TaskManager.Task::(_updateState) Task=`bcba2364-d07f-495c-9386-8d9d9714100e`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:39:05,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:39:05,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:39:05,511::task::974::TaskManager.Task::(_decref) Task=`bcba2364-d07f-495c-9386-8d9d9714100e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:05,852::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:39:05,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:39:05,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:39:05,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:06,209::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:06,854::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:39:06,999::task::579::TaskManager.Task::(_updateState) Task=`4d5cd5ff-f5e5-4aaf-bacd-b498fedbe621`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:39:06,999::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:39:07,000::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:39:07,000::task::1168::TaskManager.Task::(prepare) Task=`4d5cd5ff-f5e5-4aaf-bacd-b498fedbe621`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:39:07,000::task::579::TaskManager.Task::(_updateState) Task=`4d5cd5ff-f5e5-4aaf-bacd-b498fedbe621`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:39:07,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:39:07,000::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:39:07,001::task::974::TaskManager.Task::(_decref) Task=`4d5cd5ff-f5e5-4aaf-bacd-b498fedbe621`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:39:07,001::task::579::TaskManager.Task::(_updateState) Task=`65805007-3e28-4295-9966-335a77ffbf21`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:39:07,001::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:39:07,001::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:39:07,001::task::1168::TaskManager.Task::(prepare) Task=`65805007-3e28-4295-9966-335a77ffbf21`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:39:07,002::task::579::TaskManager.Task::(_updateState) Task=`65805007-3e28-4295-9966-335a77ffbf21`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:39:07,002::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:39:07,002::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:39:07,002::task::974::TaskManager.Task::(_decref) Task=`65805007-3e28-4295-9966-335a77ffbf21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:07,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:39:07,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:39:07,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:39:07,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:07,856::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:39:07,856::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-22::DEBUG::2014-01-16 16:39:08,134::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:39:08,151::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210474 s, 19.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:08,210::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:08,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:39:09,157::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:39:09,173::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000261691 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:39:09,177::task::579::TaskManager.Task::(_updateState) Task=`93c8cde7-25f6-4668-82a0-7b30cf27b9e1`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:39:09,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:39:09,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:39:09,179::task::1168::TaskManager.Task::(prepare) Task=`93c8cde7-25f6-4668-82a0-7b30cf27b9e1`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:39:09,179::task::579::TaskManager.Task::(_updateState) Task=`93c8cde7-25f6-4668-82a0-7b30cf27b9e1`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:39:09,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:39:09,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:39:09,179::task::974::TaskManager.Task::(_decref) Task=`93c8cde7-25f6-4668-82a0-7b30cf27b9e1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:39:09,212::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 16:39:09,298::task::579::TaskManager.Task::(_updateState) Task=`9ff61ac6-0526-4cab-9bf2-55ce36cb4a48`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:39:09,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:39:09,299::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:39:09,299::task::1168::TaskManager.Task::(prepare) Task=`9ff61ac6-0526-4cab-9bf2-55ce36cb4a48`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:39:09,299::task::579::TaskManager.Task::(_updateState) Task=`9ff61ac6-0526-4cab-9bf2-55ce36cb4a48`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:39:09,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:39:09,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:39:09,299::task::974::TaskManager.Task::(_decref) Task=`9ff61ac6-0526-4cab-9bf2-55ce36cb4a48`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:39:09,318::task::579::TaskManager.Task::(_updateState) Task=`ed1ea421-fee0-4dab-9566-64a1593ff117`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:39:09,318::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:39:09,318::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:39:09,318::task::1168::TaskManager.Task::(prepare) Task=`ed1ea421-fee0-4dab-9566-64a1593ff117`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:39:09,318::task::579::TaskManager.Task::(_updateState) Task=`ed1ea421-fee0-4dab-9566-64a1593ff117`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:39:09,318::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:39:09,319::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:39:09,319::task::974::TaskManager.Task::(_decref) Task=`ed1ea421-fee0-4dab-9566-64a1593ff117`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:39:09,319::task::579::TaskManager.Task::(_updateState) Task=`a18d2073-512c-4a5a-9ff3-631439bb283e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:39:09,319::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:39:09,320::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:39:09,320::task::1168::TaskManager.Task::(prepare) Task=`a18d2073-512c-4a5a-9ff3-631439bb283e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:39:09,320::task::579::TaskManager.Task::(_updateState) Task=`a18d2073-512c-4a5a-9ff3-631439bb283e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:39:09,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:39:09,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:39:09,320::task::974::TaskManager.Task::(_decref) Task=`a18d2073-512c-4a5a-9ff3-631439bb283e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:09,859::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:39:09,860::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:39:09,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:10,213::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:39:10,509::task::579::TaskManager.Task::(_updateState) Task=`d27fe6bc-801b-4fd2-84df-9afce20e020c`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:39:10,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:39:10,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:39:10,510::task::1168::TaskManager.Task::(prepare) Task=`d27fe6bc-801b-4fd2-84df-9afce20e020c`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:39:10,510::task::579::TaskManager.Task::(_updateState) Task=`d27fe6bc-801b-4fd2-84df-9afce20e020c`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:39:10,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:39:10,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:39:10,511::task::974::TaskManager.Task::(_decref) Task=`d27fe6bc-801b-4fd2-84df-9afce20e020c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:10,861::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:39:10,861::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:39:10,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:39:11,523::task::579::TaskManager.Task::(_updateState) Task=`f07ebb20-30b6-4fb8-9a9f-5dea8c9ba68d`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:39:11,523::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:39:11,523::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:39:11,523::task::1168::TaskManager.Task::(prepare) Task=`f07ebb20-30b6-4fb8-9a9f-5dea8c9ba68d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:39:11,524::task::579::TaskManager.Task::(_updateState) Task=`f07ebb20-30b6-4fb8-9a9f-5dea8c9ba68d`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:39:11,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:39:11,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:39:11,524::task::974::TaskManager.Task::(_decref) Task=`f07ebb20-30b6-4fb8-9a9f-5dea8c9ba68d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:11,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:39:11,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:39:11,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:39:11,863::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:12,214::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:12,863::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:13,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:39:13,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:14,216::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:14,216::task::579::TaskManager.Task::(_updateState) Task=`5d6264e5-01c5-4dca-b35a-348559fc7ea3`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:39:14,216::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:39:14,217::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:39:14,217::task::1168::TaskManager.Task::(prepare) Task=`5d6264e5-01c5-4dca-b35a-348559fc7ea3`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:39:14,217::task::579::TaskManager.Task::(_updateState) Task=`5d6264e5-01c5-4dca-b35a-348559fc7ea3`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:39:14,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:39:14,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:39:14,217::task::974::TaskManager.Task::(_decref) Task=`5d6264e5-01c5-4dca-b35a-348559fc7ea3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:39:14,219::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:39:14,220::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:39:14,221::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:14,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:14,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:39:14,680::task::579::TaskManager.Task::(_updateState) Task=`4a11ef67-f657-4460-893d-abbbdc0d3967`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:39:14,680::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:39:14,680::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:39:14,680::task::1168::TaskManager.Task::(prepare) Task=`4a11ef67-f657-4460-893d-abbbdc0d3967`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:39:14,681::task::579::TaskManager.Task::(_updateState) Task=`4a11ef67-f657-4460-893d-abbbdc0d3967`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:39:14,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:39:14,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:39:14,681::task::974::TaskManager.Task::(_decref) Task=`4a11ef67-f657-4460-893d-abbbdc0d3967`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:14,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:15,867::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:16,224::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:39:16,848::task::579::TaskManager.Task::(_updateState) Task=`d59e122d-76d0-4d3f-95b3-f3db8418f302`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:39:16,849::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:39:16,850::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:39:16,850::task::1168::TaskManager.Task::(prepare) Task=`d59e122d-76d0-4d3f-95b3-f3db8418f302`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:39:16,850::task::579::TaskManager.Task::(_updateState) Task=`d59e122d-76d0-4d3f-95b3-f3db8418f302`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:39:16,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:39:16,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:39:16,851::task::974::TaskManager.Task::(_decref) Task=`d59e122d-76d0-4d3f-95b3-f3db8418f302`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:16,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:17,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:39:18,158::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:39:18,175::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304298 s, 13.5 MB/s\n'; <rc> = 0 >Thread-49313::DEBUG::2014-01-16 16:39:18,179::task::579::TaskManager.Task::(_updateState) Task=`b053ccbb-2d1b-4cbf-8978-ea5cf1248626`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:39:18,183::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:39:18,186::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:39:18,188::task::1168::TaskManager.Task::(prepare) Task=`b053ccbb-2d1b-4cbf-8978-ea5cf1248626`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:39:18,189::task::579::TaskManager.Task::(_updateState) Task=`b053ccbb-2d1b-4cbf-8978-ea5cf1248626`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:39:18,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:39:18,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:39:18,195::task::974::TaskManager.Task::(_decref) Task=`b053ccbb-2d1b-4cbf-8978-ea5cf1248626`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:39:18,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:18,871::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:39:19,185::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:39:19,202::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000321702 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:19,228::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:19,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:39:19,872::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286891::DEBUG::2014-01-16 16:39:20,109::task::579::TaskManager.Task::(_updateState) Task=`b6d82b9f-2029-44a2-9902-d60db9f3c1cd`::moving from state init -> state preparing >Thread-286891::INFO::2014-01-16 16:39:20,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286891::INFO::2014-01-16 16:39:20,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321702', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304298', 'lastCheck': '1.9', 'valid': True}} >Thread-286891::DEBUG::2014-01-16 16:39:20,110::task::1168::TaskManager.Task::(prepare) Task=`b6d82b9f-2029-44a2-9902-d60db9f3c1cd`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321702', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304298', 'lastCheck': '1.9', 'valid': True}} >Thread-286891::DEBUG::2014-01-16 16:39:20,110::task::579::TaskManager.Task::(_updateState) Task=`b6d82b9f-2029-44a2-9902-d60db9f3c1cd`::moving from state preparing -> state finished >Thread-286891::DEBUG::2014-01-16 16:39:20,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286891::DEBUG::2014-01-16 16:39:20,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286891::DEBUG::2014-01-16 16:39:20,111::task::974::TaskManager.Task::(_decref) Task=`b6d82b9f-2029-44a2-9902-d60db9f3c1cd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:39:20,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:20,873::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:21,874::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:22,230::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:22,876::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:23,877::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:24,231::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:24,232::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:24,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:39:24,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:39:24,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:39:25,019::task::579::TaskManager.Task::(_updateState) Task=`74682e2f-197c-4c82-8eba-128ce6f4f2a3`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:39:25,020::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:39:25,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:39:25,020::task::1168::TaskManager.Task::(prepare) Task=`74682e2f-197c-4c82-8eba-128ce6f4f2a3`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:39:25,020::task::579::TaskManager.Task::(_updateState) Task=`74682e2f-197c-4c82-8eba-128ce6f4f2a3`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:39:25,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:39:25,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:39:25,021::task::974::TaskManager.Task::(_decref) Task=`74682e2f-197c-4c82-8eba-128ce6f4f2a3`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:39:25,810::task::579::TaskManager.Task::(_updateState) Task=`dad5e3c4-3f10-46e6-bb15-5295fafcdd37`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:39:25,810::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:39:25,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:39:25,811::task::1168::TaskManager.Task::(prepare) Task=`dad5e3c4-3f10-46e6-bb15-5295fafcdd37`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:39:25,811::task::579::TaskManager.Task::(_updateState) Task=`dad5e3c4-3f10-46e6-bb15-5295fafcdd37`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:39:25,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:39:25,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:39:25,811::task::974::TaskManager.Task::(_decref) Task=`dad5e3c4-3f10-46e6-bb15-5295fafcdd37`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:39:25,812::task::579::TaskManager.Task::(_updateState) Task=`7dbe1ae0-00f7-4654-9bf5-ba83e13acc16`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:39:25,812::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:39:25,812::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:39:25,812::task::1168::TaskManager.Task::(prepare) Task=`7dbe1ae0-00f7-4654-9bf5-ba83e13acc16`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:39:25,812::task::579::TaskManager.Task::(_updateState) Task=`7dbe1ae0-00f7-4654-9bf5-ba83e13acc16`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:39:25,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:39:25,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:39:25,813::task::974::TaskManager.Task::(_decref) Task=`7dbe1ae0-00f7-4654-9bf5-ba83e13acc16`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:25,880::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:39:25,880::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:39:26,118::task::579::TaskManager.Task::(_updateState) Task=`3afa72cb-11e2-4487-b864-c9162cb2ecce`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:39:26,118::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:39:26,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:39:26,119::task::1168::TaskManager.Task::(prepare) Task=`3afa72cb-11e2-4487-b864-c9162cb2ecce`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:39:26,119::task::579::TaskManager.Task::(_updateState) Task=`3afa72cb-11e2-4487-b864-c9162cb2ecce`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:39:26,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:39:26,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:39:26,119::task::974::TaskManager.Task::(_decref) Task=`3afa72cb-11e2-4487-b864-c9162cb2ecce`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:39:26,233::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:26,881::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:39:26,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:39:26,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:27,883::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:39:27,883::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:39:28,200::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:39:28,218::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000215144 s, 19.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:28,235::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:28,884::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:39:28,884::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:39:29,209::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:39:29,226::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281937 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:29,238::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:39:29,239::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:39:29,240::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:39:29,710::task::579::TaskManager.Task::(_updateState) Task=`bd59ad71-427a-4b97-8885-666c9736210c`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:39:29,711::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:39:29,711::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:39:29,711::task::1168::TaskManager.Task::(prepare) Task=`bd59ad71-427a-4b97-8885-666c9736210c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:39:29,712::task::579::TaskManager.Task::(_updateState) Task=`bd59ad71-427a-4b97-8885-666c9736210c`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:39:29,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:39:29,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:39:29,713::task::974::TaskManager.Task::(_decref) Task=`bd59ad71-427a-4b97-8885-666c9736210c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:39:29,731::task::579::TaskManager.Task::(_updateState) Task=`e5393784-b515-4390-893a-45a67f720b4c`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:39:29,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:39:29,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:39:29,731::task::1168::TaskManager.Task::(prepare) Task=`e5393784-b515-4390-893a-45a67f720b4c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:39:29,731::task::579::TaskManager.Task::(_updateState) Task=`e5393784-b515-4390-893a-45a67f720b4c`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:39:29,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:39:29,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:39:29,732::task::974::TaskManager.Task::(_decref) Task=`e5393784-b515-4390-893a-45a67f720b4c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:29,885::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:30,241::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:30,886::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:39:30,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:31,887::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:39:31,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:32,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:32,888::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:39:32,888::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:39:32,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:39:32,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:33,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:39:33,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:39:33,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:34,245::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:34,247::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:39:34,724::task::579::TaskManager.Task::(_updateState) Task=`6362eb84-090a-472c-93d4-d59418a7d9fe`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:39:34,724::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:39:34,725::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:39:34,725::task::1168::TaskManager.Task::(prepare) Task=`6362eb84-090a-472c-93d4-d59418a7d9fe`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:39:34,725::task::579::TaskManager.Task::(_updateState) Task=`6362eb84-090a-472c-93d4-d59418a7d9fe`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:39:34,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:39:34,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:39:34,725::task::974::TaskManager.Task::(_decref) Task=`6362eb84-090a-472c-93d4-d59418a7d9fe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:34,891::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:39:34,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286897::DEBUG::2014-01-16 16:39:35,853::task::579::TaskManager.Task::(_updateState) Task=`c16bf356-07d4-4848-9863-3daabd2d85e0`::moving from state init -> state preparing >Thread-286897::INFO::2014-01-16 16:39:35,853::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286897::INFO::2014-01-16 16:39:35,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281937', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000215144', 'lastCheck': '7.6', 'valid': True}} >Thread-286897::DEBUG::2014-01-16 16:39:35,853::task::1168::TaskManager.Task::(prepare) Task=`c16bf356-07d4-4848-9863-3daabd2d85e0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281937', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000215144', 'lastCheck': '7.6', 'valid': True}} >Thread-286897::DEBUG::2014-01-16 16:39:35,854::task::579::TaskManager.Task::(_updateState) Task=`c16bf356-07d4-4848-9863-3daabd2d85e0`::moving from state preparing -> state finished >Thread-286897::DEBUG::2014-01-16 16:39:35,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286897::DEBUG::2014-01-16 16:39:35,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286897::DEBUG::2014-01-16 16:39:35,854::task::974::TaskManager.Task::(_decref) Task=`c16bf356-07d4-4848-9863-3daabd2d85e0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:35,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:39:35,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:39:35,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:39:35,893::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:36,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:36,895::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:39:37,242::task::579::TaskManager.Task::(_updateState) Task=`c77b0ca7-c8b1-42e6-ae25-fdb96e5520ed`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:39:37,242::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:39:37,243::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:39:37,243::task::1168::TaskManager.Task::(prepare) Task=`c77b0ca7-c8b1-42e6-ae25-fdb96e5520ed`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:39:37,243::task::579::TaskManager.Task::(_updateState) Task=`c77b0ca7-c8b1-42e6-ae25-fdb96e5520ed`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:39:37,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:39:37,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:39:37,244::task::974::TaskManager.Task::(_decref) Task=`c77b0ca7-c8b1-42e6-ae25-fdb96e5520ed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:37,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:39:37,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:39:37,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:39:37,896::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:37,897::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:39:37,898::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-16393::DEBUG::2014-01-16 16:39:37,975::task::579::TaskManager.Task::(_updateState) Task=`ce2437ce-2d7f-4bc2-bbea-e2a9d12c13cb`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:39:37,975::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:39:37,975::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:39:37,976::task::1168::TaskManager.Task::(prepare) Task=`ce2437ce-2d7f-4bc2-bbea-e2a9d12c13cb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:39:37,976::task::579::TaskManager.Task::(_updateState) Task=`ce2437ce-2d7f-4bc2-bbea-e2a9d12c13cb`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:39:37,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:39:37,976::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:39:37,976::task::974::TaskManager.Task::(_decref) Task=`ce2437ce-2d7f-4bc2-bbea-e2a9d12c13cb`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:39:38,014::task::579::TaskManager.Task::(_updateState) Task=`f5f7dbf9-6151-4971-a2e9-41c29f70d38d`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:39:38,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:39:38,015::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:39:38,015::task::1168::TaskManager.Task::(prepare) Task=`f5f7dbf9-6151-4971-a2e9-41c29f70d38d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:39:38,015::task::579::TaskManager.Task::(_updateState) Task=`f5f7dbf9-6151-4971-a2e9-41c29f70d38d`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:39:38,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:39:38,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:39:38,015::task::974::TaskManager.Task::(_decref) Task=`f5f7dbf9-6151-4971-a2e9-41c29f70d38d`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:39:38,224::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:39:38,241::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287422 s, 14.3 MB/s\n'; <rc> = 0 >Thread-69607::DEBUG::2014-01-16 16:39:38,245::task::579::TaskManager.Task::(_updateState) Task=`ce258e2a-18c2-49c1-a449-ac52476f707e`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:39:38,248::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-189817::DEBUG::2014-01-16 16:39:38,251::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-69607::INFO::2014-01-16 16:39:38,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:39:38,257::task::1168::TaskManager.Task::(prepare) Task=`ce258e2a-18c2-49c1-a449-ac52476f707e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:39:38,259::task::579::TaskManager.Task::(_updateState) Task=`ce258e2a-18c2-49c1-a449-ac52476f707e`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:39:38,259::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:39:38,260::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:39:38,261::task::974::TaskManager.Task::(_decref) Task=`ce258e2a-18c2-49c1-a449-ac52476f707e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:38,899::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:39:39,098::task::579::TaskManager.Task::(_updateState) Task=`902cdcea-d928-42b9-a8c6-6404f85c022a`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:39:39,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:39:39,099::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:39:39,099::task::1168::TaskManager.Task::(prepare) Task=`902cdcea-d928-42b9-a8c6-6404f85c022a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:39:39,099::task::579::TaskManager.Task::(_updateState) Task=`902cdcea-d928-42b9-a8c6-6404f85c022a`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:39:39,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:39:39,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:39:39,100::task::974::TaskManager.Task::(_decref) Task=`902cdcea-d928-42b9-a8c6-6404f85c022a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:39:39,235::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:39:39,253::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257211 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:39,258::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 16:39:39,261::task::579::TaskManager.Task::(_updateState) Task=`5dbfdf47-722c-4e8a-9020-f8cd15054cbe`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:39:39,261::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:39:39,262::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:39:39,262::task::1168::TaskManager.Task::(prepare) Task=`5dbfdf47-722c-4e8a-9020-f8cd15054cbe`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:39:39,262::task::579::TaskManager.Task::(_updateState) Task=`5dbfdf47-722c-4e8a-9020-f8cd15054cbe`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:39:39,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:39:39,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:39:39,263::task::974::TaskManager.Task::(_decref) Task=`5dbfdf47-722c-4e8a-9020-f8cd15054cbe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:39,900::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:39:39,901::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:39:39,901::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:40,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:40,901::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:39:40,902::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:39:40,902::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:41,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:39:41,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:39:41,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:39:41,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:42,261::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:39:42,405::task::579::TaskManager.Task::(_updateState) Task=`d934def5-d569-4c88-a2ba-65177577b8d2`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:39:42,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:39:42,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:39:42,406::task::1168::TaskManager.Task::(prepare) Task=`d934def5-d569-4c88-a2ba-65177577b8d2`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:39:42,406::task::579::TaskManager.Task::(_updateState) Task=`d934def5-d569-4c88-a2ba-65177577b8d2`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:39:42,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:39:42,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:39:42,407::task::974::TaskManager.Task::(_decref) Task=`d934def5-d569-4c88-a2ba-65177577b8d2`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:39:42,407::task::579::TaskManager.Task::(_updateState) Task=`68489902-09db-485b-aa7e-24b1b7fff89e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:39:42,407::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:39:42,407::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:39:42,407::task::1168::TaskManager.Task::(prepare) Task=`68489902-09db-485b-aa7e-24b1b7fff89e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:39:42,407::task::579::TaskManager.Task::(_updateState) Task=`68489902-09db-485b-aa7e-24b1b7fff89e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:39:42,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:39:42,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:39:42,408::task::974::TaskManager.Task::(_decref) Task=`68489902-09db-485b-aa7e-24b1b7fff89e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:39:42,408::task::579::TaskManager.Task::(_updateState) Task=`03565a4f-9aa4-4ef7-90eb-304e52d6e2f1`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:39:42,408::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:39:42,409::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:39:42,409::task::1168::TaskManager.Task::(prepare) Task=`03565a4f-9aa4-4ef7-90eb-304e52d6e2f1`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:39:42,409::task::579::TaskManager.Task::(_updateState) Task=`03565a4f-9aa4-4ef7-90eb-304e52d6e2f1`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:39:42,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:39:42,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:39:42,409::task::974::TaskManager.Task::(_decref) Task=`03565a4f-9aa4-4ef7-90eb-304e52d6e2f1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:42,904::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:43,905::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:39:43,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:44,263::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:44,264::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:39:44,264::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:39:44,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:44,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:45,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:46,267::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:46,909::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:39:46,962::task::579::TaskManager.Task::(_updateState) Task=`c47cc064-fa7f-49b1-a2ed-a664bbe9c8a9`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:39:46,963::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:39:46,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:39:46,963::task::1168::TaskManager.Task::(prepare) Task=`c47cc064-fa7f-49b1-a2ed-a664bbe9c8a9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:39:46,963::task::579::TaskManager.Task::(_updateState) Task=`c47cc064-fa7f-49b1-a2ed-a664bbe9c8a9`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:39:46,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:39:46,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:39:46,964::task::974::TaskManager.Task::(_decref) Task=`c47cc064-fa7f-49b1-a2ed-a664bbe9c8a9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:47,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:39:48,263::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:39:48,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:39:48,287::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268145 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:39:48,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:39:49,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:39:49,279::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000265376 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:49,286::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:49,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:39:49,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:50,288::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:50,915::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:39:51,563::task::579::TaskManager.Task::(_updateState) Task=`cdae19c2-36c6-49f4-8d02-73127403f435`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:39:51,564::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:39:51,564::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:39:51,564::task::1168::TaskManager.Task::(prepare) Task=`cdae19c2-36c6-49f4-8d02-73127403f435`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:39:51,564::task::579::TaskManager.Task::(_updateState) Task=`cdae19c2-36c6-49f4-8d02-73127403f435`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:39:51,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:39:51,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:39:51,565::task::974::TaskManager.Task::(_decref) Task=`cdae19c2-36c6-49f4-8d02-73127403f435`::ref 0 aborting False >Thread-286903::DEBUG::2014-01-16 16:39:51,601::task::579::TaskManager.Task::(_updateState) Task=`755c0b32-542b-4661-9886-eef28bcab751`::moving from state init -> state preparing >Thread-286903::INFO::2014-01-16 16:39:51,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286903::INFO::2014-01-16 16:39:51,602::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265376', 'lastCheck': '2.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268145', 'lastCheck': '3.3', 'valid': True}} >Thread-286903::DEBUG::2014-01-16 16:39:51,602::task::1168::TaskManager.Task::(prepare) Task=`755c0b32-542b-4661-9886-eef28bcab751`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265376', 'lastCheck': '2.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268145', 'lastCheck': '3.3', 'valid': True}} >Thread-286903::DEBUG::2014-01-16 16:39:51,602::task::579::TaskManager.Task::(_updateState) Task=`755c0b32-542b-4661-9886-eef28bcab751`::moving from state preparing -> state finished >Thread-286903::DEBUG::2014-01-16 16:39:51,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286903::DEBUG::2014-01-16 16:39:51,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286903::DEBUG::2014-01-16 16:39:51,602::task::974::TaskManager.Task::(_decref) Task=`755c0b32-542b-4661-9886-eef28bcab751`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:39:51,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:52,289::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:52,918::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:53,919::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:54,291::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:39:54,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:54,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:39:54,921::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:39:54,921::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:55,922::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:39:55,922::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:39:56,294::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:56,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:39:56,924::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:39:56,924::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:39:57,924::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:39:57,925::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:39:58,292::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:39:58,309::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:39:58,314::task::579::TaskManager.Task::(_updateState) Task=`a762ff68-af7a-426e-a1bd-5977541b0cf8`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:39:58,316::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:39:58,318::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:39:58,319::task::1168::TaskManager.Task::(prepare) Task=`a762ff68-af7a-426e-a1bd-5977541b0cf8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:39:58,320::task::579::TaskManager.Task::(_updateState) Task=`a762ff68-af7a-426e-a1bd-5977541b0cf8`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:39:58,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:39:58,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:39:58,322::task::974::TaskManager.Task::(_decref) Task=`a762ff68-af7a-426e-a1bd-5977541b0cf8`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:39:58,323::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000262087 s, 15.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:39:58,926::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:39:58,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:39:59,288::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:39:59,305::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000284188 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:39:59,314::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:39:59,314::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:39:59,315::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:39:59,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:00,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:00,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:40:00,928::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:01,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:40:01,930::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:02,319::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:02,930::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:40:02,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:40:02,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:40:02,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:40:03,405::task::579::TaskManager.Task::(_updateState) Task=`d67ce8d5-458b-4309-a0b3-7894c86caba2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:40:03,405::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:40:03,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:40:03,406::task::1168::TaskManager.Task::(prepare) Task=`d67ce8d5-458b-4309-a0b3-7894c86caba2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:40:03,406::task::579::TaskManager.Task::(_updateState) Task=`d67ce8d5-458b-4309-a0b3-7894c86caba2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:40:03,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:40:03,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:40:03,406::task::974::TaskManager.Task::(_decref) Task=`d67ce8d5-458b-4309-a0b3-7894c86caba2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:40:03,407::task::579::TaskManager.Task::(_updateState) Task=`8f15197f-b071-4189-8155-b1ee63f17b2f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:40:03,407::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:40:03,407::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:40:03,407::task::1168::TaskManager.Task::(prepare) Task=`8f15197f-b071-4189-8155-b1ee63f17b2f`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:40:03,407::task::579::TaskManager.Task::(_updateState) Task=`8f15197f-b071-4189-8155-b1ee63f17b2f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:40:03,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:40:03,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:40:03,408::task::974::TaskManager.Task::(_decref) Task=`8f15197f-b071-4189-8155-b1ee63f17b2f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:40:03,408::task::579::TaskManager.Task::(_updateState) Task=`69de32f5-1063-4642-bc6b-62ba7de28c61`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:40:03,408::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:40:03,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:40:03,409::task::1168::TaskManager.Task::(prepare) Task=`69de32f5-1063-4642-bc6b-62ba7de28c61`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:40:03,409::task::579::TaskManager.Task::(_updateState) Task=`69de32f5-1063-4642-bc6b-62ba7de28c61`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:40:03,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:40:03,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:40:03,409::task::974::TaskManager.Task::(_decref) Task=`69de32f5-1063-4642-bc6b-62ba7de28c61`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:40:03,514::task::579::TaskManager.Task::(_updateState) Task=`f99c775c-5e2b-4713-add9-354e689d57e2`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:40:03,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:40:03,515::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:40:03,515::task::1168::TaskManager.Task::(prepare) Task=`f99c775c-5e2b-4713-add9-354e689d57e2`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:40:03,515::task::579::TaskManager.Task::(_updateState) Task=`f99c775c-5e2b-4713-add9-354e689d57e2`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:40:03,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:40:03,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:40:03,515::task::974::TaskManager.Task::(_decref) Task=`f99c775c-5e2b-4713-add9-354e689d57e2`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:40:03,515::task::579::TaskManager.Task::(_updateState) Task=`f016330a-ed90-4ea9-9222-40458276a031`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:40:03,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:40:03,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:40:03,516::task::1168::TaskManager.Task::(prepare) Task=`f016330a-ed90-4ea9-9222-40458276a031`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:40:03,516::task::579::TaskManager.Task::(_updateState) Task=`f016330a-ed90-4ea9-9222-40458276a031`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:40:03,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:40:03,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:40:03,516::task::974::TaskManager.Task::(_decref) Task=`f016330a-ed90-4ea9-9222-40458276a031`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:03,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:40:03,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:40:03,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:04,321::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:04,322::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:04,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:40:04,934::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:40:05,235::task::579::TaskManager.Task::(_updateState) Task=`32510bdf-77fe-4428-b0cf-ce6d3499126c`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:40:05,235::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:40:05,236::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:40:05,236::task::1168::TaskManager.Task::(prepare) Task=`32510bdf-77fe-4428-b0cf-ce6d3499126c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:40:05,236::task::579::TaskManager.Task::(_updateState) Task=`32510bdf-77fe-4428-b0cf-ce6d3499126c`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:40:05,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:40:05,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:40:05,236::task::974::TaskManager.Task::(_decref) Task=`32510bdf-77fe-4428-b0cf-ce6d3499126c`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:40:05,593::task::579::TaskManager.Task::(_updateState) Task=`7f7628d0-9a29-47f2-92fd-67df0789d2fc`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:40:05,593::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:40:05,594::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:40:05,594::task::1168::TaskManager.Task::(prepare) Task=`7f7628d0-9a29-47f2-92fd-67df0789d2fc`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:40:05,594::task::579::TaskManager.Task::(_updateState) Task=`7f7628d0-9a29-47f2-92fd-67df0789d2fc`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:40:05,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:40:05,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:40:05,594::task::974::TaskManager.Task::(_decref) Task=`7f7628d0-9a29-47f2-92fd-67df0789d2fc`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:40:05,596::task::579::TaskManager.Task::(_updateState) Task=`06d1da77-f578-496e-b0b4-a036ff39c238`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:40:05,596::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:40:05,598::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:40:05,598::task::1168::TaskManager.Task::(prepare) Task=`06d1da77-f578-496e-b0b4-a036ff39c238`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:40:05,598::task::579::TaskManager.Task::(_updateState) Task=`06d1da77-f578-496e-b0b4-a036ff39c238`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:40:05,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:40:05,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:40:05,599::task::974::TaskManager.Task::(_decref) Task=`06d1da77-f578-496e-b0b4-a036ff39c238`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:05,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:40:05,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:40:05,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:40:05,936::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:06,323::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:06,936::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:40:07,087::task::579::TaskManager.Task::(_updateState) Task=`c81ed2d8-f6de-48a8-8f22-28963a9ac4a6`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:40:07,087::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:40:07,088::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:40:07,088::task::1168::TaskManager.Task::(prepare) Task=`c81ed2d8-f6de-48a8-8f22-28963a9ac4a6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:40:07,088::task::579::TaskManager.Task::(_updateState) Task=`c81ed2d8-f6de-48a8-8f22-28963a9ac4a6`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:40:07,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:40:07,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:40:07,088::task::974::TaskManager.Task::(_decref) Task=`c81ed2d8-f6de-48a8-8f22-28963a9ac4a6`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:40:07,089::task::579::TaskManager.Task::(_updateState) Task=`3ac76602-9d60-48d9-8af5-8d696f795ad9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:40:07,089::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:40:07,089::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:40:07,089::task::1168::TaskManager.Task::(prepare) Task=`3ac76602-9d60-48d9-8af5-8d696f795ad9`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:40:07,089::task::579::TaskManager.Task::(_updateState) Task=`3ac76602-9d60-48d9-8af5-8d696f795ad9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:40:07,089::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:40:07,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:40:07,090::task::974::TaskManager.Task::(_decref) Task=`3ac76602-9d60-48d9-8af5-8d696f795ad9`::ref 0 aborting False >Thread-286909::DEBUG::2014-01-16 16:40:07,428::task::579::TaskManager.Task::(_updateState) Task=`8a02d6ac-8264-481f-bf14-86ddd874a0d5`::moving from state init -> state preparing >Thread-286909::INFO::2014-01-16 16:40:07,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286909::INFO::2014-01-16 16:40:07,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284188', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262087', 'lastCheck': '9.1', 'valid': True}} >Thread-286909::DEBUG::2014-01-16 16:40:07,429::task::1168::TaskManager.Task::(prepare) Task=`8a02d6ac-8264-481f-bf14-86ddd874a0d5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284188', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262087', 'lastCheck': '9.1', 'valid': True}} >Thread-286909::DEBUG::2014-01-16 16:40:07,429::task::579::TaskManager.Task::(_updateState) Task=`8a02d6ac-8264-481f-bf14-86ddd874a0d5`::moving from state preparing -> state finished >Thread-286909::DEBUG::2014-01-16 16:40:07,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286909::DEBUG::2014-01-16 16:40:07,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286909::DEBUG::2014-01-16 16:40:07,429::task::974::TaskManager.Task::(_decref) Task=`8a02d6ac-8264-481f-bf14-86ddd874a0d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:07,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:40:07,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:40:07,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:40:07,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:07,938::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:40:07,939::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:40:08,325::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:40:08,326::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:40:08,327::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:40:08,327::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:40:08,327::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:40:08,330::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:08,348::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000275625 s, 7.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:40:08,349::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000275625 s, 7.4 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:40:08,349::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:40:08,349::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:40:08,349::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:40:08,350::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:40:08,350::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:40:08,350::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:40:08,353::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:40:08,353::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:40:08,354::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:08,576::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:40:08,585::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:40:08,585::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:40:08,586::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:40:08,586::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:40:08,586::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:40:08,587::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:08,747::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:40:08,750::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:08,765::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000223041 s, 18.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:08,940::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:40:09,316::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:40:09,333::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:40:09,337::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000310661 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:40:09,337::task::579::TaskManager.Task::(_updateState) Task=`d9484414-ce7d-479e-9a4c-9bcd47a52b72`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:40:09,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:40:09,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:40:09,342::task::1168::TaskManager.Task::(prepare) Task=`d9484414-ce7d-479e-9a4c-9bcd47a52b72`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:40:09,344::task::579::TaskManager.Task::(_updateState) Task=`d9484414-ce7d-479e-9a4c-9bcd47a52b72`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:40:09,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:40:09,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:40:09,346::task::974::TaskManager.Task::(_decref) Task=`d9484414-ce7d-479e-9a4c-9bcd47a52b72`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:40:09,472::task::579::TaskManager.Task::(_updateState) Task=`cfa9457a-7e8c-4a56-9ecf-7b7501aea87c`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:40:09,473::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:40:09,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:40:09,473::task::1168::TaskManager.Task::(prepare) Task=`cfa9457a-7e8c-4a56-9ecf-7b7501aea87c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:40:09,473::task::579::TaskManager.Task::(_updateState) Task=`cfa9457a-7e8c-4a56-9ecf-7b7501aea87c`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:40:09,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:40:09,474::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:40:09,474::task::974::TaskManager.Task::(_decref) Task=`cfa9457a-7e8c-4a56-9ecf-7b7501aea87c`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:40:09,556::task::579::TaskManager.Task::(_updateState) Task=`fa9b990a-0eef-4b2e-9166-773d138db08a`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:40:09,556::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:40:09,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:40:09,557::task::1168::TaskManager.Task::(prepare) Task=`fa9b990a-0eef-4b2e-9166-773d138db08a`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:40:09,557::task::579::TaskManager.Task::(_updateState) Task=`fa9b990a-0eef-4b2e-9166-773d138db08a`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:40:09,557::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:40:09,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:40:09,557::task::974::TaskManager.Task::(_decref) Task=`fa9b990a-0eef-4b2e-9166-773d138db08a`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:40:09,558::task::579::TaskManager.Task::(_updateState) Task=`7a845eeb-4327-4c27-8a32-c64cd0a25384`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:40:09,558::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:40:09,558::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:40:09,558::task::1168::TaskManager.Task::(prepare) Task=`7a845eeb-4327-4c27-8a32-c64cd0a25384`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:40:09,558::task::579::TaskManager.Task::(_updateState) Task=`7a845eeb-4327-4c27-8a32-c64cd0a25384`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:40:09,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:40:09,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:40:09,559::task::974::TaskManager.Task::(_decref) Task=`7a845eeb-4327-4c27-8a32-c64cd0a25384`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:09,941::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:40:09,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:40:09,942::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:10,336::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:40:10,688::task::579::TaskManager.Task::(_updateState) Task=`add091db-0487-46e0-b4a3-cf6565835860`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:40:10,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:40:10,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:40:10,688::task::1168::TaskManager.Task::(prepare) Task=`add091db-0487-46e0-b4a3-cf6565835860`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:40:10,689::task::579::TaskManager.Task::(_updateState) Task=`add091db-0487-46e0-b4a3-cf6565835860`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:40:10,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:40:10,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:40:10,689::task::974::TaskManager.Task::(_decref) Task=`add091db-0487-46e0-b4a3-cf6565835860`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:10,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:40:10,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:40:10,943::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:40:11,686::task::579::TaskManager.Task::(_updateState) Task=`3912fd90-c198-46db-b893-940d2a813db9`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:40:11,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:40:11,686::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:40:11,687::task::1168::TaskManager.Task::(prepare) Task=`3912fd90-c198-46db-b893-940d2a813db9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:40:11,687::task::579::TaskManager.Task::(_updateState) Task=`3912fd90-c198-46db-b893-940d2a813db9`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:40:11,687::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:40:11,687::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:40:11,687::task::974::TaskManager.Task::(_decref) Task=`3912fd90-c198-46db-b893-940d2a813db9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:11,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:40:11,944::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:40:11,944::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:40:11,944::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:12,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:12,945::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:13,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:40:13,946::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:14,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:14,339::task::579::TaskManager.Task::(_updateState) Task=`a61666b8-925e-4673-bdd4-cf983d0cac5b`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:40:14,339::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:40:14,340::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:40:14,340::task::1168::TaskManager.Task::(prepare) Task=`a61666b8-925e-4673-bdd4-cf983d0cac5b`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:40:14,340::task::579::TaskManager.Task::(_updateState) Task=`a61666b8-925e-4673-bdd4-cf983d0cac5b`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:40:14,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:40:14,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:40:14,340::task::974::TaskManager.Task::(_decref) Task=`a61666b8-925e-4673-bdd4-cf983d0cac5b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:40:14,342::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:40:14,342::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:40:14,344::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:14,345::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:14,346::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:40:14,870::task::579::TaskManager.Task::(_updateState) Task=`7c3bebe5-95fd-4968-aa9a-9c1804cef18d`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:40:14,870::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:40:14,871::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:40:14,871::task::1168::TaskManager.Task::(prepare) Task=`7c3bebe5-95fd-4968-aa9a-9c1804cef18d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:40:14,871::task::579::TaskManager.Task::(_updateState) Task=`7c3bebe5-95fd-4968-aa9a-9c1804cef18d`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:40:14,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:40:14,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:40:14,872::task::974::TaskManager.Task::(_decref) Task=`7c3bebe5-95fd-4968-aa9a-9c1804cef18d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:14,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:15,948::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:16,348::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:40:16,931::task::579::TaskManager.Task::(_updateState) Task=`5115d187-6c9b-43ab-92a9-2f67e3d1b8a2`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:40:16,931::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:40:16,932::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:40:16,932::task::1168::TaskManager.Task::(prepare) Task=`5115d187-6c9b-43ab-92a9-2f67e3d1b8a2`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:40:16,932::task::579::TaskManager.Task::(_updateState) Task=`5115d187-6c9b-43ab-92a9-2f67e3d1b8a2`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:40:16,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:40:16,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:40:16,933::task::974::TaskManager.Task::(_decref) Task=`5115d187-6c9b-43ab-92a9-2f67e3d1b8a2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:16,949::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:17,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:18,349::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:40:18,378::task::579::TaskManager.Task::(_updateState) Task=`88374d1b-e9c5-4175-bc88-9927b6f87c41`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:40:18,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:40:18,379::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:40:18,379::task::1168::TaskManager.Task::(prepare) Task=`88374d1b-e9c5-4175-bc88-9927b6f87c41`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:40:18,379::task::579::TaskManager.Task::(_updateState) Task=`88374d1b-e9c5-4175-bc88-9927b6f87c41`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:40:18,379::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:40:18,380::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:40:18,380::task::974::TaskManager.Task::(_decref) Task=`88374d1b-e9c5-4175-bc88-9927b6f87c41`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:40:18,771::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:18,787::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000276543 s, 14.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:18,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:19,351::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:40:19,353::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:40:19,370::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300346 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:19,953::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:40:19,953::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:20,353::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:20,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:21,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:22,355::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:22,958::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286915::DEBUG::2014-01-16 16:40:23,163::task::579::TaskManager.Task::(_updateState) Task=`55c1b559-8b0d-42b0-a855-78cd283d7448`::moving from state init -> state preparing >Thread-286915::INFO::2014-01-16 16:40:23,164::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286915::INFO::2014-01-16 16:40:23,164::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300346', 'lastCheck': '3.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276543', 'lastCheck': '4.4', 'valid': True}} >Thread-286915::DEBUG::2014-01-16 16:40:23,164::task::1168::TaskManager.Task::(prepare) Task=`55c1b559-8b0d-42b0-a855-78cd283d7448`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300346', 'lastCheck': '3.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276543', 'lastCheck': '4.4', 'valid': True}} >Thread-286915::DEBUG::2014-01-16 16:40:23,164::task::579::TaskManager.Task::(_updateState) Task=`55c1b559-8b0d-42b0-a855-78cd283d7448`::moving from state preparing -> state finished >Thread-286915::DEBUG::2014-01-16 16:40:23,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286915::DEBUG::2014-01-16 16:40:23,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286915::DEBUG::2014-01-16 16:40:23,165::task::974::TaskManager.Task::(_decref) Task=`55c1b559-8b0d-42b0-a855-78cd283d7448`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:23,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:24,356::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:24,357::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:24,964::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:40:24,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:40:24,965::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:40:25,081::task::579::TaskManager.Task::(_updateState) Task=`0a5e9400-8fe6-43f5-a54b-af226f7a1f54`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:40:25,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:40:25,082::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:40:25,082::task::1168::TaskManager.Task::(prepare) Task=`0a5e9400-8fe6-43f5-a54b-af226f7a1f54`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:40:25,082::task::579::TaskManager.Task::(_updateState) Task=`0a5e9400-8fe6-43f5-a54b-af226f7a1f54`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:40:25,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:40:25,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:40:25,083::task::974::TaskManager.Task::(_decref) Task=`0a5e9400-8fe6-43f5-a54b-af226f7a1f54`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:25,966::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:40:25,967::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:40:26,202::task::579::TaskManager.Task::(_updateState) Task=`94f781af-e612-4906-8ac8-629cf4c917c6`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:40:26,202::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:40:26,202::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:40:26,203::task::1168::TaskManager.Task::(prepare) Task=`94f781af-e612-4906-8ac8-629cf4c917c6`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:40:26,203::task::579::TaskManager.Task::(_updateState) Task=`94f781af-e612-4906-8ac8-629cf4c917c6`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:40:26,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:40:26,203::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:40:26,203::task::974::TaskManager.Task::(_decref) Task=`94f781af-e612-4906-8ac8-629cf4c917c6`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:40:26,203::task::579::TaskManager.Task::(_updateState) Task=`375828ca-1590-4532-8cdd-a15927ffde4f`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:40:26,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:40:26,204::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:40:26,204::task::1168::TaskManager.Task::(prepare) Task=`375828ca-1590-4532-8cdd-a15927ffde4f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:40:26,204::task::579::TaskManager.Task::(_updateState) Task=`375828ca-1590-4532-8cdd-a15927ffde4f`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:40:26,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:40:26,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:40:26,205::task::974::TaskManager.Task::(_decref) Task=`375828ca-1590-4532-8cdd-a15927ffde4f`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:40:26,293::task::579::TaskManager.Task::(_updateState) Task=`bf76e701-fb36-4fc1-a1d7-f6919a787f6a`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:40:26,293::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:40:26,293::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:40:26,293::task::1168::TaskManager.Task::(prepare) Task=`bf76e701-fb36-4fc1-a1d7-f6919a787f6a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:40:26,293::task::579::TaskManager.Task::(_updateState) Task=`bf76e701-fb36-4fc1-a1d7-f6919a787f6a`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:40:26,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:40:26,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:40:26,294::task::974::TaskManager.Task::(_decref) Task=`bf76e701-fb36-4fc1-a1d7-f6919a787f6a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:40:26,358::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:26,968::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:40:26,968::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:40:26,968::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:27,969::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:40:27,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:28,359::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:40:28,794::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:28,812::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000212845 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:28,971::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:40:28,971::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:29,361::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:40:29,362::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:40:29,370::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:40:29,381::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:40:29,399::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000260046 s, 1.4 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:40:29,900::task::579::TaskManager.Task::(_updateState) Task=`21123b75-a038-4fc0-a30d-b276324d4460`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:40:29,900::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:40:29,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:40:29,901::task::1168::TaskManager.Task::(prepare) Task=`21123b75-a038-4fc0-a30d-b276324d4460`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:40:29,901::task::579::TaskManager.Task::(_updateState) Task=`21123b75-a038-4fc0-a30d-b276324d4460`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:40:29,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:40:29,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:40:29,902::task::974::TaskManager.Task::(_decref) Task=`21123b75-a038-4fc0-a30d-b276324d4460`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:40:29,905::task::579::TaskManager.Task::(_updateState) Task=`4df18cbe-0867-4393-9979-9ef6720b3455`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:40:29,905::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:40:29,906::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:40:29,906::task::1168::TaskManager.Task::(prepare) Task=`4df18cbe-0867-4393-9979-9ef6720b3455`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:40:29,906::task::579::TaskManager.Task::(_updateState) Task=`4df18cbe-0867-4393-9979-9ef6720b3455`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:40:29,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:40:29,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:40:29,907::task::974::TaskManager.Task::(_decref) Task=`4df18cbe-0867-4393-9979-9ef6720b3455`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:29,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:30,371::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:30,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:40:30,974::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:31,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:40:31,975::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:32,373::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:32,975::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:40:32,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:40:32,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:40:32,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:33,977::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:40:33,978::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:40:33,978::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:34,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:34,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:40:34,919::task::579::TaskManager.Task::(_updateState) Task=`5f54def5-8c9f-4d42-a540-6ffe4b227149`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:40:34,919::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:40:34,919::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:40:34,919::task::1168::TaskManager.Task::(prepare) Task=`5f54def5-8c9f-4d42-a540-6ffe4b227149`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:40:34,920::task::579::TaskManager.Task::(_updateState) Task=`5f54def5-8c9f-4d42-a540-6ffe4b227149`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:40:34,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:40:34,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:40:34,920::task::974::TaskManager.Task::(_decref) Task=`5f54def5-8c9f-4d42-a540-6ffe4b227149`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:34,979::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:40:34,979::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:35,980::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:40:35,980::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:40:35,980::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:40:35,980::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:36,376::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:36,981::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:40:37,418::task::579::TaskManager.Task::(_updateState) Task=`0b3ee74e-6980-4006-b677-b26c5b655a82`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:40:37,418::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:40:37,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:40:37,419::task::1168::TaskManager.Task::(prepare) Task=`0b3ee74e-6980-4006-b677-b26c5b655a82`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:40:37,419::task::579::TaskManager.Task::(_updateState) Task=`0b3ee74e-6980-4006-b677-b26c5b655a82`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:40:37,419::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:40:37,419::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:40:37,419::task::974::TaskManager.Task::(_decref) Task=`0b3ee74e-6980-4006-b677-b26c5b655a82`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:37,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:40:37,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:40:37,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:40:37,983::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:37,983::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:40:37,985::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-16393::DEBUG::2014-01-16 16:40:38,165::task::579::TaskManager.Task::(_updateState) Task=`b1721d7f-70a7-41a0-8e61-051d83212fc8`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:40:38,165::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:40:38,166::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:40:38,166::task::1168::TaskManager.Task::(prepare) Task=`b1721d7f-70a7-41a0-8e61-051d83212fc8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:40:38,166::task::579::TaskManager.Task::(_updateState) Task=`b1721d7f-70a7-41a0-8e61-051d83212fc8`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:40:38,166::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:40:38,166::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:40:38,166::task::974::TaskManager.Task::(_decref) Task=`b1721d7f-70a7-41a0-8e61-051d83212fc8`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:40:38,189::task::579::TaskManager.Task::(_updateState) Task=`8ac8af62-58a0-4e6b-9347-6cbaf3b4eecb`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:40:38,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:40:38,189::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:40:38,189::task::1168::TaskManager.Task::(prepare) Task=`8ac8af62-58a0-4e6b-9347-6cbaf3b4eecb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:40:38,190::task::579::TaskManager.Task::(_updateState) Task=`8ac8af62-58a0-4e6b-9347-6cbaf3b4eecb`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:40:38,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:40:38,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:40:38,190::task::974::TaskManager.Task::(_decref) Task=`8ac8af62-58a0-4e6b-9347-6cbaf3b4eecb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:40:38,377::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-69607::DEBUG::2014-01-16 16:40:38,445::task::579::TaskManager.Task::(_updateState) Task=`d269738e-f93e-4fe7-ad4e-1e371861837f`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:40:38,445::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:40:38,445::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:40:38,446::task::1168::TaskManager.Task::(prepare) Task=`d269738e-f93e-4fe7-ad4e-1e371861837f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:40:38,446::task::579::TaskManager.Task::(_updateState) Task=`d269738e-f93e-4fe7-ad4e-1e371861837f`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:40:38,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:40:38,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:40:38,446::task::974::TaskManager.Task::(_decref) Task=`d269738e-f93e-4fe7-ad4e-1e371861837f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:40:38,819::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:38,838::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000284249 s, 14.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:38,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286921::DEBUG::2014-01-16 16:40:39,067::task::579::TaskManager.Task::(_updateState) Task=`598192ec-7775-4981-b993-05f7f3c199f7`::moving from state init -> state preparing >Thread-286921::INFO::2014-01-16 16:40:39,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286921::INFO::2014-01-16 16:40:39,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260046', 'lastCheck': '9.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284249', 'lastCheck': '0.2', 'valid': True}} >Thread-286921::DEBUG::2014-01-16 16:40:39,068::task::1168::TaskManager.Task::(prepare) Task=`598192ec-7775-4981-b993-05f7f3c199f7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260046', 'lastCheck': '9.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284249', 'lastCheck': '0.2', 'valid': True}} >Thread-286921::DEBUG::2014-01-16 16:40:39,068::task::579::TaskManager.Task::(_updateState) Task=`598192ec-7775-4981-b993-05f7f3c199f7`::moving from state preparing -> state finished >Thread-286921::DEBUG::2014-01-16 16:40:39,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286921::DEBUG::2014-01-16 16:40:39,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286921::DEBUG::2014-01-16 16:40:39,068::task::974::TaskManager.Task::(_decref) Task=`598192ec-7775-4981-b993-05f7f3c199f7`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:40:39,277::task::579::TaskManager.Task::(_updateState) Task=`3d56833b-9fdf-4a80-a6d0-3087979449b9`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:40:39,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:40:39,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:40:39,278::task::1168::TaskManager.Task::(prepare) Task=`3d56833b-9fdf-4a80-a6d0-3087979449b9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:40:39,278::task::579::TaskManager.Task::(_updateState) Task=`3d56833b-9fdf-4a80-a6d0-3087979449b9`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:40:39,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:40:39,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:40:39,278::task::974::TaskManager.Task::(_decref) Task=`3d56833b-9fdf-4a80-a6d0-3087979449b9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:40:39,379::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:40:39,408::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:40:39,425::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000336689 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:40:39,439::task::579::TaskManager.Task::(_updateState) Task=`6a8594ad-adbc-48fc-a288-ea4dc7cf1d9b`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:40:39,439::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:40:39,440::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:40:39,440::task::1168::TaskManager.Task::(prepare) Task=`6a8594ad-adbc-48fc-a288-ea4dc7cf1d9b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:40:39,440::task::579::TaskManager.Task::(_updateState) Task=`6a8594ad-adbc-48fc-a288-ea4dc7cf1d9b`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:40:39,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:40:39,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:40:39,440::task::974::TaskManager.Task::(_decref) Task=`6a8594ad-adbc-48fc-a288-ea4dc7cf1d9b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:39,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:40:39,989::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:40:39,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:40,380::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:40,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:40:40,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:40:40,991::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:41,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:40:41,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:40:41,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:40:41,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:42,381::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:40:42,695::task::579::TaskManager.Task::(_updateState) Task=`4be86540-2ff2-41a5-9914-ef022b648fc0`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:40:42,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:40:42,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:40:42,696::task::1168::TaskManager.Task::(prepare) Task=`4be86540-2ff2-41a5-9914-ef022b648fc0`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:40:42,696::task::579::TaskManager.Task::(_updateState) Task=`4be86540-2ff2-41a5-9914-ef022b648fc0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:40:42,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:40:42,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:40:42,697::task::974::TaskManager.Task::(_decref) Task=`4be86540-2ff2-41a5-9914-ef022b648fc0`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:40:42,697::task::579::TaskManager.Task::(_updateState) Task=`a954e2f2-13a9-420b-949a-17a74272c832`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:40:42,697::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:40:42,697::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:40:42,697::task::1168::TaskManager.Task::(prepare) Task=`a954e2f2-13a9-420b-949a-17a74272c832`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:40:42,698::task::579::TaskManager.Task::(_updateState) Task=`a954e2f2-13a9-420b-949a-17a74272c832`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:40:42,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:40:42,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:40:42,698::task::974::TaskManager.Task::(_decref) Task=`a954e2f2-13a9-420b-949a-17a74272c832`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:40:42,698::task::579::TaskManager.Task::(_updateState) Task=`73e64f37-3b4f-4b3b-9ac0-c480be9765ba`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:40:42,698::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:40:42,699::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:40:42,699::task::1168::TaskManager.Task::(prepare) Task=`73e64f37-3b4f-4b3b-9ac0-c480be9765ba`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:40:42,699::task::579::TaskManager.Task::(_updateState) Task=`73e64f37-3b4f-4b3b-9ac0-c480be9765ba`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:40:42,699::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:40:42,699::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:40:42,699::task::974::TaskManager.Task::(_decref) Task=`73e64f37-3b4f-4b3b-9ac0-c480be9765ba`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:42,994::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:43,994::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:40:43,995::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:44,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:44,384::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:40:44,384::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:40:44,386::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:44,995::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:45,997::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:46,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:46,998::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:40:47,132::task::579::TaskManager.Task::(_updateState) Task=`c5f3749a-c0aa-4845-a76f-5c77fa97a4ef`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:40:47,132::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:40:47,132::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:40:47,133::task::1168::TaskManager.Task::(prepare) Task=`c5f3749a-c0aa-4845-a76f-5c77fa97a4ef`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:40:47,133::task::579::TaskManager.Task::(_updateState) Task=`c5f3749a-c0aa-4845-a76f-5c77fa97a4ef`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:40:47,133::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:40:47,133::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:40:47,133::task::974::TaskManager.Task::(_decref) Task=`c5f3749a-c0aa-4845-a76f-5c77fa97a4ef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:48,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:48,388::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:40:48,844::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:48,862::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000329861 s, 12.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:49,001::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:49,389::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:40:49,434::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:40:49,450::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026459 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:50,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:40:50,003::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:50,391::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:51,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:40:51,763::task::579::TaskManager.Task::(_updateState) Task=`9e8c2bf7-8904-4349-bae4-e2ad2f03bda0`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:40:51,763::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:40:51,763::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:40:51,763::task::1168::TaskManager.Task::(prepare) Task=`9e8c2bf7-8904-4349-bae4-e2ad2f03bda0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:40:51,764::task::579::TaskManager.Task::(_updateState) Task=`9e8c2bf7-8904-4349-bae4-e2ad2f03bda0`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:40:51,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:40:51,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:40:51,764::task::974::TaskManager.Task::(_decref) Task=`9e8c2bf7-8904-4349-bae4-e2ad2f03bda0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:52,005::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:52,392::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:53,007::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:54,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:54,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:40:54,395::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286927::DEBUG::2014-01-16 16:40:54,795::task::579::TaskManager.Task::(_updateState) Task=`8d699903-51f6-4c74-a98a-274e41423641`::moving from state init -> state preparing >Thread-286927::INFO::2014-01-16 16:40:54,795::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286927::INFO::2014-01-16 16:40:54,796::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026459', 'lastCheck': '5.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329861', 'lastCheck': '5.9', 'valid': True}} >Thread-286927::DEBUG::2014-01-16 16:40:54,796::task::1168::TaskManager.Task::(prepare) Task=`8d699903-51f6-4c74-a98a-274e41423641`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026459', 'lastCheck': '5.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329861', 'lastCheck': '5.9', 'valid': True}} >Thread-286927::DEBUG::2014-01-16 16:40:54,796::task::579::TaskManager.Task::(_updateState) Task=`8d699903-51f6-4c74-a98a-274e41423641`::moving from state preparing -> state finished >Thread-286927::DEBUG::2014-01-16 16:40:54,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286927::DEBUG::2014-01-16 16:40:54,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286927::DEBUG::2014-01-16 16:40:54,796::task::974::TaskManager.Task::(_decref) Task=`8d699903-51f6-4c74-a98a-274e41423641`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:40:55,010::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:40:55,010::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:40:55,010::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:56,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:40:56,012::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:56,396::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:40:57,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:40:57,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:40:57,013::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:40:58,014::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:40:58,015::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:58,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:40:58,496::task::579::TaskManager.Task::(_updateState) Task=`68abf51f-70db-4117-91e9-7814221fcc4e`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:40:58,497::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:40:58,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:40:58,497::task::1168::TaskManager.Task::(prepare) Task=`68abf51f-70db-4117-91e9-7814221fcc4e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:40:58,497::task::579::TaskManager.Task::(_updateState) Task=`68abf51f-70db-4117-91e9-7814221fcc4e`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:40:58,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:40:58,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:40:58,498::task::974::TaskManager.Task::(_decref) Task=`68abf51f-70db-4117-91e9-7814221fcc4e`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:40:58,867::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:40:58,883::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260675 s, 15.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:40:59,016::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:40:59,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:40:59,399::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:40:59,400::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:40:59,402::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:40:59,458::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:40:59,475::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279217 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:00,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:00,403::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:01,019::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:41:01,019::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:02,020::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:41:02,021::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:02,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:03,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:41:03,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:41:03,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:41:03,022::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:41:03,738::task::579::TaskManager.Task::(_updateState) Task=`facc0a2b-a487-4822-ad43-53fec9bba120`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:41:03,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:41:03,738::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:41:03,739::task::1168::TaskManager.Task::(prepare) Task=`facc0a2b-a487-4822-ad43-53fec9bba120`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:41:03,739::task::579::TaskManager.Task::(_updateState) Task=`facc0a2b-a487-4822-ad43-53fec9bba120`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:41:03,739::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:41:03,739::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:41:03,739::task::974::TaskManager.Task::(_decref) Task=`facc0a2b-a487-4822-ad43-53fec9bba120`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:41:03,739::task::579::TaskManager.Task::(_updateState) Task=`7464a23d-4e2d-48db-a91a-d22ddbd1ac71`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:41:03,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:41:03,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:41:03,740::task::1168::TaskManager.Task::(prepare) Task=`7464a23d-4e2d-48db-a91a-d22ddbd1ac71`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:41:03,740::task::579::TaskManager.Task::(_updateState) Task=`7464a23d-4e2d-48db-a91a-d22ddbd1ac71`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:41:03,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:41:03,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:41:03,740::task::974::TaskManager.Task::(_decref) Task=`7464a23d-4e2d-48db-a91a-d22ddbd1ac71`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:41:04,012::task::579::TaskManager.Task::(_updateState) Task=`6dde9d62-c557-4525-846c-bb4c5d1b3c3c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:41:04,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:41:04,012::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:41:04,013::task::1168::TaskManager.Task::(prepare) Task=`6dde9d62-c557-4525-846c-bb4c5d1b3c3c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:41:04,013::task::579::TaskManager.Task::(_updateState) Task=`6dde9d62-c557-4525-846c-bb4c5d1b3c3c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:41:04,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:41:04,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:41:04,013::task::974::TaskManager.Task::(_decref) Task=`6dde9d62-c557-4525-846c-bb4c5d1b3c3c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:41:04,014::task::579::TaskManager.Task::(_updateState) Task=`4f92b746-c6a8-4001-823e-8deba20bac67`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:41:04,014::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:41:04,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:41:04,014::task::1168::TaskManager.Task::(prepare) Task=`4f92b746-c6a8-4001-823e-8deba20bac67`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:41:04,014::task::579::TaskManager.Task::(_updateState) Task=`4f92b746-c6a8-4001-823e-8deba20bac67`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:41:04,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:41:04,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:41:04,015::task::974::TaskManager.Task::(_decref) Task=`4f92b746-c6a8-4001-823e-8deba20bac67`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:41:04,015::task::579::TaskManager.Task::(_updateState) Task=`34d8d3c4-574f-4d4b-9365-f89f24d8f058`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:41:04,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:41:04,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:41:04,016::task::1168::TaskManager.Task::(prepare) Task=`34d8d3c4-574f-4d4b-9365-f89f24d8f058`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:41:04,016::task::579::TaskManager.Task::(_updateState) Task=`34d8d3c4-574f-4d4b-9365-f89f24d8f058`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:41:04,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:41:04,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:41:04,017::task::974::TaskManager.Task::(_decref) Task=`34d8d3c4-574f-4d4b-9365-f89f24d8f058`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:04,024::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:41:04,024::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:41:04,024::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:04,407::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:04,408::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:05,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:41:05,026::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:41:05,415::task::579::TaskManager.Task::(_updateState) Task=`7b97a419-759a-4dd2-88da-2e319773d218`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:41:05,415::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:41:05,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:41:05,416::task::1168::TaskManager.Task::(prepare) Task=`7b97a419-759a-4dd2-88da-2e319773d218`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:41:05,416::task::579::TaskManager.Task::(_updateState) Task=`7b97a419-759a-4dd2-88da-2e319773d218`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:41:05,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:41:05,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:41:05,417::task::974::TaskManager.Task::(_decref) Task=`7b97a419-759a-4dd2-88da-2e319773d218`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:41:05,663::task::579::TaskManager.Task::(_updateState) Task=`b3d08312-e520-4b1a-b885-a8f096132d0e`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:41:05,663::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:41:05,665::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:41:05,665::task::1168::TaskManager.Task::(prepare) Task=`b3d08312-e520-4b1a-b885-a8f096132d0e`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:41:05,665::task::579::TaskManager.Task::(_updateState) Task=`b3d08312-e520-4b1a-b885-a8f096132d0e`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:41:05,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:41:05,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:41:05,665::task::974::TaskManager.Task::(_decref) Task=`b3d08312-e520-4b1a-b885-a8f096132d0e`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:41:05,672::task::579::TaskManager.Task::(_updateState) Task=`316d10b3-f110-44a2-b2b7-f6ba3be82b11`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:41:05,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:41:05,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:41:05,674::task::1168::TaskManager.Task::(prepare) Task=`316d10b3-f110-44a2-b2b7-f6ba3be82b11`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:41:05,674::task::579::TaskManager.Task::(_updateState) Task=`316d10b3-f110-44a2-b2b7-f6ba3be82b11`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:41:05,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:41:05,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:41:05,674::task::974::TaskManager.Task::(_decref) Task=`316d10b3-f110-44a2-b2b7-f6ba3be82b11`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:06,027::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:41:06,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:41:06,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:41:06,028::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:06,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:07,029::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:41:07,177::task::579::TaskManager.Task::(_updateState) Task=`ff9568ff-b272-40a4-9d72-f08c11cfb1ee`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:41:07,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:41:07,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:41:07,179::task::1168::TaskManager.Task::(prepare) Task=`ff9568ff-b272-40a4-9d72-f08c11cfb1ee`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:41:07,179::task::579::TaskManager.Task::(_updateState) Task=`ff9568ff-b272-40a4-9d72-f08c11cfb1ee`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:41:07,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:41:07,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:41:07,180::task::974::TaskManager.Task::(_decref) Task=`ff9568ff-b272-40a4-9d72-f08c11cfb1ee`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:41:07,180::task::579::TaskManager.Task::(_updateState) Task=`fde244ec-87c6-4585-8789-4e8dc734dae4`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:41:07,180::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:41:07,180::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:41:07,180::task::1168::TaskManager.Task::(prepare) Task=`fde244ec-87c6-4585-8789-4e8dc734dae4`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:41:07,180::task::579::TaskManager.Task::(_updateState) Task=`fde244ec-87c6-4585-8789-4e8dc734dae4`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:41:07,181::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:41:07,181::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:41:07,181::task::974::TaskManager.Task::(_decref) Task=`fde244ec-87c6-4585-8789-4e8dc734dae4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:08,031::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:41:08,031::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:41:08,031::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:41:08,031::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:08,031::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:41:08,032::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:41:08,410::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:41:08,889::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:41:08,906::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218261 s, 18.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:09,033::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:09,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:41:09,477::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:41:09,482::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:41:09,483::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:41:09,488::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:41:09,489::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:41:09,490::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:41:09,490::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:41:09,496::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-17177::DEBUG::2014-01-16 16:41:09,514::task::579::TaskManager.Task::(_updateState) Task=`e238d3a4-ac10-4fe1-b2a6-e54fdcf718a0`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:41:09,517::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:41:09,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:41:09,521::task::1168::TaskManager.Task::(prepare) Task=`e238d3a4-ac10-4fe1-b2a6-e54fdcf718a0`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:41:09,523::task::579::TaskManager.Task::(_updateState) Task=`e238d3a4-ac10-4fe1-b2a6-e54fdcf718a0`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:41:09,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:41:09,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:41:09,529::task::974::TaskManager.Task::(_decref) Task=`e238d3a4-ac10-4fe1-b2a6-e54fdcf718a0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:41:09,532::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271021 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26403::DEBUG::2014-01-16 16:41:09,643::task::579::TaskManager.Task::(_updateState) Task=`c2c3d58c-6cc9-47f7-8fba-43bf178c833a`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:41:09,644::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:41:09,644::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:41:09,644::task::1168::TaskManager.Task::(prepare) Task=`c2c3d58c-6cc9-47f7-8fba-43bf178c833a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:41:09,644::task::579::TaskManager.Task::(_updateState) Task=`c2c3d58c-6cc9-47f7-8fba-43bf178c833a`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:41:09,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:41:09,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:41:09,645::task::974::TaskManager.Task::(_decref) Task=`c2c3d58c-6cc9-47f7-8fba-43bf178c833a`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:41:09,776::task::579::TaskManager.Task::(_updateState) Task=`c4469d7e-4aaa-45e3-b615-00a04c100286`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:41:09,776::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:41:09,776::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:41:09,777::task::1168::TaskManager.Task::(prepare) Task=`c4469d7e-4aaa-45e3-b615-00a04c100286`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:41:09,777::task::579::TaskManager.Task::(_updateState) Task=`c4469d7e-4aaa-45e3-b615-00a04c100286`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:41:09,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:41:09,777::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:41:09,777::task::974::TaskManager.Task::(_decref) Task=`c4469d7e-4aaa-45e3-b615-00a04c100286`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:41:09,777::task::579::TaskManager.Task::(_updateState) Task=`28580a02-ac0b-43ba-afb7-804bdf69660d`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:41:09,778::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:41:09,778::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:41:09,778::task::1168::TaskManager.Task::(prepare) Task=`28580a02-ac0b-43ba-afb7-804bdf69660d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:41:09,778::task::579::TaskManager.Task::(_updateState) Task=`28580a02-ac0b-43ba-afb7-804bdf69660d`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:41:09,778::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:41:09,778::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:41:09,779::task::974::TaskManager.Task::(_decref) Task=`28580a02-ac0b-43ba-afb7-804bdf69660d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:10,035::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:41:10,036::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:41:10,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:10,413::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286934::DEBUG::2014-01-16 16:41:10,586::task::579::TaskManager.Task::(_updateState) Task=`9bb23890-c7f5-4f92-804b-1d48b6d163ab`::moving from state init -> state preparing >Thread-286934::INFO::2014-01-16 16:41:10,587::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286934::INFO::2014-01-16 16:41:10,587::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271021', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218261', 'lastCheck': '1.7', 'valid': True}} >Thread-286934::DEBUG::2014-01-16 16:41:10,587::task::1168::TaskManager.Task::(prepare) Task=`9bb23890-c7f5-4f92-804b-1d48b6d163ab`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271021', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218261', 'lastCheck': '1.7', 'valid': True}} >Thread-286934::DEBUG::2014-01-16 16:41:10,587::task::579::TaskManager.Task::(_updateState) Task=`9bb23890-c7f5-4f92-804b-1d48b6d163ab`::moving from state preparing -> state finished >Thread-286934::DEBUG::2014-01-16 16:41:10,587::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286934::DEBUG::2014-01-16 16:41:10,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286934::DEBUG::2014-01-16 16:41:10,588::task::974::TaskManager.Task::(_decref) Task=`9bb23890-c7f5-4f92-804b-1d48b6d163ab`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:41:10,860::task::579::TaskManager.Task::(_updateState) Task=`ccec1ec5-ccab-49c6-be24-c798adde939d`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:41:10,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:41:10,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:41:10,860::task::1168::TaskManager.Task::(prepare) Task=`ccec1ec5-ccab-49c6-be24-c798adde939d`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:41:10,860::task::579::TaskManager.Task::(_updateState) Task=`ccec1ec5-ccab-49c6-be24-c798adde939d`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:41:10,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:41:10,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:41:10,861::task::974::TaskManager.Task::(_decref) Task=`ccec1ec5-ccab-49c6-be24-c798adde939d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:11,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:41:11,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:41:11,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:41:11,850::task::579::TaskManager.Task::(_updateState) Task=`b6d33465-4c40-40aa-9f74-f767d6a3010c`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:41:11,851::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:41:11,851::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:41:11,851::task::1168::TaskManager.Task::(prepare) Task=`b6d33465-4c40-40aa-9f74-f767d6a3010c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:41:11,851::task::579::TaskManager.Task::(_updateState) Task=`b6d33465-4c40-40aa-9f74-f767d6a3010c`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:41:11,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:41:11,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:41:11,852::task::974::TaskManager.Task::(_decref) Task=`b6d33465-4c40-40aa-9f74-f767d6a3010c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:12,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:41:12,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:41:12,039::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:41:12,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:12,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:13,040::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:14,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:41:14,041::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:14,415::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:14,416::task::579::TaskManager.Task::(_updateState) Task=`7832f5b9-fe87-4771-b040-de809b2b6dba`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:41:14,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:41:14,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:41:14,417::task::1168::TaskManager.Task::(prepare) Task=`7832f5b9-fe87-4771-b040-de809b2b6dba`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:41:14,417::task::579::TaskManager.Task::(_updateState) Task=`7832f5b9-fe87-4771-b040-de809b2b6dba`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:41:14,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:41:14,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:41:14,417::task::974::TaskManager.Task::(_decref) Task=`7832f5b9-fe87-4771-b040-de809b2b6dba`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:41:14,419::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:41:14,419::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:41:14,420::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:14,422::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:14,423::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:15,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:41:15,046::task::579::TaskManager.Task::(_updateState) Task=`2da3db21-6c24-4bff-8a60-87f6a7b682b8`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:41:15,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:41:15,047::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:41:15,047::task::1168::TaskManager.Task::(prepare) Task=`2da3db21-6c24-4bff-8a60-87f6a7b682b8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:41:15,048::task::579::TaskManager.Task::(_updateState) Task=`2da3db21-6c24-4bff-8a60-87f6a7b682b8`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:41:15,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:41:15,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:41:15,048::task::974::TaskManager.Task::(_decref) Task=`2da3db21-6c24-4bff-8a60-87f6a7b682b8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:16,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:16,424::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:41:17,015::task::579::TaskManager.Task::(_updateState) Task=`0bc7eb4b-0201-4b48-918f-347459cd7e13`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:41:17,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:41:17,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:41:17,016::task::1168::TaskManager.Task::(prepare) Task=`0bc7eb4b-0201-4b48-918f-347459cd7e13`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:41:17,016::task::579::TaskManager.Task::(_updateState) Task=`0bc7eb4b-0201-4b48-918f-347459cd7e13`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:41:17,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:41:17,017::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:41:17,017::task::974::TaskManager.Task::(_decref) Task=`0bc7eb4b-0201-4b48-918f-347459cd7e13`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:17,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:18,046::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:18,426::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:41:18,557::task::579::TaskManager.Task::(_updateState) Task=`3811688b-65bb-4225-bb2e-231e13cf5819`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:41:18,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:41:18,557::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:41:18,557::task::1168::TaskManager.Task::(prepare) Task=`3811688b-65bb-4225-bb2e-231e13cf5819`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:41:18,557::task::579::TaskManager.Task::(_updateState) Task=`3811688b-65bb-4225-bb2e-231e13cf5819`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:41:18,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:41:18,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:41:18,558::task::974::TaskManager.Task::(_decref) Task=`3811688b-65bb-4225-bb2e-231e13cf5819`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:41:18,912::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:41:18,929::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000354506 s, 11.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:19,047::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:19,427::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:41:19,539::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:41:19,555::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275485 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:20,049::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:41:20,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:20,429::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:21,050::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:22,051::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:22,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:23,053::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:24,054::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:24,432::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:24,433::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:25,055::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:41:25,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:41:25,056::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:41:25,153::task::579::TaskManager.Task::(_updateState) Task=`908474a6-13d1-4ca9-9c8f-fc9d3224db1c`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:41:25,153::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:41:25,154::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:41:25,154::task::1168::TaskManager.Task::(prepare) Task=`908474a6-13d1-4ca9-9c8f-fc9d3224db1c`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:41:25,154::task::579::TaskManager.Task::(_updateState) Task=`908474a6-13d1-4ca9-9c8f-fc9d3224db1c`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:41:25,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:41:25,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:41:25,154::task::974::TaskManager.Task::(_decref) Task=`908474a6-13d1-4ca9-9c8f-fc9d3224db1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:26,057::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:41:26,058::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286940::DEBUG::2014-01-16 16:41:26,306::task::579::TaskManager.Task::(_updateState) Task=`a7e45061-7814-4310-b40f-dbe9346c3589`::moving from state init -> state preparing >Thread-286940::INFO::2014-01-16 16:41:26,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286940::INFO::2014-01-16 16:41:26,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275485', 'lastCheck': '6.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354506', 'lastCheck': '7.4', 'valid': True}} >Thread-286940::DEBUG::2014-01-16 16:41:26,306::task::1168::TaskManager.Task::(prepare) Task=`a7e45061-7814-4310-b40f-dbe9346c3589`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275485', 'lastCheck': '6.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354506', 'lastCheck': '7.4', 'valid': True}} >Thread-286940::DEBUG::2014-01-16 16:41:26,307::task::579::TaskManager.Task::(_updateState) Task=`a7e45061-7814-4310-b40f-dbe9346c3589`::moving from state preparing -> state finished >Thread-286940::DEBUG::2014-01-16 16:41:26,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286940::DEBUG::2014-01-16 16:41:26,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286940::DEBUG::2014-01-16 16:41:26,307::task::974::TaskManager.Task::(_decref) Task=`a7e45061-7814-4310-b40f-dbe9346c3589`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:41:26,434::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:41:26,457::task::579::TaskManager.Task::(_updateState) Task=`775a973a-e965-4473-bf6d-62d2948b2aeb`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:41:26,457::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:41:26,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:41:26,458::task::1168::TaskManager.Task::(prepare) Task=`775a973a-e965-4473-bf6d-62d2948b2aeb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:41:26,458::task::579::TaskManager.Task::(_updateState) Task=`775a973a-e965-4473-bf6d-62d2948b2aeb`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:41:26,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:41:26,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:41:26,459::task::974::TaskManager.Task::(_decref) Task=`775a973a-e965-4473-bf6d-62d2948b2aeb`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:41:26,563::task::579::TaskManager.Task::(_updateState) Task=`8f675335-adb7-4a26-a261-0731d72de749`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:41:26,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:41:26,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:41:26,563::task::1168::TaskManager.Task::(prepare) Task=`8f675335-adb7-4a26-a261-0731d72de749`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:41:26,563::task::579::TaskManager.Task::(_updateState) Task=`8f675335-adb7-4a26-a261-0731d72de749`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:41:26,563::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:41:26,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:41:26,564::task::974::TaskManager.Task::(_decref) Task=`8f675335-adb7-4a26-a261-0731d72de749`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:41:26,564::task::579::TaskManager.Task::(_updateState) Task=`0c9df568-218a-4a2e-8fa7-5396c5cc8871`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:41:26,564::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:41:26,564::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:41:26,564::task::1168::TaskManager.Task::(prepare) Task=`0c9df568-218a-4a2e-8fa7-5396c5cc8871`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:41:26,565::task::579::TaskManager.Task::(_updateState) Task=`0c9df568-218a-4a2e-8fa7-5396c5cc8871`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:41:26,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:41:26,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:41:26,565::task::974::TaskManager.Task::(_decref) Task=`0c9df568-218a-4a2e-8fa7-5396c5cc8871`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:27,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:41:27,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:41:27,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:28,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:41:28,061::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:28,435::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:41:28,934::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:41:28,951::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000248575 s, 16.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:29,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:41:29,063::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:29,438::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:41:29,439::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:41:29,440::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:41:29,564::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:41:29,584::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271264 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:30,064::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:41:30,071::task::579::TaskManager.Task::(_updateState) Task=`8419576a-a4ea-4e2d-a8c9-88c378837ec2`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:41:30,072::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:41:30,072::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:41:30,072::task::1168::TaskManager.Task::(prepare) Task=`8419576a-a4ea-4e2d-a8c9-88c378837ec2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:41:30,072::task::579::TaskManager.Task::(_updateState) Task=`8419576a-a4ea-4e2d-a8c9-88c378837ec2`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:41:30,073::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:41:30,073::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:41:30,073::task::974::TaskManager.Task::(_decref) Task=`8419576a-a4ea-4e2d-a8c9-88c378837ec2`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:41:30,075::task::579::TaskManager.Task::(_updateState) Task=`e1830c82-4cbb-42cb-9e3e-cd982cff7913`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:41:30,076::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:41:30,076::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:41:30,076::task::1168::TaskManager.Task::(prepare) Task=`e1830c82-4cbb-42cb-9e3e-cd982cff7913`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:41:30,077::task::579::TaskManager.Task::(_updateState) Task=`e1830c82-4cbb-42cb-9e3e-cd982cff7913`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:41:30,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:41:30,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:41:30,077::task::974::TaskManager.Task::(_decref) Task=`e1830c82-4cbb-42cb-9e3e-cd982cff7913`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:41:30,442::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:31,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:41:31,066::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:32,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:41:32,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:32,443::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:33,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:41:33,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:41:33,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:41:33,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:34,069::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:41:34,069::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:41:34,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:34,444::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:34,445::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:35,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:41:35,071::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:41:35,099::task::579::TaskManager.Task::(_updateState) Task=`db46e0d2-bd7b-44aa-9505-4ad00e8fc187`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:41:35,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:41:35,099::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:41:35,099::task::1168::TaskManager.Task::(prepare) Task=`db46e0d2-bd7b-44aa-9505-4ad00e8fc187`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:41:35,100::task::579::TaskManager.Task::(_updateState) Task=`db46e0d2-bd7b-44aa-9505-4ad00e8fc187`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:41:35,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:41:35,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:41:35,100::task::974::TaskManager.Task::(_decref) Task=`db46e0d2-bd7b-44aa-9505-4ad00e8fc187`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:36,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:41:36,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:41:36,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:41:36,073::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:36,447::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:37,075::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:41:37,600::task::579::TaskManager.Task::(_updateState) Task=`9a22600a-e81a-40d7-8483-26d9c34adfcd`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:41:37,600::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:41:37,601::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:41:37,601::task::1168::TaskManager.Task::(prepare) Task=`9a22600a-e81a-40d7-8483-26d9c34adfcd`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:41:37,601::task::579::TaskManager.Task::(_updateState) Task=`9a22600a-e81a-40d7-8483-26d9c34adfcd`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:41:37,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:41:37,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:41:37,602::task::974::TaskManager.Task::(_decref) Task=`9a22600a-e81a-40d7-8483-26d9c34adfcd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:38,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:41:38,076::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:41:38,076::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:41:38,076::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:38,076::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:41:38,076::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-16393::DEBUG::2014-01-16 16:41:38,324::task::579::TaskManager.Task::(_updateState) Task=`4695aefd-df96-43e7-aa89-6f718ed964fb`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:41:38,324::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:41:38,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:41:38,325::task::1168::TaskManager.Task::(prepare) Task=`4695aefd-df96-43e7-aa89-6f718ed964fb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:41:38,325::task::579::TaskManager.Task::(_updateState) Task=`4695aefd-df96-43e7-aa89-6f718ed964fb`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:41:38,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:41:38,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:41:38,325::task::974::TaskManager.Task::(_decref) Task=`4695aefd-df96-43e7-aa89-6f718ed964fb`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:41:38,345::task::579::TaskManager.Task::(_updateState) Task=`d02da436-59d7-4e3f-afb2-d913bccf1f7e`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:41:38,345::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:41:38,345::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:41:38,345::task::1168::TaskManager.Task::(prepare) Task=`d02da436-59d7-4e3f-afb2-d913bccf1f7e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:41:38,346::task::579::TaskManager.Task::(_updateState) Task=`d02da436-59d7-4e3f-afb2-d913bccf1f7e`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:41:38,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:41:38,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:41:38,346::task::974::TaskManager.Task::(_decref) Task=`d02da436-59d7-4e3f-afb2-d913bccf1f7e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:41:38,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-69607::DEBUG::2014-01-16 16:41:38,612::task::579::TaskManager.Task::(_updateState) Task=`2f3d80e7-10ba-4ed4-947d-f601a69ecb16`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:41:38,612::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:41:38,612::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:41:38,613::task::1168::TaskManager.Task::(prepare) Task=`2f3d80e7-10ba-4ed4-947d-f601a69ecb16`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:41:38,613::task::579::TaskManager.Task::(_updateState) Task=`2f3d80e7-10ba-4ed4-947d-f601a69ecb16`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:41:38,613::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:41:38,613::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:41:38,614::task::974::TaskManager.Task::(_decref) Task=`2f3d80e7-10ba-4ed4-947d-f601a69ecb16`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:41:38,957::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:41:38,978::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000455714 s, 9.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:39,078::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:41:39,431::task::579::TaskManager.Task::(_updateState) Task=`0adea7d2-2dbd-4a06-acf6-177bc61af6fb`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:41:39,431::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:41:39,432::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:41:39,432::task::1168::TaskManager.Task::(prepare) Task=`0adea7d2-2dbd-4a06-acf6-177bc61af6fb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:41:39,432::task::579::TaskManager.Task::(_updateState) Task=`0adea7d2-2dbd-4a06-acf6-177bc61af6fb`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:41:39,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:41:39,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:41:39,433::task::974::TaskManager.Task::(_decref) Task=`0adea7d2-2dbd-4a06-acf6-177bc61af6fb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:41:39,450::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:41:39,595::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:41:39,612::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000293352 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:41:39,615::task::579::TaskManager.Task::(_updateState) Task=`0a4b2252-9bd4-476b-b032-e4c43b6b4a10`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:41:39,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:41:39,616::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:41:39,616::task::1168::TaskManager.Task::(prepare) Task=`0a4b2252-9bd4-476b-b032-e4c43b6b4a10`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:41:39,616::task::579::TaskManager.Task::(_updateState) Task=`0a4b2252-9bd4-476b-b032-e4c43b6b4a10`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:41:39,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:41:39,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:41:39,617::task::974::TaskManager.Task::(_decref) Task=`0a4b2252-9bd4-476b-b032-e4c43b6b4a10`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:40,079::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:41:40,079::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:41:40,080::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:40,451::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:41,081::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:41:41,081::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:41:41,081::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286946::DEBUG::2014-01-16 16:41:42,060::task::579::TaskManager.Task::(_updateState) Task=`e0957a2a-6e3b-4bc1-9ead-296b4a9c054c`::moving from state init -> state preparing >Thread-286946::INFO::2014-01-16 16:41:42,060::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286946::INFO::2014-01-16 16:41:42,061::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293352', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455714', 'lastCheck': '3.1', 'valid': True}} >Thread-286946::DEBUG::2014-01-16 16:41:42,061::task::1168::TaskManager.Task::(prepare) Task=`e0957a2a-6e3b-4bc1-9ead-296b4a9c054c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293352', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455714', 'lastCheck': '3.1', 'valid': True}} >Thread-286946::DEBUG::2014-01-16 16:41:42,061::task::579::TaskManager.Task::(_updateState) Task=`e0957a2a-6e3b-4bc1-9ead-296b4a9c054c`::moving from state preparing -> state finished >Thread-286946::DEBUG::2014-01-16 16:41:42,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286946::DEBUG::2014-01-16 16:41:42,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286946::DEBUG::2014-01-16 16:41:42,061::task::974::TaskManager.Task::(_decref) Task=`e0957a2a-6e3b-4bc1-9ead-296b4a9c054c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:42,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:41:42,083::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:41:42,083::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:41:42,083::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:42,452::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:41:42,982::task::579::TaskManager.Task::(_updateState) Task=`ac9e4060-ad1b-4acb-95a7-07bacf1b450f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:41:42,983::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:41:42,983::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:41:42,983::task::1168::TaskManager.Task::(prepare) Task=`ac9e4060-ad1b-4acb-95a7-07bacf1b450f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:41:42,983::task::579::TaskManager.Task::(_updateState) Task=`ac9e4060-ad1b-4acb-95a7-07bacf1b450f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:41:42,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:41:42,983::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:41:42,983::task::974::TaskManager.Task::(_decref) Task=`ac9e4060-ad1b-4acb-95a7-07bacf1b450f`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:41:42,984::task::579::TaskManager.Task::(_updateState) Task=`69ce1755-8971-414b-bf92-721d7af53897`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:41:42,984::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:41:42,984::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:41:42,984::task::1168::TaskManager.Task::(prepare) Task=`69ce1755-8971-414b-bf92-721d7af53897`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:41:42,984::task::579::TaskManager.Task::(_updateState) Task=`69ce1755-8971-414b-bf92-721d7af53897`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:41:42,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:41:42,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:41:42,985::task::974::TaskManager.Task::(_decref) Task=`69ce1755-8971-414b-bf92-721d7af53897`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:41:42,985::task::579::TaskManager.Task::(_updateState) Task=`01873aaa-3995-4fe5-8538-26a8cc3f2e99`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:41:42,985::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:41:42,985::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:41:42,986::task::1168::TaskManager.Task::(prepare) Task=`01873aaa-3995-4fe5-8538-26a8cc3f2e99`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:41:42,986::task::579::TaskManager.Task::(_updateState) Task=`01873aaa-3995-4fe5-8538-26a8cc3f2e99`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:41:42,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:41:42,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:41:42,986::task::974::TaskManager.Task::(_decref) Task=`01873aaa-3995-4fe5-8538-26a8cc3f2e99`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:43,084::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:44,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:41:44,086::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:44,453::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:44,455::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:41:44,455::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:41:44,458::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:45,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:46,088::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:46,459::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:47,089::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:41:47,291::task::579::TaskManager.Task::(_updateState) Task=`f3b26511-2ffc-4b47-99d9-8c1f3df453f7`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:41:47,291::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:41:47,292::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:41:47,292::task::1168::TaskManager.Task::(prepare) Task=`f3b26511-2ffc-4b47-99d9-8c1f3df453f7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:41:47,292::task::579::TaskManager.Task::(_updateState) Task=`f3b26511-2ffc-4b47-99d9-8c1f3df453f7`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:41:47,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:41:47,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:41:47,292::task::974::TaskManager.Task::(_decref) Task=`f3b26511-2ffc-4b47-99d9-8c1f3df453f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:48,090::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:48,460::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:41:48,985::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:41:49,006::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260791 s, 15.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:49,092::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:49,462::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:41:49,620::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:41:49,636::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000254018 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:50,094::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:41:50,094::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:50,463::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:51,095::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:41:51,946::task::579::TaskManager.Task::(_updateState) Task=`4b510d62-38e4-4627-9e6b-eb09a1572da3`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:41:51,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:41:51,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:41:51,947::task::1168::TaskManager.Task::(prepare) Task=`4b510d62-38e4-4627-9e6b-eb09a1572da3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:41:51,947::task::579::TaskManager.Task::(_updateState) Task=`4b510d62-38e4-4627-9e6b-eb09a1572da3`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:41:51,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:41:51,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:41:51,948::task::974::TaskManager.Task::(_decref) Task=`4b510d62-38e4-4627-9e6b-eb09a1572da3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:52,096::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:52,464::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:53,098::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:54,099::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:54,466::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:41:54,466::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:55,100::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:41:55,100::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:41:55,100::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:41:56,102::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:41:56,102::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:56,468::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:41:57,103::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:41:57,103::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:41:57,103::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286952::DEBUG::2014-01-16 16:41:57,840::task::579::TaskManager.Task::(_updateState) Task=`79241190-ad76-447b-99d4-315357cc50cf`::moving from state init -> state preparing >Thread-286952::INFO::2014-01-16 16:41:57,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286952::INFO::2014-01-16 16:41:57,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254018', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260791', 'lastCheck': '8.8', 'valid': True}} >Thread-286952::DEBUG::2014-01-16 16:41:57,841::task::1168::TaskManager.Task::(prepare) Task=`79241190-ad76-447b-99d4-315357cc50cf`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254018', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260791', 'lastCheck': '8.8', 'valid': True}} >Thread-286952::DEBUG::2014-01-16 16:41:57,841::task::579::TaskManager.Task::(_updateState) Task=`79241190-ad76-447b-99d4-315357cc50cf`::moving from state preparing -> state finished >Thread-286952::DEBUG::2014-01-16 16:41:57,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286952::DEBUG::2014-01-16 16:41:57,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286952::DEBUG::2014-01-16 16:41:57,841::task::974::TaskManager.Task::(_decref) Task=`79241190-ad76-447b-99d4-315357cc50cf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:41:58,104::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:41:58,105::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:58,469::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:41:58,662::task::579::TaskManager.Task::(_updateState) Task=`22551425-2ec8-4276-b4cd-2e85b6c7f771`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:41:58,663::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:41:58,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:41:58,663::task::1168::TaskManager.Task::(prepare) Task=`22551425-2ec8-4276-b4cd-2e85b6c7f771`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:41:58,663::task::579::TaskManager.Task::(_updateState) Task=`22551425-2ec8-4276-b4cd-2e85b6c7f771`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:41:58,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:41:58,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:41:58,664::task::974::TaskManager.Task::(_decref) Task=`22551425-2ec8-4276-b4cd-2e85b6c7f771`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:41:59,012::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:41:59,029::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000244099 s, 16.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:41:59,105::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:41:59,106::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:41:59,471::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:41:59,471::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:41:59,473::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:41:59,645::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:41:59,662::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000254041 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:00,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:00,474::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:01,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:42:01,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:02,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:42:02,111::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:02,475::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:03,111::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:42:03,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:42:03,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:42:03,112::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:42:03,962::task::579::TaskManager.Task::(_updateState) Task=`6627a937-4427-406a-aaaa-0b0caae66cc5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:42:03,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:42:03,962::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:42:03,962::task::1168::TaskManager.Task::(prepare) Task=`6627a937-4427-406a-aaaa-0b0caae66cc5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:42:03,963::task::579::TaskManager.Task::(_updateState) Task=`6627a937-4427-406a-aaaa-0b0caae66cc5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:42:03,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:42:03,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:42:03,963::task::974::TaskManager.Task::(_decref) Task=`6627a937-4427-406a-aaaa-0b0caae66cc5`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:42:03,963::task::579::TaskManager.Task::(_updateState) Task=`a92848fc-225f-4621-9b6b-45bfe111bd37`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:42:03,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:42:03,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:42:03,964::task::1168::TaskManager.Task::(prepare) Task=`a92848fc-225f-4621-9b6b-45bfe111bd37`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:42:03,964::task::579::TaskManager.Task::(_updateState) Task=`a92848fc-225f-4621-9b6b-45bfe111bd37`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:42:03,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:42:03,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:42:03,964::task::974::TaskManager.Task::(_decref) Task=`a92848fc-225f-4621-9b6b-45bfe111bd37`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:04,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:42:04,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:42:04,114::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:04,476::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:04,478::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:42:04,595::task::579::TaskManager.Task::(_updateState) Task=`6e30584f-f93e-4d7a-9edc-41143960c237`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:42:04,596::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:42:04,596::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:42:04,596::task::1168::TaskManager.Task::(prepare) Task=`6e30584f-f93e-4d7a-9edc-41143960c237`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:42:04,596::task::579::TaskManager.Task::(_updateState) Task=`6e30584f-f93e-4d7a-9edc-41143960c237`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:42:04,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:42:04,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:42:04,597::task::974::TaskManager.Task::(_decref) Task=`6e30584f-f93e-4d7a-9edc-41143960c237`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:42:04,597::task::579::TaskManager.Task::(_updateState) Task=`5b375e9c-8a6d-461b-8e49-b22c014a5e07`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:42:04,597::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:42:04,597::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:42:04,597::task::1168::TaskManager.Task::(prepare) Task=`5b375e9c-8a6d-461b-8e49-b22c014a5e07`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:42:04,598::task::579::TaskManager.Task::(_updateState) Task=`5b375e9c-8a6d-461b-8e49-b22c014a5e07`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:42:04,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:42:04,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:42:04,598::task::974::TaskManager.Task::(_decref) Task=`5b375e9c-8a6d-461b-8e49-b22c014a5e07`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:42:04,598::task::579::TaskManager.Task::(_updateState) Task=`de3243b3-de9e-4816-91a6-4ddfe6e3ca92`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:42:04,598::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:42:04,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:42:04,599::task::1168::TaskManager.Task::(prepare) Task=`de3243b3-de9e-4816-91a6-4ddfe6e3ca92`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:42:04,599::task::579::TaskManager.Task::(_updateState) Task=`de3243b3-de9e-4816-91a6-4ddfe6e3ca92`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:42:04,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:42:04,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:42:04,599::task::974::TaskManager.Task::(_decref) Task=`de3243b3-de9e-4816-91a6-4ddfe6e3ca92`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:05,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:42:05,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:42:05,589::task::579::TaskManager.Task::(_updateState) Task=`a5ffbb74-1b08-40c0-9601-3c777bb044f5`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:42:05,589::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:42:05,589::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:42:05,589::task::1168::TaskManager.Task::(prepare) Task=`a5ffbb74-1b08-40c0-9601-3c777bb044f5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:42:05,590::task::579::TaskManager.Task::(_updateState) Task=`a5ffbb74-1b08-40c0-9601-3c777bb044f5`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:42:05,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:42:05,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:42:05,590::task::974::TaskManager.Task::(_decref) Task=`a5ffbb74-1b08-40c0-9601-3c777bb044f5`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:42:05,744::task::579::TaskManager.Task::(_updateState) Task=`95ffc05d-1e7b-451a-8a13-8329e3f15c07`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:42:05,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:42:05,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:42:05,744::task::1168::TaskManager.Task::(prepare) Task=`95ffc05d-1e7b-451a-8a13-8329e3f15c07`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:42:05,745::task::579::TaskManager.Task::(_updateState) Task=`95ffc05d-1e7b-451a-8a13-8329e3f15c07`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:42:05,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:42:05,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:42:05,745::task::974::TaskManager.Task::(_decref) Task=`95ffc05d-1e7b-451a-8a13-8329e3f15c07`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:42:05,753::task::579::TaskManager.Task::(_updateState) Task=`879ccd5e-78d8-4c43-b8fc-168dcdbcf433`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:42:05,753::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:42:05,754::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:42:05,754::task::1168::TaskManager.Task::(prepare) Task=`879ccd5e-78d8-4c43-b8fc-168dcdbcf433`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:42:05,754::task::579::TaskManager.Task::(_updateState) Task=`879ccd5e-78d8-4c43-b8fc-168dcdbcf433`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:42:05,754::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:42:05,754::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:42:05,754::task::974::TaskManager.Task::(_decref) Task=`879ccd5e-78d8-4c43-b8fc-168dcdbcf433`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:06,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:42:06,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:42:06,117::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:42:06,117::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:06,479::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:07,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:42:07,274::task::579::TaskManager.Task::(_updateState) Task=`6e3c29fe-cecc-42a6-9743-795f5f9010a7`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:42:07,274::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:42:07,274::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:42:07,274::task::1168::TaskManager.Task::(prepare) Task=`6e3c29fe-cecc-42a6-9743-795f5f9010a7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:42:07,275::task::579::TaskManager.Task::(_updateState) Task=`6e3c29fe-cecc-42a6-9743-795f5f9010a7`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:42:07,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:42:07,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:42:07,275::task::974::TaskManager.Task::(_decref) Task=`6e3c29fe-cecc-42a6-9743-795f5f9010a7`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:42:07,275::task::579::TaskManager.Task::(_updateState) Task=`0ca8af1f-8cfb-47a6-bd2d-baebc276cb21`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:42:07,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:42:07,276::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:42:07,276::task::1168::TaskManager.Task::(prepare) Task=`0ca8af1f-8cfb-47a6-bd2d-baebc276cb21`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:42:07,276::task::579::TaskManager.Task::(_updateState) Task=`0ca8af1f-8cfb-47a6-bd2d-baebc276cb21`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:42:07,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:42:07,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:42:07,276::task::974::TaskManager.Task::(_decref) Task=`0ca8af1f-8cfb-47a6-bd2d-baebc276cb21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:08,119::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:42:08,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:42:08,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:42:08,120::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:08,120::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:42:08,121::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:42:08,480::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:42:09,034::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:42:09,054::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022627 s, 18.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:09,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:09,481::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:42:09,671::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:42:09,689::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271226 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:42:09,693::task::579::TaskManager.Task::(_updateState) Task=`d02b5f17-7b8a-4548-9283-ddf8106e3676`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:42:09,693::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:42:09,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:42:09,693::task::1168::TaskManager.Task::(prepare) Task=`d02b5f17-7b8a-4548-9283-ddf8106e3676`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:42:09,694::task::579::TaskManager.Task::(_updateState) Task=`d02b5f17-7b8a-4548-9283-ddf8106e3676`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:42:09,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:42:09,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:42:09,694::task::974::TaskManager.Task::(_decref) Task=`d02b5f17-7b8a-4548-9283-ddf8106e3676`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:42:09,804::task::579::TaskManager.Task::(_updateState) Task=`b8f4f8c6-5fdb-48c7-a1cd-6828460c8916`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:42:09,804::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:42:09,805::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:42:09,805::task::1168::TaskManager.Task::(prepare) Task=`b8f4f8c6-5fdb-48c7-a1cd-6828460c8916`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:42:09,805::task::579::TaskManager.Task::(_updateState) Task=`b8f4f8c6-5fdb-48c7-a1cd-6828460c8916`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:42:09,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:42:09,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:42:09,806::task::974::TaskManager.Task::(_decref) Task=`b8f4f8c6-5fdb-48c7-a1cd-6828460c8916`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:42:09,999::task::579::TaskManager.Task::(_updateState) Task=`8f94d37a-4bc3-4ac5-9da0-2e4c0c140bde`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:42:09,999::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:42:09,999::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:42:09,999::task::1168::TaskManager.Task::(prepare) Task=`8f94d37a-4bc3-4ac5-9da0-2e4c0c140bde`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:42:10,000::task::579::TaskManager.Task::(_updateState) Task=`8f94d37a-4bc3-4ac5-9da0-2e4c0c140bde`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:42:10,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:42:10,000::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:42:10,000::task::974::TaskManager.Task::(_decref) Task=`8f94d37a-4bc3-4ac5-9da0-2e4c0c140bde`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:42:10,000::task::579::TaskManager.Task::(_updateState) Task=`d60890be-0393-47e4-a008-92ef50f5f315`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:42:10,001::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:42:10,001::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:42:10,001::task::1168::TaskManager.Task::(prepare) Task=`d60890be-0393-47e4-a008-92ef50f5f315`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:42:10,001::task::579::TaskManager.Task::(_updateState) Task=`d60890be-0393-47e4-a008-92ef50f5f315`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:42:10,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:42:10,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:42:10,002::task::974::TaskManager.Task::(_decref) Task=`d60890be-0393-47e4-a008-92ef50f5f315`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:10,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:42:10,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:42:10,123::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:10,483::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 16:42:11,025::task::579::TaskManager.Task::(_updateState) Task=`dae08d3b-8640-4e18-bc52-3270b0e3f699`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:42:11,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:42:11,026::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:42:11,026::task::1168::TaskManager.Task::(prepare) Task=`dae08d3b-8640-4e18-bc52-3270b0e3f699`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:42:11,026::task::579::TaskManager.Task::(_updateState) Task=`dae08d3b-8640-4e18-bc52-3270b0e3f699`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:42:11,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:42:11,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:42:11,027::task::974::TaskManager.Task::(_decref) Task=`dae08d3b-8640-4e18-bc52-3270b0e3f699`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:11,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:42:11,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:42:11,125::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:42:12,010::task::579::TaskManager.Task::(_updateState) Task=`2f363fd9-2851-44ba-abdc-a465a0ad2068`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:42:12,010::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:42:12,011::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:42:12,011::task::1168::TaskManager.Task::(prepare) Task=`2f363fd9-2851-44ba-abdc-a465a0ad2068`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:42:12,011::task::579::TaskManager.Task::(_updateState) Task=`2f363fd9-2851-44ba-abdc-a465a0ad2068`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:42:12,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:42:12,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:42:12,011::task::974::TaskManager.Task::(_decref) Task=`2f363fd9-2851-44ba-abdc-a465a0ad2068`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:12,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:42:12,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:42:12,126::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:42:12,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:12,484::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:13,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286958::DEBUG::2014-01-16 16:42:13,588::task::579::TaskManager.Task::(_updateState) Task=`6c2067e1-ac77-46ae-b1d1-591d04ce3bc4`::moving from state init -> state preparing >Thread-286958::INFO::2014-01-16 16:42:13,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286958::INFO::2014-01-16 16:42:13,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271226', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022627', 'lastCheck': '4.5', 'valid': True}} >Thread-286958::DEBUG::2014-01-16 16:42:13,589::task::1168::TaskManager.Task::(prepare) Task=`6c2067e1-ac77-46ae-b1d1-591d04ce3bc4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271226', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022627', 'lastCheck': '4.5', 'valid': True}} >Thread-286958::DEBUG::2014-01-16 16:42:13,589::task::579::TaskManager.Task::(_updateState) Task=`6c2067e1-ac77-46ae-b1d1-591d04ce3bc4`::moving from state preparing -> state finished >Thread-286958::DEBUG::2014-01-16 16:42:13,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286958::DEBUG::2014-01-16 16:42:13,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286958::DEBUG::2014-01-16 16:42:13,589::task::974::TaskManager.Task::(_decref) Task=`6c2067e1-ac77-46ae-b1d1-591d04ce3bc4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:14,127::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:42:14,127::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:14,485::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:14,486::task::579::TaskManager.Task::(_updateState) Task=`2e45794c-6f66-444b-9a24-0d21c5b09ee7`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:42:14,486::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:42:14,486::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:42:14,487::task::1168::TaskManager.Task::(prepare) Task=`2e45794c-6f66-444b-9a24-0d21c5b09ee7`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:42:14,487::task::579::TaskManager.Task::(_updateState) Task=`2e45794c-6f66-444b-9a24-0d21c5b09ee7`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:42:14,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:42:14,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:42:14,487::task::974::TaskManager.Task::(_decref) Task=`2e45794c-6f66-444b-9a24-0d21c5b09ee7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:42:14,489::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:42:14,489::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:42:14,490::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:14,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:14,492::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:15,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:42:15,223::task::579::TaskManager.Task::(_updateState) Task=`84e93597-aaaa-4d29-b906-b98a4a12a031`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:42:15,223::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:42:15,223::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:42:15,223::task::1168::TaskManager.Task::(prepare) Task=`84e93597-aaaa-4d29-b906-b98a4a12a031`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:42:15,224::task::579::TaskManager.Task::(_updateState) Task=`84e93597-aaaa-4d29-b906-b98a4a12a031`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:42:15,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:42:15,224::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:42:15,224::task::974::TaskManager.Task::(_decref) Task=`84e93597-aaaa-4d29-b906-b98a4a12a031`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:16,129::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:16,493::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:42:17,103::task::579::TaskManager.Task::(_updateState) Task=`a4f27d34-baaa-411d-bb01-46419d29dbf3`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:42:17,103::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:42:17,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:42:17,103::task::1168::TaskManager.Task::(prepare) Task=`a4f27d34-baaa-411d-bb01-46419d29dbf3`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:42:17,104::task::579::TaskManager.Task::(_updateState) Task=`a4f27d34-baaa-411d-bb01-46419d29dbf3`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:42:17,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:42:17,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:42:17,104::task::974::TaskManager.Task::(_decref) Task=`a4f27d34-baaa-411d-bb01-46419d29dbf3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:17,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:18,132::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:18,495::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:42:18,718::task::579::TaskManager.Task::(_updateState) Task=`c833a2cd-b698-4fbb-a1e0-2e5c283c0f32`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:42:18,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:42:18,719::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:42:18,719::task::1168::TaskManager.Task::(prepare) Task=`c833a2cd-b698-4fbb-a1e0-2e5c283c0f32`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:42:18,719::task::579::TaskManager.Task::(_updateState) Task=`c833a2cd-b698-4fbb-a1e0-2e5c283c0f32`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:42:18,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:42:18,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:42:18,720::task::974::TaskManager.Task::(_decref) Task=`c833a2cd-b698-4fbb-a1e0-2e5c283c0f32`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:42:19,061::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:42:19,080::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024244 s, 16.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:19,133::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:19,497::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:42:19,698::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:42:19,714::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000263378 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:20,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:42:20,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:20,498::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:21,135::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:22,137::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:22,500::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:23,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:24,139::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:24,501::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:24,502::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:25,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:42:25,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:42:25,141::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:42:25,214::task::579::TaskManager.Task::(_updateState) Task=`35b58cb7-b692-43d3-8a24-b88cd04a3d11`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:42:25,215::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:42:25,215::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:42:25,215::task::1168::TaskManager.Task::(prepare) Task=`35b58cb7-b692-43d3-8a24-b88cd04a3d11`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:42:25,215::task::579::TaskManager.Task::(_updateState) Task=`35b58cb7-b692-43d3-8a24-b88cd04a3d11`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:42:25,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:42:25,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:42:25,216::task::974::TaskManager.Task::(_decref) Task=`35b58cb7-b692-43d3-8a24-b88cd04a3d11`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:26,142::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:42:26,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:26,503::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:42:26,619::task::579::TaskManager.Task::(_updateState) Task=`90fd033e-1d9d-492a-a381-71467b44e39f`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:42:26,619::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:42:26,620::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:42:26,620::task::1168::TaskManager.Task::(prepare) Task=`90fd033e-1d9d-492a-a381-71467b44e39f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:42:26,620::task::579::TaskManager.Task::(_updateState) Task=`90fd033e-1d9d-492a-a381-71467b44e39f`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:42:26,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:42:26,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:42:26,620::task::974::TaskManager.Task::(_decref) Task=`90fd033e-1d9d-492a-a381-71467b44e39f`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:42:26,953::task::579::TaskManager.Task::(_updateState) Task=`a86bfba3-c783-4577-9f49-9270a55ce6a1`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:42:26,953::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:42:26,953::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:42:26,954::task::1168::TaskManager.Task::(prepare) Task=`a86bfba3-c783-4577-9f49-9270a55ce6a1`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:42:26,954::task::579::TaskManager.Task::(_updateState) Task=`a86bfba3-c783-4577-9f49-9270a55ce6a1`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:42:26,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:42:26,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:42:26,954::task::974::TaskManager.Task::(_decref) Task=`a86bfba3-c783-4577-9f49-9270a55ce6a1`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:42:26,954::task::579::TaskManager.Task::(_updateState) Task=`0c2b01e8-58c3-4f9c-a2d5-3ac604b40f60`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:42:26,954::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:42:26,955::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:42:26,955::task::1168::TaskManager.Task::(prepare) Task=`0c2b01e8-58c3-4f9c-a2d5-3ac604b40f60`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:42:26,955::task::579::TaskManager.Task::(_updateState) Task=`0c2b01e8-58c3-4f9c-a2d5-3ac604b40f60`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:42:26,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:42:26,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:42:26,955::task::974::TaskManager.Task::(_decref) Task=`0c2b01e8-58c3-4f9c-a2d5-3ac604b40f60`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:27,143::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:42:27,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:42:27,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:28,145::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:42:28,145::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:28,504::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:42:29,086::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:42:29,103::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000229802 s, 17.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:29,146::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:42:29,146::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286964::DEBUG::2014-01-16 16:42:29,296::task::579::TaskManager.Task::(_updateState) Task=`8a5090e5-44ee-4dd3-9189-61f058509774`::moving from state init -> state preparing >Thread-286964::INFO::2014-01-16 16:42:29,297::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286964::INFO::2014-01-16 16:42:29,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263378', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229802', 'lastCheck': '0.2', 'valid': True}} >Thread-286964::DEBUG::2014-01-16 16:42:29,297::task::1168::TaskManager.Task::(prepare) Task=`8a5090e5-44ee-4dd3-9189-61f058509774`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263378', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229802', 'lastCheck': '0.2', 'valid': True}} >Thread-286964::DEBUG::2014-01-16 16:42:29,297::task::579::TaskManager.Task::(_updateState) Task=`8a5090e5-44ee-4dd3-9189-61f058509774`::moving from state preparing -> state finished >Thread-286964::DEBUG::2014-01-16 16:42:29,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286964::DEBUG::2014-01-16 16:42:29,298::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286964::DEBUG::2014-01-16 16:42:29,298::task::974::TaskManager.Task::(_decref) Task=`8a5090e5-44ee-4dd3-9189-61f058509774`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:42:29,507::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:42:29,507::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:42:29,508::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:42:29,722::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:42:29,739::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000333363 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:30,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:42:30,266::task::579::TaskManager.Task::(_updateState) Task=`4878663d-a1d5-4efc-bb1b-6350c9b904be`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:42:30,267::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:42:30,267::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:42:30,267::task::1168::TaskManager.Task::(prepare) Task=`4878663d-a1d5-4efc-bb1b-6350c9b904be`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:42:30,268::task::579::TaskManager.Task::(_updateState) Task=`4878663d-a1d5-4efc-bb1b-6350c9b904be`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:42:30,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:42:30,269::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:42:30,269::task::579::TaskManager.Task::(_updateState) Task=`a9b63547-1020-4d5b-a52e-14aca9ccbd53`::moving from state init -> state preparing >Thread-3175::DEBUG::2014-01-16 16:42:30,270::task::974::TaskManager.Task::(_decref) Task=`4878663d-a1d5-4efc-bb1b-6350c9b904be`::ref 0 aborting False >Thread-59295::INFO::2014-01-16 16:42:30,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:42:30,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:42:30,271::task::1168::TaskManager.Task::(prepare) Task=`a9b63547-1020-4d5b-a52e-14aca9ccbd53`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:42:30,271::task::579::TaskManager.Task::(_updateState) Task=`a9b63547-1020-4d5b-a52e-14aca9ccbd53`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:42:30,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:42:30,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:42:30,272::task::974::TaskManager.Task::(_decref) Task=`a9b63547-1020-4d5b-a52e-14aca9ccbd53`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:42:30,510::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:31,148::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:42:31,149::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:32,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:42:32,150::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:32,511::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:33,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:42:33,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:42:33,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:42:33,152::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:34,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:42:34,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:42:34,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:34,513::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:34,514::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:35,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:42:35,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:42:35,290::task::579::TaskManager.Task::(_updateState) Task=`821fc6ae-eb6a-4f81-98e9-fe546c2db685`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:42:35,291::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:42:35,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:42:35,291::task::1168::TaskManager.Task::(prepare) Task=`821fc6ae-eb6a-4f81-98e9-fe546c2db685`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:42:35,291::task::579::TaskManager.Task::(_updateState) Task=`821fc6ae-eb6a-4f81-98e9-fe546c2db685`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:42:35,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:42:35,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:42:35,292::task::974::TaskManager.Task::(_decref) Task=`821fc6ae-eb6a-4f81-98e9-fe546c2db685`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:36,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:42:36,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:42:36,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:42:36,156::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:36,515::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:37,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:42:37,763::task::579::TaskManager.Task::(_updateState) Task=`35b6779b-0474-4cf2-b20f-e660843af976`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:42:37,763::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:42:37,763::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:42:37,763::task::1168::TaskManager.Task::(prepare) Task=`35b6779b-0474-4cf2-b20f-e660843af976`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:42:37,764::task::579::TaskManager.Task::(_updateState) Task=`35b6779b-0474-4cf2-b20f-e660843af976`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:42:37,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:42:37,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:42:37,764::task::974::TaskManager.Task::(_decref) Task=`35b6779b-0474-4cf2-b20f-e660843af976`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:38,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:42:38,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:42:38,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:42:38,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:38,158::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:42:38,158::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-16398::DEBUG::2014-01-16 16:42:38,506::task::579::TaskManager.Task::(_updateState) Task=`e03d391b-d9eb-4aed-9073-c8321308b7fd`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:42:38,506::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:42:38,507::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:42:38,507::task::1168::TaskManager.Task::(prepare) Task=`e03d391b-d9eb-4aed-9073-c8321308b7fd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:42:38,507::task::579::TaskManager.Task::(_updateState) Task=`e03d391b-d9eb-4aed-9073-c8321308b7fd`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:42:38,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:42:38,507::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:42:38,507::task::974::TaskManager.Task::(_decref) Task=`e03d391b-d9eb-4aed-9073-c8321308b7fd`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:42:38,508::task::579::TaskManager.Task::(_updateState) Task=`4fee7609-6e9d-4a1a-bb01-7442603ab0cd`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:42:38,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:42:38,509::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:42:38,509::task::1168::TaskManager.Task::(prepare) Task=`4fee7609-6e9d-4a1a-bb01-7442603ab0cd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:42:38,509::task::579::TaskManager.Task::(_updateState) Task=`4fee7609-6e9d-4a1a-bb01-7442603ab0cd`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:42:38,509::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:42:38,509::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:42:38,510::task::974::TaskManager.Task::(_decref) Task=`4fee7609-6e9d-4a1a-bb01-7442603ab0cd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:42:38,517::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-69607::DEBUG::2014-01-16 16:42:38,794::task::579::TaskManager.Task::(_updateState) Task=`bf975d77-d702-484f-8f79-bf767ad1f0ec`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:42:38,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:42:38,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:42:38,795::task::1168::TaskManager.Task::(prepare) Task=`bf975d77-d702-484f-8f79-bf767ad1f0ec`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:42:38,795::task::579::TaskManager.Task::(_updateState) Task=`bf975d77-d702-484f-8f79-bf767ad1f0ec`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:42:38,795::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:42:38,795::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:42:38,795::task::974::TaskManager.Task::(_decref) Task=`bf975d77-d702-484f-8f79-bf767ad1f0ec`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:42:39,109::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:42:39,126::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028106 s, 14.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:39,160::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:39,518::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:42:39,597::task::579::TaskManager.Task::(_updateState) Task=`747d2104-7ff9-49a0-89a0-8a5589384cb1`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:42:39,597::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:42:39,598::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:42:39,598::task::1168::TaskManager.Task::(prepare) Task=`747d2104-7ff9-49a0-89a0-8a5589384cb1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:42:39,598::task::579::TaskManager.Task::(_updateState) Task=`747d2104-7ff9-49a0-89a0-8a5589384cb1`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:42:39,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:42:39,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:42:39,598::task::974::TaskManager.Task::(_decref) Task=`747d2104-7ff9-49a0-89a0-8a5589384cb1`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:42:39,748::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:42:39,763::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272548 s, 1.3 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:42:39,787::task::579::TaskManager.Task::(_updateState) Task=`320a682c-2e12-4984-b096-b105b316a9d8`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:42:39,787::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:42:39,788::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:42:39,788::task::1168::TaskManager.Task::(prepare) Task=`320a682c-2e12-4984-b096-b105b316a9d8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:42:39,788::task::579::TaskManager.Task::(_updateState) Task=`320a682c-2e12-4984-b096-b105b316a9d8`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:42:39,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:42:39,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:42:39,789::task::974::TaskManager.Task::(_decref) Task=`320a682c-2e12-4984-b096-b105b316a9d8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:40,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:42:40,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:42:40,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:40,519::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:41,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:42:41,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:42:41,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:42,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:42:42,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:42:42,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:42:42,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:42,521::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:43,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:42:43,277::task::579::TaskManager.Task::(_updateState) Task=`4bcb6f51-9ea9-46ca-9938-d02a18e005b7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:42:43,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:42:43,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:42:43,278::task::1168::TaskManager.Task::(prepare) Task=`4bcb6f51-9ea9-46ca-9938-d02a18e005b7`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:42:43,278::task::579::TaskManager.Task::(_updateState) Task=`4bcb6f51-9ea9-46ca-9938-d02a18e005b7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:42:43,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:42:43,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:42:43,279::task::974::TaskManager.Task::(_decref) Task=`4bcb6f51-9ea9-46ca-9938-d02a18e005b7`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:42:43,279::task::579::TaskManager.Task::(_updateState) Task=`4363d105-6682-4e10-aaf0-43ef214098ed`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:42:43,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:42:43,280::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:42:43,280::task::1168::TaskManager.Task::(prepare) Task=`4363d105-6682-4e10-aaf0-43ef214098ed`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:42:43,280::task::579::TaskManager.Task::(_updateState) Task=`4363d105-6682-4e10-aaf0-43ef214098ed`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:42:43,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:42:43,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:42:43,280::task::974::TaskManager.Task::(_decref) Task=`4363d105-6682-4e10-aaf0-43ef214098ed`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:42:43,281::task::579::TaskManager.Task::(_updateState) Task=`faab26ee-e290-4e5e-8a27-d56b24743c1d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:42:43,281::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:42:43,281::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:42:43,281::task::1168::TaskManager.Task::(prepare) Task=`faab26ee-e290-4e5e-8a27-d56b24743c1d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:42:43,281::task::579::TaskManager.Task::(_updateState) Task=`faab26ee-e290-4e5e-8a27-d56b24743c1d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:42:43,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:42:43,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:42:43,282::task::974::TaskManager.Task::(_decref) Task=`faab26ee-e290-4e5e-8a27-d56b24743c1d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:44,167::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:42:44,167::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:44,522::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:44,524::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:42:44,524::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:42:44,526::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286970::DEBUG::2014-01-16 16:42:45,067::task::579::TaskManager.Task::(_updateState) Task=`f2905c7c-f704-455f-8ea0-5a1f08c8f646`::moving from state init -> state preparing >Thread-286970::INFO::2014-01-16 16:42:45,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286970::INFO::2014-01-16 16:42:45,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272548', 'lastCheck': '5.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028106', 'lastCheck': '5.9', 'valid': True}} >Thread-286970::DEBUG::2014-01-16 16:42:45,068::task::1168::TaskManager.Task::(prepare) Task=`f2905c7c-f704-455f-8ea0-5a1f08c8f646`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272548', 'lastCheck': '5.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028106', 'lastCheck': '5.9', 'valid': True}} >Thread-286970::DEBUG::2014-01-16 16:42:45,068::task::579::TaskManager.Task::(_updateState) Task=`f2905c7c-f704-455f-8ea0-5a1f08c8f646`::moving from state preparing -> state finished >Thread-286970::DEBUG::2014-01-16 16:42:45,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286970::DEBUG::2014-01-16 16:42:45,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286970::DEBUG::2014-01-16 16:42:45,068::task::974::TaskManager.Task::(_decref) Task=`f2905c7c-f704-455f-8ea0-5a1f08c8f646`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:45,168::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:46,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:46,527::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:47,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:42:47,456::task::579::TaskManager.Task::(_updateState) Task=`8af275f0-5435-42f6-9a37-35128b3b6b6e`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:42:47,456::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:42:47,456::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:42:47,456::task::1168::TaskManager.Task::(prepare) Task=`8af275f0-5435-42f6-9a37-35128b3b6b6e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:42:47,457::task::579::TaskManager.Task::(_updateState) Task=`8af275f0-5435-42f6-9a37-35128b3b6b6e`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:42:47,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:42:47,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:42:47,457::task::974::TaskManager.Task::(_decref) Task=`8af275f0-5435-42f6-9a37-35128b3b6b6e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:48,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:48,528::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:42:49,132::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:42:49,149::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000312397 s, 13.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:49,173::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:49,530::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:42:49,771::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:42:49,787::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292001 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:50,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:42:50,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:50,531::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:51,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:42:52,122::task::579::TaskManager.Task::(_updateState) Task=`d9b22bba-61ec-4ed7-88cf-3b5884a62b14`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:42:52,122::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:42:52,123::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:42:52,123::task::1168::TaskManager.Task::(prepare) Task=`d9b22bba-61ec-4ed7-88cf-3b5884a62b14`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:42:52,123::task::579::TaskManager.Task::(_updateState) Task=`d9b22bba-61ec-4ed7-88cf-3b5884a62b14`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:42:52,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:42:52,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:42:52,124::task::974::TaskManager.Task::(_decref) Task=`d9b22bba-61ec-4ed7-88cf-3b5884a62b14`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:42:52,176::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:52,533::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:53,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:54,179::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:54,534::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:42:54,535::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:55,180::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:42:55,180::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:42:55,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:56,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:42:56,182::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:56,536::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:42:57,183::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:42:57,183::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:42:57,183::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:42:58,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:42:58,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:58,538::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:42:58,835::task::579::TaskManager.Task::(_updateState) Task=`09c4aa29-48b1-4906-bb43-20fbc717815c`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:42:58,835::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:42:58,835::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:42:58,835::task::1168::TaskManager.Task::(prepare) Task=`09c4aa29-48b1-4906-bb43-20fbc717815c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:42:58,835::task::579::TaskManager.Task::(_updateState) Task=`09c4aa29-48b1-4906-bb43-20fbc717815c`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:42:58,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:42:58,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:42:58,836::task::974::TaskManager.Task::(_decref) Task=`09c4aa29-48b1-4906-bb43-20fbc717815c`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:42:59,154::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:42:59,171::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000285492 s, 14.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:42:59,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:42:59,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:42:59,540::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:42:59,541::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:42:59,542::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:42:59,796::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:42:59,813::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000294631 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:43:00,188::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:00,544::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286976::DEBUG::2014-01-16 16:43:00,818::task::579::TaskManager.Task::(_updateState) Task=`6115c415-fdd2-47c8-b126-1cfe87701550`::moving from state init -> state preparing >Thread-286976::INFO::2014-01-16 16:43:00,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286976::INFO::2014-01-16 16:43:00,819::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294631', 'lastCheck': '1.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285492', 'lastCheck': '1.6', 'valid': True}} >Thread-286976::DEBUG::2014-01-16 16:43:00,819::task::1168::TaskManager.Task::(prepare) Task=`6115c415-fdd2-47c8-b126-1cfe87701550`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294631', 'lastCheck': '1.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285492', 'lastCheck': '1.6', 'valid': True}} >Thread-286976::DEBUG::2014-01-16 16:43:00,819::task::579::TaskManager.Task::(_updateState) Task=`6115c415-fdd2-47c8-b126-1cfe87701550`::moving from state preparing -> state finished >Thread-286976::DEBUG::2014-01-16 16:43:00,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286976::DEBUG::2014-01-16 16:43:00,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286976::DEBUG::2014-01-16 16:43:00,820::task::974::TaskManager.Task::(_decref) Task=`6115c415-fdd2-47c8-b126-1cfe87701550`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:01,189::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:43:01,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:02,190::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:43:02,190::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:02,545::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:03,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:43:03,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:43:03,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:43:03,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:04,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:43:04,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:43:04,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:43:04,218::task::579::TaskManager.Task::(_updateState) Task=`c3b3cddd-78df-40a8-98e4-27ddca490929`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:43:04,219::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:43:04,219::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:43:04,219::task::1168::TaskManager.Task::(prepare) Task=`c3b3cddd-78df-40a8-98e4-27ddca490929`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:43:04,219::task::579::TaskManager.Task::(_updateState) Task=`c3b3cddd-78df-40a8-98e4-27ddca490929`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:43:04,219::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:43:04,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:43:04,220::task::974::TaskManager.Task::(_decref) Task=`c3b3cddd-78df-40a8-98e4-27ddca490929`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:43:04,220::task::579::TaskManager.Task::(_updateState) Task=`41fe4cfa-17dc-47ac-898b-70bd0b1ecaa6`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:43:04,220::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:43:04,221::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:43:04,221::task::1168::TaskManager.Task::(prepare) Task=`41fe4cfa-17dc-47ac-898b-70bd0b1ecaa6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:43:04,221::task::579::TaskManager.Task::(_updateState) Task=`41fe4cfa-17dc-47ac-898b-70bd0b1ecaa6`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:43:04,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:43:04,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:43:04,221::task::974::TaskManager.Task::(_decref) Task=`41fe4cfa-17dc-47ac-898b-70bd0b1ecaa6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:43:04,547::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:04,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:43:05,189::task::579::TaskManager.Task::(_updateState) Task=`fc8b3c92-25e5-4f2a-9752-d04871bf43ce`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:43:05,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:43:05,189::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:43:05,189::task::1168::TaskManager.Task::(prepare) Task=`fc8b3c92-25e5-4f2a-9752-d04871bf43ce`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:43:05,190::task::579::TaskManager.Task::(_updateState) Task=`fc8b3c92-25e5-4f2a-9752-d04871bf43ce`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:43:05,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:43:05,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:43:05,190::task::974::TaskManager.Task::(_decref) Task=`fc8b3c92-25e5-4f2a-9752-d04871bf43ce`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:43:05,190::task::579::TaskManager.Task::(_updateState) Task=`92f8eb21-ff92-45bd-be8e-0bb6b3a3522b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:43:05,190::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:43:05,191::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:43:05,191::task::1168::TaskManager.Task::(prepare) Task=`92f8eb21-ff92-45bd-be8e-0bb6b3a3522b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:43:05,191::task::579::TaskManager.Task::(_updateState) Task=`92f8eb21-ff92-45bd-be8e-0bb6b3a3522b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:43:05,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:43:05,191::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:43:05,191::task::974::TaskManager.Task::(_decref) Task=`92f8eb21-ff92-45bd-be8e-0bb6b3a3522b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:43:05,192::task::579::TaskManager.Task::(_updateState) Task=`bf36e470-59cf-4323-b57e-487d455000b1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:43:05,192::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:43:05,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:43:05,192::task::1168::TaskManager.Task::(prepare) Task=`bf36e470-59cf-4323-b57e-487d455000b1`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:43:05,192::task::579::TaskManager.Task::(_updateState) Task=`bf36e470-59cf-4323-b57e-487d455000b1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:43:05,192::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:43:05,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:43:05,193::task::974::TaskManager.Task::(_decref) Task=`bf36e470-59cf-4323-b57e-487d455000b1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:05,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:43:05,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:43:05,761::task::579::TaskManager.Task::(_updateState) Task=`f80f3188-b547-4ed1-842a-c94baf1d19c7`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:43:05,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:43:05,762::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:43:05,762::task::1168::TaskManager.Task::(prepare) Task=`f80f3188-b547-4ed1-842a-c94baf1d19c7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:43:05,762::task::579::TaskManager.Task::(_updateState) Task=`f80f3188-b547-4ed1-842a-c94baf1d19c7`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:43:05,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:43:05,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:43:05,763::task::974::TaskManager.Task::(_decref) Task=`f80f3188-b547-4ed1-842a-c94baf1d19c7`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:43:05,817::task::579::TaskManager.Task::(_updateState) Task=`660c3a49-1b8d-42a1-9aa0-857d9582beb6`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:43:05,817::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:43:05,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:43:05,818::task::1168::TaskManager.Task::(prepare) Task=`660c3a49-1b8d-42a1-9aa0-857d9582beb6`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:43:05,818::task::579::TaskManager.Task::(_updateState) Task=`660c3a49-1b8d-42a1-9aa0-857d9582beb6`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:43:05,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:43:05,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:43:05,818::task::974::TaskManager.Task::(_decref) Task=`660c3a49-1b8d-42a1-9aa0-857d9582beb6`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:43:05,826::task::579::TaskManager.Task::(_updateState) Task=`205a141d-fabd-43a5-814d-3d8547aedcc8`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:43:05,826::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:43:05,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:43:05,827::task::1168::TaskManager.Task::(prepare) Task=`205a141d-fabd-43a5-814d-3d8547aedcc8`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:43:05,827::task::579::TaskManager.Task::(_updateState) Task=`205a141d-fabd-43a5-814d-3d8547aedcc8`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:43:05,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:43:05,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:43:05,827::task::974::TaskManager.Task::(_decref) Task=`205a141d-fabd-43a5-814d-3d8547aedcc8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:06,195::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:43:06,195::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:43:06,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:43:06,196::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:06,549::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:07,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:43:07,362::task::579::TaskManager.Task::(_updateState) Task=`14f61679-127a-484b-a392-5298cf381c0b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:43:07,362::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:43:07,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:43:07,364::task::1168::TaskManager.Task::(prepare) Task=`14f61679-127a-484b-a392-5298cf381c0b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:43:07,364::task::579::TaskManager.Task::(_updateState) Task=`14f61679-127a-484b-a392-5298cf381c0b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:43:07,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:43:07,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:43:07,364::task::974::TaskManager.Task::(_decref) Task=`14f61679-127a-484b-a392-5298cf381c0b`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:43:07,365::task::579::TaskManager.Task::(_updateState) Task=`7518c468-3e99-4fcb-8512-3bc6cfcd66ee`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:43:07,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:43:07,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:43:07,365::task::1168::TaskManager.Task::(prepare) Task=`7518c468-3e99-4fcb-8512-3bc6cfcd66ee`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:43:07,365::task::579::TaskManager.Task::(_updateState) Task=`7518c468-3e99-4fcb-8512-3bc6cfcd66ee`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:43:07,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:43:07,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:43:07,366::task::974::TaskManager.Task::(_decref) Task=`7518c468-3e99-4fcb-8512-3bc6cfcd66ee`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:08,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:43:08,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:43:08,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:43:08,198::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:08,198::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:43:08,199::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:43:08,551::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:43:09,176::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:43:09,193::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000444306 s, 9.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:43:09,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:09,552::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:43:09,824::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:43:09,840::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274695 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:43:09,853::task::579::TaskManager.Task::(_updateState) Task=`a1afd35a-0af2-4e1f-9e53-fb4b9d776d72`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:43:09,853::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:43:09,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:43:09,854::task::1168::TaskManager.Task::(prepare) Task=`a1afd35a-0af2-4e1f-9e53-fb4b9d776d72`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:43:09,854::task::579::TaskManager.Task::(_updateState) Task=`a1afd35a-0af2-4e1f-9e53-fb4b9d776d72`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:43:09,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:43:09,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:43:09,854::task::974::TaskManager.Task::(_decref) Task=`a1afd35a-0af2-4e1f-9e53-fb4b9d776d72`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:43:09,969::task::579::TaskManager.Task::(_updateState) Task=`ebad7e1c-70c2-489f-a5d9-672d4654e521`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:43:09,969::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:43:09,969::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:43:09,969::task::1168::TaskManager.Task::(prepare) Task=`ebad7e1c-70c2-489f-a5d9-672d4654e521`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:43:09,969::task::579::TaskManager.Task::(_updateState) Task=`ebad7e1c-70c2-489f-a5d9-672d4654e521`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:43:09,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:43:09,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:43:09,970::task::974::TaskManager.Task::(_decref) Task=`ebad7e1c-70c2-489f-a5d9-672d4654e521`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:10,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:43:10,201::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:43:10,201::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:43:10,230::task::579::TaskManager.Task::(_updateState) Task=`91a649e4-98a3-4e3a-9653-997190136cd3`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:43:10,231::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:43:10,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:43:10,231::task::1168::TaskManager.Task::(prepare) Task=`91a649e4-98a3-4e3a-9653-997190136cd3`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:43:10,231::task::579::TaskManager.Task::(_updateState) Task=`91a649e4-98a3-4e3a-9653-997190136cd3`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:43:10,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:43:10,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:43:10,232::task::974::TaskManager.Task::(_decref) Task=`91a649e4-98a3-4e3a-9653-997190136cd3`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:43:10,232::task::579::TaskManager.Task::(_updateState) Task=`b63c9388-b498-4140-a967-be331d8ef263`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:43:10,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:43:10,233::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:43:10,233::task::1168::TaskManager.Task::(prepare) Task=`b63c9388-b498-4140-a967-be331d8ef263`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:43:10,233::task::579::TaskManager.Task::(_updateState) Task=`b63c9388-b498-4140-a967-be331d8ef263`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:43:10,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:43:10,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:43:10,233::task::974::TaskManager.Task::(_decref) Task=`b63c9388-b498-4140-a967-be331d8ef263`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:43:10,554::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:11,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:43:11,203::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:43:11,203::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:43:11,214::task::579::TaskManager.Task::(_updateState) Task=`486fa923-bcb2-49b0-bf15-7b3cf0005d18`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:43:11,214::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:43:11,215::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:43:11,215::task::1168::TaskManager.Task::(prepare) Task=`486fa923-bcb2-49b0-bf15-7b3cf0005d18`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:43:11,215::task::579::TaskManager.Task::(_updateState) Task=`486fa923-bcb2-49b0-bf15-7b3cf0005d18`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:43:11,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:43:11,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:43:11,215::task::974::TaskManager.Task::(_decref) Task=`486fa923-bcb2-49b0-bf15-7b3cf0005d18`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 16:43:12,187::task::579::TaskManager.Task::(_updateState) Task=`fa0b967d-8d67-4eb2-bb88-80e3b358e7bc`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:43:12,187::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:43:12,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:43:12,188::task::1168::TaskManager.Task::(prepare) Task=`fa0b967d-8d67-4eb2-bb88-80e3b358e7bc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:43:12,188::task::579::TaskManager.Task::(_updateState) Task=`fa0b967d-8d67-4eb2-bb88-80e3b358e7bc`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:43:12,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:43:12,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:43:12,188::task::974::TaskManager.Task::(_decref) Task=`fa0b967d-8d67-4eb2-bb88-80e3b358e7bc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:12,203::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:43:12,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:43:12,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:43:12,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:12,555::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:13,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:14,205::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:43:14,206::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:14,556::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:14,557::task::579::TaskManager.Task::(_updateState) Task=`0ca06ef7-8755-47a1-88fe-993f6f03578f`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:43:14,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:43:14,557::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:43:14,558::task::1168::TaskManager.Task::(prepare) Task=`0ca06ef7-8755-47a1-88fe-993f6f03578f`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:43:14,558::task::579::TaskManager.Task::(_updateState) Task=`0ca06ef7-8755-47a1-88fe-993f6f03578f`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:43:14,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:43:14,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:43:14,558::task::974::TaskManager.Task::(_decref) Task=`0ca06ef7-8755-47a1-88fe-993f6f03578f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:43:14,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:43:14,560::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:43:14,561::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:14,563::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:14,564::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:15,206::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:43:15,402::task::579::TaskManager.Task::(_updateState) Task=`0771af99-4108-40fe-b474-f87a00aa8e46`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:43:15,402::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:43:15,403::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:43:15,403::task::1168::TaskManager.Task::(prepare) Task=`0771af99-4108-40fe-b474-f87a00aa8e46`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:43:15,403::task::579::TaskManager.Task::(_updateState) Task=`0771af99-4108-40fe-b474-f87a00aa8e46`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:43:15,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:43:15,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:43:15,403::task::974::TaskManager.Task::(_decref) Task=`0771af99-4108-40fe-b474-f87a00aa8e46`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:16,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:16,565::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286982::DEBUG::2014-01-16 16:43:16,784::task::579::TaskManager.Task::(_updateState) Task=`d05dab33-a24d-490c-9e3e-ecbf1efceff4`::moving from state init -> state preparing >Thread-286982::INFO::2014-01-16 16:43:16,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286982::INFO::2014-01-16 16:43:16,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274695', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444306', 'lastCheck': '7.6', 'valid': True}} >Thread-286982::DEBUG::2014-01-16 16:43:16,785::task::1168::TaskManager.Task::(prepare) Task=`d05dab33-a24d-490c-9e3e-ecbf1efceff4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274695', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444306', 'lastCheck': '7.6', 'valid': True}} >Thread-286982::DEBUG::2014-01-16 16:43:16,785::task::579::TaskManager.Task::(_updateState) Task=`d05dab33-a24d-490c-9e3e-ecbf1efceff4`::moving from state preparing -> state finished >Thread-286982::DEBUG::2014-01-16 16:43:16,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286982::DEBUG::2014-01-16 16:43:16,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286982::DEBUG::2014-01-16 16:43:16,786::task::974::TaskManager.Task::(_decref) Task=`d05dab33-a24d-490c-9e3e-ecbf1efceff4`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:43:17,195::task::579::TaskManager.Task::(_updateState) Task=`577b4765-48ea-49ca-939c-88156da613fe`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:43:17,195::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:43:17,196::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:43:17,196::task::1168::TaskManager.Task::(prepare) Task=`577b4765-48ea-49ca-939c-88156da613fe`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:43:17,196::task::579::TaskManager.Task::(_updateState) Task=`577b4765-48ea-49ca-939c-88156da613fe`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:43:17,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:43:17,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:43:17,197::task::974::TaskManager.Task::(_decref) Task=`577b4765-48ea-49ca-939c-88156da613fe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:17,208::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:18,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:18,567::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:43:18,891::task::579::TaskManager.Task::(_updateState) Task=`3ab88edf-f9d0-40dc-970c-4b7a6838f438`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:43:18,892::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:43:18,892::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:43:18,892::task::1168::TaskManager.Task::(prepare) Task=`3ab88edf-f9d0-40dc-970c-4b7a6838f438`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:43:18,892::task::579::TaskManager.Task::(_updateState) Task=`3ab88edf-f9d0-40dc-970c-4b7a6838f438`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:43:18,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:43:18,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:43:18,893::task::974::TaskManager.Task::(_decref) Task=`3ab88edf-f9d0-40dc-970c-4b7a6838f438`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:43:19,198::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:43:19,212::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:43:19,215::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024146 s, 17.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:43:19,568::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:43:19,847::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:43:19,864::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289536 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:43:20,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:43:20,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:20,570::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:21,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:22,218::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:22,571::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:23,219::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:24,220::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:24,572::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:24,573::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:25,221::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:43:25,221::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:43:25,222::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:43:25,278::task::579::TaskManager.Task::(_updateState) Task=`ee8211f3-28fd-4285-81f2-82c5db6af5d3`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:43:25,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:43:25,279::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:43:25,279::task::1168::TaskManager.Task::(prepare) Task=`ee8211f3-28fd-4285-81f2-82c5db6af5d3`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:43:25,279::task::579::TaskManager.Task::(_updateState) Task=`ee8211f3-28fd-4285-81f2-82c5db6af5d3`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:43:25,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:43:25,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:43:25,280::task::974::TaskManager.Task::(_decref) Task=`ee8211f3-28fd-4285-81f2-82c5db6af5d3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:26,223::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:43:26,223::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:26,575::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:43:26,798::task::579::TaskManager.Task::(_updateState) Task=`282ca9d4-3d6d-4c2e-80c6-6a3b9e3cbb3b`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:43:26,798::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:43:26,799::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:43:26,799::task::1168::TaskManager.Task::(prepare) Task=`282ca9d4-3d6d-4c2e-80c6-6a3b9e3cbb3b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:43:26,799::task::579::TaskManager.Task::(_updateState) Task=`282ca9d4-3d6d-4c2e-80c6-6a3b9e3cbb3b`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:43:26,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:43:26,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:43:26,799::task::974::TaskManager.Task::(_decref) Task=`282ca9d4-3d6d-4c2e-80c6-6a3b9e3cbb3b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:27,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:43:27,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:43:27,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:43:27,332::task::579::TaskManager.Task::(_updateState) Task=`f0dffcf8-46cc-4719-a128-9c4f8b1f57b8`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:43:27,332::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:43:27,332::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:43:27,332::task::1168::TaskManager.Task::(prepare) Task=`f0dffcf8-46cc-4719-a128-9c4f8b1f57b8`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:43:27,333::task::579::TaskManager.Task::(_updateState) Task=`f0dffcf8-46cc-4719-a128-9c4f8b1f57b8`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:43:27,333::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:43:27,333::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:43:27,333::task::974::TaskManager.Task::(_decref) Task=`f0dffcf8-46cc-4719-a128-9c4f8b1f57b8`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:43:27,333::task::579::TaskManager.Task::(_updateState) Task=`b75f1a57-a210-4f03-8981-928a292e8eb3`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:43:27,333::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:43:27,334::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:43:27,334::task::1168::TaskManager.Task::(prepare) Task=`b75f1a57-a210-4f03-8981-928a292e8eb3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:43:27,334::task::579::TaskManager.Task::(_updateState) Task=`b75f1a57-a210-4f03-8981-928a292e8eb3`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:43:27,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:43:27,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:43:27,334::task::974::TaskManager.Task::(_decref) Task=`b75f1a57-a210-4f03-8981-928a292e8eb3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:28,225::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:43:28,226::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:28,576::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:43:29,221::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:43:29,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:43:29,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:43:29,243::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000300808 s, 13.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:43:29,579::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:43:29,580::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:43:29,587::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:43:29,874::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:43:29,891::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000295742 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:43:30,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:43:30,485::task::579::TaskManager.Task::(_updateState) Task=`77d9f76b-1e98-468b-99b5-ac6211c42fa8`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:43:30,485::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:43:30,485::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:43:30,486::task::1168::TaskManager.Task::(prepare) Task=`77d9f76b-1e98-468b-99b5-ac6211c42fa8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:43:30,486::task::579::TaskManager.Task::(_updateState) Task=`77d9f76b-1e98-468b-99b5-ac6211c42fa8`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:43:30,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:43:30,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:43:30,486::task::974::TaskManager.Task::(_decref) Task=`77d9f76b-1e98-468b-99b5-ac6211c42fa8`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:43:30,489::task::579::TaskManager.Task::(_updateState) Task=`021a28db-4aaf-47e3-a93b-9b3c4e0eb767`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:43:30,489::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:43:30,489::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:43:30,489::task::1168::TaskManager.Task::(prepare) Task=`021a28db-4aaf-47e3-a93b-9b3c4e0eb767`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:43:30,490::task::579::TaskManager.Task::(_updateState) Task=`021a28db-4aaf-47e3-a93b-9b3c4e0eb767`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:43:30,490::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:43:30,490::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:43:30,490::task::974::TaskManager.Task::(_decref) Task=`021a28db-4aaf-47e3-a93b-9b3c4e0eb767`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:43:30,589::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:31,244::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:43:31,244::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:32,246::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:43:32,246::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-286988::DEBUG::2014-01-16 16:43:32,535::task::579::TaskManager.Task::(_updateState) Task=`e9301a10-95ef-414d-bec2-78b7dddfb959`::moving from state init -> state preparing >Thread-286988::INFO::2014-01-16 16:43:32,536::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286988::INFO::2014-01-16 16:43:32,536::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295742', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300808', 'lastCheck': '3.3', 'valid': True}} >Thread-286988::DEBUG::2014-01-16 16:43:32,536::task::1168::TaskManager.Task::(prepare) Task=`e9301a10-95ef-414d-bec2-78b7dddfb959`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295742', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300808', 'lastCheck': '3.3', 'valid': True}} >Thread-286988::DEBUG::2014-01-16 16:43:32,536::task::579::TaskManager.Task::(_updateState) Task=`e9301a10-95ef-414d-bec2-78b7dddfb959`::moving from state preparing -> state finished >Thread-286988::DEBUG::2014-01-16 16:43:32,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286988::DEBUG::2014-01-16 16:43:32,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286988::DEBUG::2014-01-16 16:43:32,537::task::974::TaskManager.Task::(_decref) Task=`e9301a10-95ef-414d-bec2-78b7dddfb959`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:43:32,590::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:33,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:43:33,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:43:33,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:43:33,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:34,250::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:43:34,250::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:43:34,250::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:34,591::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:34,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:35,252::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:43:35,252::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:43:35,465::task::579::TaskManager.Task::(_updateState) Task=`ecf4589b-f85e-4a9f-900a-54de1220f318`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:43:35,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:43:35,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:43:35,466::task::1168::TaskManager.Task::(prepare) Task=`ecf4589b-f85e-4a9f-900a-54de1220f318`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:43:35,466::task::579::TaskManager.Task::(_updateState) Task=`ecf4589b-f85e-4a9f-900a-54de1220f318`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:43:35,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:43:35,466::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:43:35,467::task::974::TaskManager.Task::(_decref) Task=`ecf4589b-f85e-4a9f-900a-54de1220f318`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:36,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:43:36,254::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:43:36,254::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:43:36,254::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:36,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:37,255::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:43:37,936::task::579::TaskManager.Task::(_updateState) Task=`4607da37-82bd-4ab2-ad9c-dfc7f5555233`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:43:37,936::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:43:37,937::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:43:37,937::task::1168::TaskManager.Task::(prepare) Task=`4607da37-82bd-4ab2-ad9c-dfc7f5555233`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:43:37,937::task::579::TaskManager.Task::(_updateState) Task=`4607da37-82bd-4ab2-ad9c-dfc7f5555233`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:43:37,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:43:37,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:43:37,938::task::974::TaskManager.Task::(_decref) Task=`4607da37-82bd-4ab2-ad9c-dfc7f5555233`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:38,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:43:38,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:43:38,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:43:38,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:38,257::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:43:38,258::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:43:38,595::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:43:38,718::task::579::TaskManager.Task::(_updateState) Task=`8ac844e2-fef9-4225-95bd-c39f1a0b263c`::moving from state init -> state preparing >Thread-16398::DEBUG::2014-01-16 16:43:38,719::task::579::TaskManager.Task::(_updateState) Task=`446ce61d-9bc4-4ca6-8de5-8c3e47fc5baa`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:43:38,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16398::INFO::2014-01-16 16:43:38,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16393::INFO::2014-01-16 16:43:38,720::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::INFO::2014-01-16 16:43:38,720::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:43:38,720::task::1168::TaskManager.Task::(prepare) Task=`8ac844e2-fef9-4225-95bd-c39f1a0b263c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:43:38,721::task::1168::TaskManager.Task::(prepare) Task=`446ce61d-9bc4-4ca6-8de5-8c3e47fc5baa`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:43:38,721::task::579::TaskManager.Task::(_updateState) Task=`8ac844e2-fef9-4225-95bd-c39f1a0b263c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:43:38,721::task::579::TaskManager.Task::(_updateState) Task=`446ce61d-9bc4-4ca6-8de5-8c3e47fc5baa`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:43:38,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:43:38,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:43:38,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:43:38,722::task::974::TaskManager.Task::(_decref) Task=`8ac844e2-fef9-4225-95bd-c39f1a0b263c`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:43:38,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:43:38,722::task::974::TaskManager.Task::(_decref) Task=`446ce61d-9bc4-4ca6-8de5-8c3e47fc5baa`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:43:38,968::task::579::TaskManager.Task::(_updateState) Task=`383c0cac-04fd-477d-b1ca-4e6215f5fbde`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:43:38,968::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:43:38,969::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:43:38,969::task::1168::TaskManager.Task::(prepare) Task=`383c0cac-04fd-477d-b1ca-4e6215f5fbde`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:43:38,969::task::579::TaskManager.Task::(_updateState) Task=`383c0cac-04fd-477d-b1ca-4e6215f5fbde`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:43:38,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:43:38,969::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:43:38,969::task::974::TaskManager.Task::(_decref) Task=`383c0cac-04fd-477d-b1ca-4e6215f5fbde`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:43:39,254::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:43:39,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:43:39,271::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00020338 s, 20.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:43:39,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:43:39,769::task::579::TaskManager.Task::(_updateState) Task=`2c5d726d-5bd6-45c0-9f31-a0eceaaf61ab`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:43:39,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:43:39,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:43:39,770::task::1168::TaskManager.Task::(prepare) Task=`2c5d726d-5bd6-45c0-9f31-a0eceaaf61ab`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:43:39,770::task::579::TaskManager.Task::(_updateState) Task=`2c5d726d-5bd6-45c0-9f31-a0eceaaf61ab`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:43:39,770::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:43:39,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:43:39,770::task::974::TaskManager.Task::(_decref) Task=`2c5d726d-5bd6-45c0-9f31-a0eceaaf61ab`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:43:39,901::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:43:39,920::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002481 s, 1.5 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:43:39,947::task::579::TaskManager.Task::(_updateState) Task=`15ca2f48-c385-4d71-aed6-11e985c66b81`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:43:39,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:43:39,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:43:39,948::task::1168::TaskManager.Task::(prepare) Task=`15ca2f48-c385-4d71-aed6-11e985c66b81`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:43:39,948::task::579::TaskManager.Task::(_updateState) Task=`15ca2f48-c385-4d71-aed6-11e985c66b81`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:43:39,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:43:39,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:43:39,948::task::974::TaskManager.Task::(_decref) Task=`15ca2f48-c385-4d71-aed6-11e985c66b81`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:40,271::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:43:40,271::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:43:40,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:40,598::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:41,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:43:41,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:43:41,273::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:42,274::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:43:42,275::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:43:42,275::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:43:42,275::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:42,599::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:43,276::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:43:43,556::task::579::TaskManager.Task::(_updateState) Task=`c9596afb-afe3-4027-bc37-232da3c5a13d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:43:43,556::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:43:43,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:43:43,556::task::1168::TaskManager.Task::(prepare) Task=`c9596afb-afe3-4027-bc37-232da3c5a13d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:43:43,557::task::579::TaskManager.Task::(_updateState) Task=`c9596afb-afe3-4027-bc37-232da3c5a13d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:43:43,557::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:43:43,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:43:43,557::task::974::TaskManager.Task::(_decref) Task=`c9596afb-afe3-4027-bc37-232da3c5a13d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:43:43,557::task::579::TaskManager.Task::(_updateState) Task=`f6cfe217-f08d-4113-8b54-a42866689354`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:43:43,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:43:43,558::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:43:43,558::task::1168::TaskManager.Task::(prepare) Task=`f6cfe217-f08d-4113-8b54-a42866689354`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:43:43,558::task::579::TaskManager.Task::(_updateState) Task=`f6cfe217-f08d-4113-8b54-a42866689354`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:43:43,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:43:43,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:43:43,558::task::974::TaskManager.Task::(_decref) Task=`f6cfe217-f08d-4113-8b54-a42866689354`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:43:43,559::task::579::TaskManager.Task::(_updateState) Task=`91807cc2-e7a5-444c-b3af-28ff08e88c54`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:43:43,559::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:43:43,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:43:43,559::task::1168::TaskManager.Task::(prepare) Task=`91807cc2-e7a5-444c-b3af-28ff08e88c54`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:43:43,559::task::579::TaskManager.Task::(_updateState) Task=`91807cc2-e7a5-444c-b3af-28ff08e88c54`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:43:43,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:43:43,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:43:43,560::task::974::TaskManager.Task::(_decref) Task=`91807cc2-e7a5-444c-b3af-28ff08e88c54`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:44,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:43:44,278::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:44,600::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:44,602::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:43:44,602::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:43:44,603::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:45,279::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:46,280::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:46,605::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:47,282::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:43:47,624::task::579::TaskManager.Task::(_updateState) Task=`499a54ba-8923-41ab-89cc-b299eca21bee`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:43:47,625::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:43:47,625::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:43:47,625::task::1168::TaskManager.Task::(prepare) Task=`499a54ba-8923-41ab-89cc-b299eca21bee`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:43:47,625::task::579::TaskManager.Task::(_updateState) Task=`499a54ba-8923-41ab-89cc-b299eca21bee`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:43:47,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:43:47,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:43:47,626::task::974::TaskManager.Task::(_decref) Task=`499a54ba-8923-41ab-89cc-b299eca21bee`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:43:48,283::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:48,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-286994::DEBUG::2014-01-16 16:43:48,844::task::579::TaskManager.Task::(_updateState) Task=`40cd2fbb-4c15-4f7a-be0f-4e9556b2ed05`::moving from state init -> state preparing >Thread-286994::INFO::2014-01-16 16:43:48,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-286994::INFO::2014-01-16 16:43:48,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002481', 'lastCheck': '8.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020338', 'lastCheck': '9.6', 'valid': True}} >Thread-286994::DEBUG::2014-01-16 16:43:48,844::task::1168::TaskManager.Task::(prepare) Task=`40cd2fbb-4c15-4f7a-be0f-4e9556b2ed05`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002481', 'lastCheck': '8.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020338', 'lastCheck': '9.6', 'valid': True}} >Thread-286994::DEBUG::2014-01-16 16:43:48,844::task::579::TaskManager.Task::(_updateState) Task=`40cd2fbb-4c15-4f7a-be0f-4e9556b2ed05`::moving from state preparing -> state finished >Thread-286994::DEBUG::2014-01-16 16:43:48,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-286994::DEBUG::2014-01-16 16:43:48,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-286994::DEBUG::2014-01-16 16:43:48,845::task::974::TaskManager.Task::(_decref) Task=`40cd2fbb-4c15-4f7a-be0f-4e9556b2ed05`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:43:49,277::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:43:49,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:43:49,294::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000234276 s, 17.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:43:49,607::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:43:49,928::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:43:49,944::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276367 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:43:50,294::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:43:50,294::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:50,608::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:51,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:52,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:43:52,329::task::579::TaskManager.Task::(_updateState) Task=`54fcbda1-88f8-4fb7-bfd7-3b5f87b70960`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:43:52,330::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:43:52,330::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:43:52,330::task::1168::TaskManager.Task::(prepare) Task=`54fcbda1-88f8-4fb7-bfd7-3b5f87b70960`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:43:52,331::task::579::TaskManager.Task::(_updateState) Task=`54fcbda1-88f8-4fb7-bfd7-3b5f87b70960`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:43:52,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:43:52,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:43:52,331::task::974::TaskManager.Task::(_decref) Task=`54fcbda1-88f8-4fb7-bfd7-3b5f87b70960`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:43:52,610::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:53,297::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:54,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:54,611::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:43:54,612::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:55,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:43:55,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:43:55,301::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:56,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:43:56,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:56,614::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:43:57,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:43:57,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:43:57,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:43:58,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:43:58,305::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:43:58,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:43:59,002::task::579::TaskManager.Task::(_updateState) Task=`f188891a-8298-45be-8772-30eea6f45457`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:43:59,002::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:43:59,002::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:43:59,003::task::1168::TaskManager.Task::(prepare) Task=`f188891a-8298-45be-8772-30eea6f45457`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:43:59,003::task::579::TaskManager.Task::(_updateState) Task=`f188891a-8298-45be-8772-30eea6f45457`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:43:59,003::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:43:59,003::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:43:59,003::task::974::TaskManager.Task::(_decref) Task=`f188891a-8298-45be-8772-30eea6f45457`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:43:59,300::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:43:59,315::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:43:59,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:43:59,318::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000238285 s, 17.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:43:59,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:43:59,618::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:43:59,619::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:43:59,953::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:43:59,969::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273139 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:44:00,318::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:00,621::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:01,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:44:01,319::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:02,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:44:02,321::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:02,622::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:03,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:44:03,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:44:03,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:44:03,323::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:04,324::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:44:04,325::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:44:04,325::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:44:04,451::task::579::TaskManager.Task::(_updateState) Task=`8b3d1df9-9656-4144-9aa4-d3abdc1030ac`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:44:04,451::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:44:04,452::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:44:04,452::task::1168::TaskManager.Task::(prepare) Task=`8b3d1df9-9656-4144-9aa4-d3abdc1030ac`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:44:04,452::task::579::TaskManager.Task::(_updateState) Task=`8b3d1df9-9656-4144-9aa4-d3abdc1030ac`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:44:04,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:44:04,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:44:04,452::task::974::TaskManager.Task::(_decref) Task=`8b3d1df9-9656-4144-9aa4-d3abdc1030ac`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:44:04,453::task::579::TaskManager.Task::(_updateState) Task=`24288fbe-0917-416d-b029-8a9bc1d54328`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:44:04,453::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:44:04,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:44:04,453::task::1168::TaskManager.Task::(prepare) Task=`24288fbe-0917-416d-b029-8a9bc1d54328`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:44:04,454::task::579::TaskManager.Task::(_updateState) Task=`24288fbe-0917-416d-b029-8a9bc1d54328`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:44:04,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:44:04,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:44:04,454::task::974::TaskManager.Task::(_decref) Task=`24288fbe-0917-416d-b029-8a9bc1d54328`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:04,623::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:04,624::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287000::DEBUG::2014-01-16 16:44:04,816::task::579::TaskManager.Task::(_updateState) Task=`2cca5d2a-cf05-456f-b065-1e7c5b80c266`::moving from state init -> state preparing >Thread-287000::INFO::2014-01-16 16:44:04,816::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287000::INFO::2014-01-16 16:44:04,816::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273139', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238285', 'lastCheck': '5.5', 'valid': True}} >Thread-287000::DEBUG::2014-01-16 16:44:04,816::task::1168::TaskManager.Task::(prepare) Task=`2cca5d2a-cf05-456f-b065-1e7c5b80c266`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273139', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238285', 'lastCheck': '5.5', 'valid': True}} >Thread-287000::DEBUG::2014-01-16 16:44:04,816::task::579::TaskManager.Task::(_updateState) Task=`2cca5d2a-cf05-456f-b065-1e7c5b80c266`::moving from state preparing -> state finished >Thread-287000::DEBUG::2014-01-16 16:44:04,817::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287000::DEBUG::2014-01-16 16:44:04,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287000::DEBUG::2014-01-16 16:44:04,817::task::974::TaskManager.Task::(_decref) Task=`2cca5d2a-cf05-456f-b065-1e7c5b80c266`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:05,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:44:05,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:44:05,767::task::579::TaskManager.Task::(_updateState) Task=`ab994ad1-61c4-4cfd-ad32-0be003cafcb2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:44:05,768::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:44:05,768::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:44:05,768::task::1168::TaskManager.Task::(prepare) Task=`ab994ad1-61c4-4cfd-ad32-0be003cafcb2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:44:05,768::task::579::TaskManager.Task::(_updateState) Task=`ab994ad1-61c4-4cfd-ad32-0be003cafcb2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:44:05,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:44:05,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:44:05,769::task::974::TaskManager.Task::(_decref) Task=`ab994ad1-61c4-4cfd-ad32-0be003cafcb2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:44:05,769::task::579::TaskManager.Task::(_updateState) Task=`489fafde-0abc-4c93-8685-0a4e275432f7`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:44:05,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:44:05,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:44:05,770::task::1168::TaskManager.Task::(prepare) Task=`489fafde-0abc-4c93-8685-0a4e275432f7`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:44:05,770::task::579::TaskManager.Task::(_updateState) Task=`489fafde-0abc-4c93-8685-0a4e275432f7`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:44:05,770::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:44:05,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:44:05,770::task::974::TaskManager.Task::(_decref) Task=`489fafde-0abc-4c93-8685-0a4e275432f7`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:44:05,770::task::579::TaskManager.Task::(_updateState) Task=`2f3e3d9e-d6ac-4d7d-a6d6-b052b072e751`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:44:05,770::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:44:05,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:44:05,771::task::1168::TaskManager.Task::(prepare) Task=`2f3e3d9e-d6ac-4d7d-a6d6-b052b072e751`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:44:05,771::task::579::TaskManager.Task::(_updateState) Task=`2f3e3d9e-d6ac-4d7d-a6d6-b052b072e751`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:44:05,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:44:05,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:44:05,771::task::974::TaskManager.Task::(_decref) Task=`2f3e3d9e-d6ac-4d7d-a6d6-b052b072e751`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:44:05,892::task::579::TaskManager.Task::(_updateState) Task=`7db201b7-1bd3-4ec0-9e70-4bd27dd8f1de`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:44:05,892::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:44:05,893::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:44:05,894::task::1168::TaskManager.Task::(prepare) Task=`7db201b7-1bd3-4ec0-9e70-4bd27dd8f1de`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:44:05,894::task::579::TaskManager.Task::(_updateState) Task=`7db201b7-1bd3-4ec0-9e70-4bd27dd8f1de`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:44:05,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:44:05,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:44:05,894::task::974::TaskManager.Task::(_decref) Task=`7db201b7-1bd3-4ec0-9e70-4bd27dd8f1de`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:44:05,909::task::579::TaskManager.Task::(_updateState) Task=`dd888146-18f7-47ee-8325-20513fabc752`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:44:05,909::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:44:05,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:44:05,910::task::1168::TaskManager.Task::(prepare) Task=`dd888146-18f7-47ee-8325-20513fabc752`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:44:05,910::task::579::TaskManager.Task::(_updateState) Task=`dd888146-18f7-47ee-8325-20513fabc752`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:44:05,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:44:05,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:44:05,910::task::974::TaskManager.Task::(_decref) Task=`dd888146-18f7-47ee-8325-20513fabc752`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:44:05,937::task::579::TaskManager.Task::(_updateState) Task=`76d1ad5b-445d-432a-b6bd-a6694af337ca`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:44:05,937::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:44:05,938::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:44:05,938::task::1168::TaskManager.Task::(prepare) Task=`76d1ad5b-445d-432a-b6bd-a6694af337ca`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:44:05,938::task::579::TaskManager.Task::(_updateState) Task=`76d1ad5b-445d-432a-b6bd-a6694af337ca`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:44:05,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:44:05,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:44:05,938::task::974::TaskManager.Task::(_decref) Task=`76d1ad5b-445d-432a-b6bd-a6694af337ca`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:06,328::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:44:06,328::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:44:06,328::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:44:06,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:06,625::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:07,329::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:44:07,454::task::579::TaskManager.Task::(_updateState) Task=`72070392-5528-4307-8393-795e1856d48c`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:44:07,454::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:44:07,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:44:07,455::task::1168::TaskManager.Task::(prepare) Task=`72070392-5528-4307-8393-795e1856d48c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:44:07,455::task::579::TaskManager.Task::(_updateState) Task=`72070392-5528-4307-8393-795e1856d48c`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:44:07,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:44:07,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:44:07,455::task::974::TaskManager.Task::(_decref) Task=`72070392-5528-4307-8393-795e1856d48c`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:44:07,456::task::579::TaskManager.Task::(_updateState) Task=`cce1ff91-f034-4709-ba9c-3099da256f34`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:44:07,456::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:44:07,456::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:44:07,456::task::1168::TaskManager.Task::(prepare) Task=`cce1ff91-f034-4709-ba9c-3099da256f34`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:44:07,456::task::579::TaskManager.Task::(_updateState) Task=`cce1ff91-f034-4709-ba9c-3099da256f34`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:44:07,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:44:07,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:44:07,457::task::974::TaskManager.Task::(_decref) Task=`cce1ff91-f034-4709-ba9c-3099da256f34`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:08,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:44:08,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:44:08,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:44:08,331::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:08,331::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:44:08,333::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:44:08,627::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:44:09,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:44:09,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:44:09,343::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241174 s, 17.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:44:09,629::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:44:09,980::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:44:09,997::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00033053 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:44:10,000::task::579::TaskManager.Task::(_updateState) Task=`13a547d9-ac93-46ce-9dd9-d58d37974ef9`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:44:10,001::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:44:10,001::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:44:10,001::task::1168::TaskManager.Task::(prepare) Task=`13a547d9-ac93-46ce-9dd9-d58d37974ef9`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:44:10,002::task::579::TaskManager.Task::(_updateState) Task=`13a547d9-ac93-46ce-9dd9-d58d37974ef9`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:44:10,002::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:44:10,002::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:44:10,002::task::974::TaskManager.Task::(_decref) Task=`13a547d9-ac93-46ce-9dd9-d58d37974ef9`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:44:10,139::task::579::TaskManager.Task::(_updateState) Task=`a60efaf0-33ac-445d-a246-abb1d1fffb92`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:44:10,139::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:44:10,140::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:44:10,140::task::1168::TaskManager.Task::(prepare) Task=`a60efaf0-33ac-445d-a246-abb1d1fffb92`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:44:10,140::task::579::TaskManager.Task::(_updateState) Task=`a60efaf0-33ac-445d-a246-abb1d1fffb92`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:44:10,140::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:44:10,140::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:44:10,140::task::974::TaskManager.Task::(_decref) Task=`a60efaf0-33ac-445d-a246-abb1d1fffb92`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:10,343::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:44:10,343::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:44:10,343::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:44:10,450::task::579::TaskManager.Task::(_updateState) Task=`4742c0c6-72cb-4ce4-b6d1-3bc5c418b67f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:44:10,451::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:44:10,451::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:44:10,451::task::1168::TaskManager.Task::(prepare) Task=`4742c0c6-72cb-4ce4-b6d1-3bc5c418b67f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:44:10,451::task::579::TaskManager.Task::(_updateState) Task=`4742c0c6-72cb-4ce4-b6d1-3bc5c418b67f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:44:10,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:44:10,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:44:10,452::task::974::TaskManager.Task::(_decref) Task=`4742c0c6-72cb-4ce4-b6d1-3bc5c418b67f`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:44:10,452::task::579::TaskManager.Task::(_updateState) Task=`915336c0-c8ce-465c-900d-341679b3a451`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:44:10,452::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:44:10,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:44:10,453::task::1168::TaskManager.Task::(prepare) Task=`915336c0-c8ce-465c-900d-341679b3a451`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:44:10,453::task::579::TaskManager.Task::(_updateState) Task=`915336c0-c8ce-465c-900d-341679b3a451`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:44:10,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:44:10,453::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:44:10,453::task::974::TaskManager.Task::(_decref) Task=`915336c0-c8ce-465c-900d-341679b3a451`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:10,630::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:11,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:44:11,345::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:44:11,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:44:11,393::task::579::TaskManager.Task::(_updateState) Task=`94829160-0f76-4892-be54-018e900213b1`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:44:11,393::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:44:11,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:44:11,394::task::1168::TaskManager.Task::(prepare) Task=`94829160-0f76-4892-be54-018e900213b1`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:44:11,394::task::579::TaskManager.Task::(_updateState) Task=`94829160-0f76-4892-be54-018e900213b1`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:44:11,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:44:11,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:44:11,394::task::974::TaskManager.Task::(_decref) Task=`94829160-0f76-4892-be54-018e900213b1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:12,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:44:12,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:44:12,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:44:12,347::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:44:12,371::task::579::TaskManager.Task::(_updateState) Task=`37ad9235-44fa-4518-a382-4aa5aac6e448`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:44:12,371::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:44:12,372::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:44:12,372::task::1168::TaskManager.Task::(prepare) Task=`37ad9235-44fa-4518-a382-4aa5aac6e448`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:44:12,372::task::579::TaskManager.Task::(_updateState) Task=`37ad9235-44fa-4518-a382-4aa5aac6e448`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:44:12,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:44:12,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:44:12,372::task::974::TaskManager.Task::(_decref) Task=`37ad9235-44fa-4518-a382-4aa5aac6e448`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:12,631::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:13,348::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:14,349::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:44:14,350::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:14,633::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:14,633::task::579::TaskManager.Task::(_updateState) Task=`06dba5c7-6982-48e3-8b1f-54ba1472cfd6`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:44:14,633::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:44:14,634::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:44:14,634::task::1168::TaskManager.Task::(prepare) Task=`06dba5c7-6982-48e3-8b1f-54ba1472cfd6`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:44:14,634::task::579::TaskManager.Task::(_updateState) Task=`06dba5c7-6982-48e3-8b1f-54ba1472cfd6`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:44:14,634::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:44:14,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:44:14,634::task::974::TaskManager.Task::(_decref) Task=`06dba5c7-6982-48e3-8b1f-54ba1472cfd6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:14,636::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:44:14,636::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:44:14,638::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:14,640::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:14,641::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:15,351::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:44:15,594::task::579::TaskManager.Task::(_updateState) Task=`9100f7f6-c866-4f2b-bd44-e81afed291dd`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:44:15,594::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:44:15,595::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:44:15,595::task::1168::TaskManager.Task::(prepare) Task=`9100f7f6-c866-4f2b-bd44-e81afed291dd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:44:15,595::task::579::TaskManager.Task::(_updateState) Task=`9100f7f6-c866-4f2b-bd44-e81afed291dd`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:44:15,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:44:15,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:44:15,595::task::974::TaskManager.Task::(_decref) Task=`9100f7f6-c866-4f2b-bd44-e81afed291dd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:16,351::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:16,642::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:44:17,278::task::579::TaskManager.Task::(_updateState) Task=`d3fec9ff-5837-451f-ad0b-afc39e49e0f7`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:44:17,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:44:17,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:44:17,278::task::1168::TaskManager.Task::(prepare) Task=`d3fec9ff-5837-451f-ad0b-afc39e49e0f7`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:44:17,279::task::579::TaskManager.Task::(_updateState) Task=`d3fec9ff-5837-451f-ad0b-afc39e49e0f7`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:44:17,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:44:17,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:44:17,279::task::974::TaskManager.Task::(_decref) Task=`d3fec9ff-5837-451f-ad0b-afc39e49e0f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:17,353::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:18,354::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:18,644::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:44:19,065::task::579::TaskManager.Task::(_updateState) Task=`dad6b642-c24c-4b82-a744-3176d8faa429`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:44:19,066::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:44:19,066::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:44:19,066::task::1168::TaskManager.Task::(prepare) Task=`dad6b642-c24c-4b82-a744-3176d8faa429`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:44:19,066::task::579::TaskManager.Task::(_updateState) Task=`dad6b642-c24c-4b82-a744-3176d8faa429`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:44:19,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:44:19,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:44:19,067::task::974::TaskManager.Task::(_decref) Task=`dad6b642-c24c-4b82-a744-3176d8faa429`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:44:19,349::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:44:19,366::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:44:19,369::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304945 s, 13.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:44:19,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:44:20,005::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:44:20,022::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271127 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:44:20,368::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:44:20,369::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287006::DEBUG::2014-01-16 16:44:20,641::task::579::TaskManager.Task::(_updateState) Task=`5119cc54-3d8b-40bf-898c-866e97fce458`::moving from state init -> state preparing >Thread-287006::INFO::2014-01-16 16:44:20,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287006::INFO::2014-01-16 16:44:20,642::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271127', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304945', 'lastCheck': '1.3', 'valid': True}} >Thread-287006::DEBUG::2014-01-16 16:44:20,642::task::1168::TaskManager.Task::(prepare) Task=`5119cc54-3d8b-40bf-898c-866e97fce458`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271127', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304945', 'lastCheck': '1.3', 'valid': True}} >Thread-287006::DEBUG::2014-01-16 16:44:20,642::task::579::TaskManager.Task::(_updateState) Task=`5119cc54-3d8b-40bf-898c-866e97fce458`::moving from state preparing -> state finished >Thread-287006::DEBUG::2014-01-16 16:44:20,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287006::DEBUG::2014-01-16 16:44:20,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287006::DEBUG::2014-01-16 16:44:20,643::task::974::TaskManager.Task::(_decref) Task=`5119cc54-3d8b-40bf-898c-866e97fce458`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:20,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:21,370::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:22,371::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:22,649::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:23,372::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:24,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:24,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:24,652::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:44:25,349::task::579::TaskManager.Task::(_updateState) Task=`b5227b87-dfff-48fa-99bc-9011a68f71cd`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:44:25,350::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:44:25,350::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:44:25,350::task::1168::TaskManager.Task::(prepare) Task=`b5227b87-dfff-48fa-99bc-9011a68f71cd`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:44:25,350::task::579::TaskManager.Task::(_updateState) Task=`b5227b87-dfff-48fa-99bc-9011a68f71cd`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:44:25,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:44:25,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:44:25,351::task::974::TaskManager.Task::(_decref) Task=`b5227b87-dfff-48fa-99bc-9011a68f71cd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:25,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:44:25,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:44:25,374::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:26,375::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:44:26,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:26,653::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:44:26,964::task::579::TaskManager.Task::(_updateState) Task=`1a78b2bd-466a-45a8-8384-6281003b139a`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:44:26,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:44:26,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:44:26,965::task::1168::TaskManager.Task::(prepare) Task=`1a78b2bd-466a-45a8-8384-6281003b139a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:44:26,965::task::579::TaskManager.Task::(_updateState) Task=`1a78b2bd-466a-45a8-8384-6281003b139a`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:44:26,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:44:26,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:44:26,965::task::974::TaskManager.Task::(_decref) Task=`1a78b2bd-466a-45a8-8384-6281003b139a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:27,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:44:27,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:44:27,377::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:44:27,695::task::579::TaskManager.Task::(_updateState) Task=`d671fc14-c15f-4849-82f8-0e0b77d0b570`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:44:27,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:44:27,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:44:27,696::task::1168::TaskManager.Task::(prepare) Task=`d671fc14-c15f-4849-82f8-0e0b77d0b570`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:44:27,696::task::579::TaskManager.Task::(_updateState) Task=`d671fc14-c15f-4849-82f8-0e0b77d0b570`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:44:27,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:44:27,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:44:27,696::task::974::TaskManager.Task::(_decref) Task=`d671fc14-c15f-4849-82f8-0e0b77d0b570`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:44:27,697::task::579::TaskManager.Task::(_updateState) Task=`ebdbfb5c-7565-4f24-8eff-5fbd311f50a1`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:44:27,697::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:44:27,697::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:44:27,697::task::1168::TaskManager.Task::(prepare) Task=`ebdbfb5c-7565-4f24-8eff-5fbd311f50a1`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:44:27,697::task::579::TaskManager.Task::(_updateState) Task=`ebdbfb5c-7565-4f24-8eff-5fbd311f50a1`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:44:27,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:44:27,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:44:27,698::task::974::TaskManager.Task::(_decref) Task=`ebdbfb5c-7565-4f24-8eff-5fbd311f50a1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:28,378::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:44:28,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:28,654::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:44:29,374::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:44:29,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:44:29,392::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:44:29,394::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000247118 s, 16.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:44:29,656::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:44:29,657::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:44:29,658::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:44:30,030::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:44:30,048::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000282243 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:44:30,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:44:30,650::task::579::TaskManager.Task::(_updateState) Task=`c67ff474-9963-4ab5-92d6-0d233b8b07da`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:44:30,650::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:44:30,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:44:30,651::task::1168::TaskManager.Task::(prepare) Task=`c67ff474-9963-4ab5-92d6-0d233b8b07da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:44:30,651::task::579::TaskManager.Task::(_updateState) Task=`c67ff474-9963-4ab5-92d6-0d233b8b07da`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:44:30,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:44:30,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:44:30,652::task::974::TaskManager.Task::(_decref) Task=`c67ff474-9963-4ab5-92d6-0d233b8b07da`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:44:30,659::task::579::TaskManager.Task::(_updateState) Task=`b3ada3ca-4cf0-4088-a775-5090f3a21866`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:44:30,660::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:44:30,660::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:44:30,660::task::1168::TaskManager.Task::(prepare) Task=`b3ada3ca-4cf0-4088-a775-5090f3a21866`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:44:30,661::task::579::TaskManager.Task::(_updateState) Task=`b3ada3ca-4cf0-4088-a775-5090f3a21866`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:44:30,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:44:30,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:44:30,661::task::974::TaskManager.Task::(_decref) Task=`b3ada3ca-4cf0-4088-a775-5090f3a21866`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:30,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:31,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:44:31,395::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:32,396::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:44:32,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:32,664::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:33,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:44:33,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:44:33,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:44:33,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:34,399::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:44:34,399::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:44:34,399::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:34,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:34,666::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:35,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:44:35,401::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:44:35,643::task::579::TaskManager.Task::(_updateState) Task=`de2932c9-65d1-491b-9796-417b06ee7dbb`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:44:35,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:44:35,644::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:44:35,644::task::1168::TaskManager.Task::(prepare) Task=`de2932c9-65d1-491b-9796-417b06ee7dbb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:44:35,644::task::579::TaskManager.Task::(_updateState) Task=`de2932c9-65d1-491b-9796-417b06ee7dbb`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:44:35,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:44:35,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:44:35,644::task::974::TaskManager.Task::(_decref) Task=`de2932c9-65d1-491b-9796-417b06ee7dbb`::ref 0 aborting False >Thread-287012::DEBUG::2014-01-16 16:44:36,344::task::579::TaskManager.Task::(_updateState) Task=`0a256040-c351-4fc0-9906-2b5a5ce574ce`::moving from state init -> state preparing >Thread-287012::INFO::2014-01-16 16:44:36,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287012::INFO::2014-01-16 16:44:36,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282243', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000247118', 'lastCheck': '6.9', 'valid': True}} >Thread-287012::DEBUG::2014-01-16 16:44:36,345::task::1168::TaskManager.Task::(prepare) Task=`0a256040-c351-4fc0-9906-2b5a5ce574ce`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282243', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000247118', 'lastCheck': '6.9', 'valid': True}} >Thread-287012::DEBUG::2014-01-16 16:44:36,345::task::579::TaskManager.Task::(_updateState) Task=`0a256040-c351-4fc0-9906-2b5a5ce574ce`::moving from state preparing -> state finished >Thread-287012::DEBUG::2014-01-16 16:44:36,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287012::DEBUG::2014-01-16 16:44:36,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287012::DEBUG::2014-01-16 16:44:36,346::task::974::TaskManager.Task::(_decref) Task=`0a256040-c351-4fc0-9906-2b5a5ce574ce`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:36,401::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:44:36,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:44:36,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:44:36,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:36,667::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:37,404::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:44:38,106::task::579::TaskManager.Task::(_updateState) Task=`be0a66be-b2f7-42e0-ab28-d45f51846314`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:44:38,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:44:38,107::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:44:38,107::task::1168::TaskManager.Task::(prepare) Task=`be0a66be-b2f7-42e0-ab28-d45f51846314`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:44:38,107::task::579::TaskManager.Task::(_updateState) Task=`be0a66be-b2f7-42e0-ab28-d45f51846314`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:44:38,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:44:38,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:44:38,108::task::974::TaskManager.Task::(_decref) Task=`be0a66be-b2f7-42e0-ab28-d45f51846314`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:38,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:44:38,406::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:44:38,406::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:44:38,406::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:38,406::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:44:38,406::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:44:38,669::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 16:44:38,920::task::579::TaskManager.Task::(_updateState) Task=`13d833d5-3d5c-4bf7-9a53-2d36d4240b3e`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:44:38,920::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:44:38,921::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:44:38,921::task::1168::TaskManager.Task::(prepare) Task=`13d833d5-3d5c-4bf7-9a53-2d36d4240b3e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:44:38,921::task::579::TaskManager.Task::(_updateState) Task=`13d833d5-3d5c-4bf7-9a53-2d36d4240b3e`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:44:38,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:44:38,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:44:38,922::task::974::TaskManager.Task::(_decref) Task=`13d833d5-3d5c-4bf7-9a53-2d36d4240b3e`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:44:38,923::task::579::TaskManager.Task::(_updateState) Task=`e2088814-c42a-481a-8b1d-83e896964fc6`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:44:38,923::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:44:38,924::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:44:38,924::task::1168::TaskManager.Task::(prepare) Task=`e2088814-c42a-481a-8b1d-83e896964fc6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:44:38,924::task::579::TaskManager.Task::(_updateState) Task=`e2088814-c42a-481a-8b1d-83e896964fc6`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:44:38,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:44:38,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:44:38,924::task::974::TaskManager.Task::(_decref) Task=`e2088814-c42a-481a-8b1d-83e896964fc6`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:44:39,138::task::579::TaskManager.Task::(_updateState) Task=`5e2e135a-ccaf-4b3e-a19b-610752872eea`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:44:39,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:44:39,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:44:39,138::task::1168::TaskManager.Task::(prepare) Task=`5e2e135a-ccaf-4b3e-a19b-610752872eea`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:44:39,138::task::579::TaskManager.Task::(_updateState) Task=`5e2e135a-ccaf-4b3e-a19b-610752872eea`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:44:39,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:44:39,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:44:39,139::task::974::TaskManager.Task::(_decref) Task=`5e2e135a-ccaf-4b3e-a19b-610752872eea`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:44:39,399::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:44:39,413::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:44:39,416::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000232852 s, 17.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:44:39,670::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:44:39,926::task::579::TaskManager.Task::(_updateState) Task=`3cb29e27-eea5-4caf-9eab-5d6bc96348d4`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:44:39,927::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:44:39,927::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:44:39,927::task::1168::TaskManager.Task::(prepare) Task=`3cb29e27-eea5-4caf-9eab-5d6bc96348d4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:44:39,928::task::579::TaskManager.Task::(_updateState) Task=`3cb29e27-eea5-4caf-9eab-5d6bc96348d4`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:44:39,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:44:39,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:44:39,928::task::974::TaskManager.Task::(_decref) Task=`3cb29e27-eea5-4caf-9eab-5d6bc96348d4`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:44:40,056::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:44:40,073::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00031557 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:44:40,115::task::579::TaskManager.Task::(_updateState) Task=`2e01aa27-edd5-4cfb-8896-cf4ce50c300f`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:44:40,115::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:44:40,116::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:44:40,116::task::1168::TaskManager.Task::(prepare) Task=`2e01aa27-edd5-4cfb-8896-cf4ce50c300f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:44:40,116::task::579::TaskManager.Task::(_updateState) Task=`2e01aa27-edd5-4cfb-8896-cf4ce50c300f`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:44:40,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:44:40,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:44:40,117::task::974::TaskManager.Task::(_decref) Task=`2e01aa27-edd5-4cfb-8896-cf4ce50c300f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:40,415::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:44:40,416::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:44:40,416::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:40,672::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:41,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:44:41,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:44:41,417::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:42,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:44:42,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:44:42,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:44:42,419::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:42,673::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:43,420::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:44:43,826::task::579::TaskManager.Task::(_updateState) Task=`01d54631-a765-487f-a20c-3b19226c9e83`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:44:43,826::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:44:43,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:44:43,826::task::1168::TaskManager.Task::(prepare) Task=`01d54631-a765-487f-a20c-3b19226c9e83`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:44:43,827::task::579::TaskManager.Task::(_updateState) Task=`01d54631-a765-487f-a20c-3b19226c9e83`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:44:43,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:44:43,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:44:43,827::task::974::TaskManager.Task::(_decref) Task=`01d54631-a765-487f-a20c-3b19226c9e83`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:44:43,827::task::579::TaskManager.Task::(_updateState) Task=`682ae23e-bfa1-4d0c-98f9-0d0318039020`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:44:43,828::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:44:43,828::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:44:43,828::task::1168::TaskManager.Task::(prepare) Task=`682ae23e-bfa1-4d0c-98f9-0d0318039020`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:44:43,828::task::579::TaskManager.Task::(_updateState) Task=`682ae23e-bfa1-4d0c-98f9-0d0318039020`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:44:43,828::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:44:43,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:44:43,829::task::974::TaskManager.Task::(_decref) Task=`682ae23e-bfa1-4d0c-98f9-0d0318039020`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:44:43,829::task::579::TaskManager.Task::(_updateState) Task=`ed5aaddd-2921-4fb3-9cc3-51008f887ac5`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:44:43,829::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:44:43,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:44:43,830::task::1168::TaskManager.Task::(prepare) Task=`ed5aaddd-2921-4fb3-9cc3-51008f887ac5`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:44:43,830::task::579::TaskManager.Task::(_updateState) Task=`ed5aaddd-2921-4fb3-9cc3-51008f887ac5`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:44:43,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:44:43,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:44:43,831::task::974::TaskManager.Task::(_decref) Task=`ed5aaddd-2921-4fb3-9cc3-51008f887ac5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:44,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:44:44,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:44,675::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:44,677::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:44:44,677::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:44:44,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:45,423::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:46,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:46,680::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:47,426::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:44:47,789::task::579::TaskManager.Task::(_updateState) Task=`4e72c892-a891-4e46-9a26-6b69d6ce36c8`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:44:47,789::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:44:47,789::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:44:47,790::task::1168::TaskManager.Task::(prepare) Task=`4e72c892-a891-4e46-9a26-6b69d6ce36c8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:44:47,790::task::579::TaskManager.Task::(_updateState) Task=`4e72c892-a891-4e46-9a26-6b69d6ce36c8`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:44:47,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:44:47,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:44:47,790::task::974::TaskManager.Task::(_decref) Task=`4e72c892-a891-4e46-9a26-6b69d6ce36c8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:48,427::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:48,681::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:44:49,421::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:44:49,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:44:49,441::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000229807 s, 17.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:44:49,683::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:44:50,080::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:44:50,097::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000283176 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:44:50,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:44:50,441::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:50,684::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:51,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287018::DEBUG::2014-01-16 16:44:52,134::task::579::TaskManager.Task::(_updateState) Task=`b957f98d-ce15-4b36-a1c4-8a478990ed6e`::moving from state init -> state preparing >Thread-287018::INFO::2014-01-16 16:44:52,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287018::INFO::2014-01-16 16:44:52,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283176', 'lastCheck': '2.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229807', 'lastCheck': '2.7', 'valid': True}} >Thread-287018::DEBUG::2014-01-16 16:44:52,135::task::1168::TaskManager.Task::(prepare) Task=`b957f98d-ce15-4b36-a1c4-8a478990ed6e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283176', 'lastCheck': '2.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229807', 'lastCheck': '2.7', 'valid': True}} >Thread-287018::DEBUG::2014-01-16 16:44:52,135::task::579::TaskManager.Task::(_updateState) Task=`b957f98d-ce15-4b36-a1c4-8a478990ed6e`::moving from state preparing -> state finished >Thread-287018::DEBUG::2014-01-16 16:44:52,135::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287018::DEBUG::2014-01-16 16:44:52,135::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287018::DEBUG::2014-01-16 16:44:52,135::task::974::TaskManager.Task::(_decref) Task=`b957f98d-ce15-4b36-a1c4-8a478990ed6e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:44:52,443::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:44:52,504::task::579::TaskManager.Task::(_updateState) Task=`68d5252f-a856-4a94-8220-84c1ed2bb372`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:44:52,504::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:44:52,505::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:44:52,505::task::1168::TaskManager.Task::(prepare) Task=`68d5252f-a856-4a94-8220-84c1ed2bb372`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:44:52,505::task::579::TaskManager.Task::(_updateState) Task=`68d5252f-a856-4a94-8220-84c1ed2bb372`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:44:52,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:44:52,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:44:52,505::task::974::TaskManager.Task::(_decref) Task=`68d5252f-a856-4a94-8220-84c1ed2bb372`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:44:52,686::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:53,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:54,445::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:54,687::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:44:54,688::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:55,446::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:44:55,446::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:44:55,447::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:56,447::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:44:56,448::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:56,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:44:57,449::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:44:57,449::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:44:57,449::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:44:58,450::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:44:58,450::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:44:58,691::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:44:59,163::task::579::TaskManager.Task::(_updateState) Task=`c95ddf8c-5c61-4ec3-8614-dc0c1647a4f0`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:44:59,164::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:44:59,164::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:44:59,164::task::1168::TaskManager.Task::(prepare) Task=`c95ddf8c-5c61-4ec3-8614-dc0c1647a4f0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:44:59,164::task::579::TaskManager.Task::(_updateState) Task=`c95ddf8c-5c61-4ec3-8614-dc0c1647a4f0`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:44:59,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:44:59,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:44:59,165::task::974::TaskManager.Task::(_decref) Task=`c95ddf8c-5c61-4ec3-8614-dc0c1647a4f0`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:44:59,446::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:44:59,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:44:59,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:44:59,463::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00025062 s, 16.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:44:59,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:44:59,693::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:44:59,695::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:45:00,105::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:45:00,123::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000320241 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:45:00,463::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:00,696::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:01,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:45:01,464::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:02,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:45:02,465::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:02,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:03,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:45:03,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:45:03,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:45:03,466::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:04,467::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:45:04,468::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:45:04,468::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:45:04,677::task::579::TaskManager.Task::(_updateState) Task=`4abedc00-ee93-4a38-9178-1c9783a700be`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:45:04,677::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:45:04,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:45:04,677::task::1168::TaskManager.Task::(prepare) Task=`4abedc00-ee93-4a38-9178-1c9783a700be`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:45:04,678::task::579::TaskManager.Task::(_updateState) Task=`4abedc00-ee93-4a38-9178-1c9783a700be`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:45:04,678::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:45:04,678::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:45:04,678::task::974::TaskManager.Task::(_decref) Task=`4abedc00-ee93-4a38-9178-1c9783a700be`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:45:04,678::task::579::TaskManager.Task::(_updateState) Task=`e54087e5-7f8d-449f-a62b-bfc8cafe6a02`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:45:04,679::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:45:04,679::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:45:04,679::task::1168::TaskManager.Task::(prepare) Task=`e54087e5-7f8d-449f-a62b-bfc8cafe6a02`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:45:04,679::task::579::TaskManager.Task::(_updateState) Task=`e54087e5-7f8d-449f-a62b-bfc8cafe6a02`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:45:04,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:45:04,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:45:04,679::task::974::TaskManager.Task::(_decref) Task=`e54087e5-7f8d-449f-a62b-bfc8cafe6a02`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:45:04,699::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:04,700::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:05,469::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:45:05,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:45:05,956::task::579::TaskManager.Task::(_updateState) Task=`87b54fcc-1a96-443b-8757-bbc72fca96ba`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:45:05,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:45:05,957::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:45:05,957::task::1168::TaskManager.Task::(prepare) Task=`87b54fcc-1a96-443b-8757-bbc72fca96ba`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:45:05,957::task::579::TaskManager.Task::(_updateState) Task=`87b54fcc-1a96-443b-8757-bbc72fca96ba`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:45:05,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:45:05,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:45:05,958::task::974::TaskManager.Task::(_decref) Task=`87b54fcc-1a96-443b-8757-bbc72fca96ba`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:45:05,978::task::579::TaskManager.Task::(_updateState) Task=`591f01ec-5685-478d-bb06-86442287901f`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:45:05,979::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:45:05,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:45:05,980::task::1168::TaskManager.Task::(prepare) Task=`591f01ec-5685-478d-bb06-86442287901f`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:45:05,980::task::579::TaskManager.Task::(_updateState) Task=`591f01ec-5685-478d-bb06-86442287901f`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:45:05,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:45:05,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:45:05,980::task::974::TaskManager.Task::(_decref) Task=`591f01ec-5685-478d-bb06-86442287901f`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:45:06,104::task::579::TaskManager.Task::(_updateState) Task=`e539cde3-4305-4c29-b0f0-5a36ba7bbfdf`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:45:06,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:45:06,105::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:45:06,105::task::1168::TaskManager.Task::(prepare) Task=`e539cde3-4305-4c29-b0f0-5a36ba7bbfdf`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:45:06,105::task::579::TaskManager.Task::(_updateState) Task=`e539cde3-4305-4c29-b0f0-5a36ba7bbfdf`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:45:06,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:45:06,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:45:06,105::task::974::TaskManager.Task::(_decref) Task=`e539cde3-4305-4c29-b0f0-5a36ba7bbfdf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:45:06,363::task::579::TaskManager.Task::(_updateState) Task=`1936c4c1-27ea-4bab-82e6-432011346407`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:45:06,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:45:06,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:45:06,363::task::1168::TaskManager.Task::(prepare) Task=`1936c4c1-27ea-4bab-82e6-432011346407`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:45:06,363::task::579::TaskManager.Task::(_updateState) Task=`1936c4c1-27ea-4bab-82e6-432011346407`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:45:06,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:45:06,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:45:06,364::task::974::TaskManager.Task::(_decref) Task=`1936c4c1-27ea-4bab-82e6-432011346407`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:45:06,364::task::579::TaskManager.Task::(_updateState) Task=`dcf710c2-7175-4f2a-940f-bff31eb9decf`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:45:06,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:45:06,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:45:06,365::task::1168::TaskManager.Task::(prepare) Task=`dcf710c2-7175-4f2a-940f-bff31eb9decf`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:45:06,365::task::579::TaskManager.Task::(_updateState) Task=`dcf710c2-7175-4f2a-940f-bff31eb9decf`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:45:06,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:45:06,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:45:06,365::task::974::TaskManager.Task::(_decref) Task=`dcf710c2-7175-4f2a-940f-bff31eb9decf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:45:06,365::task::579::TaskManager.Task::(_updateState) Task=`959d94d0-1f2f-444b-b3ea-719b8e4caf67`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:45:06,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:45:06,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:45:06,366::task::1168::TaskManager.Task::(prepare) Task=`959d94d0-1f2f-444b-b3ea-719b8e4caf67`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:45:06,366::task::579::TaskManager.Task::(_updateState) Task=`959d94d0-1f2f-444b-b3ea-719b8e4caf67`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:45:06,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:45:06,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:45:06,367::task::974::TaskManager.Task::(_decref) Task=`959d94d0-1f2f-444b-b3ea-719b8e4caf67`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:06,470::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:45:06,470::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:45:06,470::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:45:06,470::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:06,701::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:07,471::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:45:07,549::task::579::TaskManager.Task::(_updateState) Task=`59854309-b1e1-4092-8e96-9cc14e684127`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:45:07,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:45:07,550::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:45:07,550::task::1168::TaskManager.Task::(prepare) Task=`59854309-b1e1-4092-8e96-9cc14e684127`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:45:07,550::task::579::TaskManager.Task::(_updateState) Task=`59854309-b1e1-4092-8e96-9cc14e684127`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:45:07,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:45:07,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:45:07,551::task::974::TaskManager.Task::(_decref) Task=`59854309-b1e1-4092-8e96-9cc14e684127`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:45:07,551::task::579::TaskManager.Task::(_updateState) Task=`47754653-70ea-471b-bb0a-ee826446ad90`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:45:07,551::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:45:07,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:45:07,552::task::1168::TaskManager.Task::(prepare) Task=`47754653-70ea-471b-bb0a-ee826446ad90`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:45:07,552::task::579::TaskManager.Task::(_updateState) Task=`47754653-70ea-471b-bb0a-ee826446ad90`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:45:07,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:45:07,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:45:07,552::task::974::TaskManager.Task::(_decref) Task=`47754653-70ea-471b-bb0a-ee826446ad90`::ref 0 aborting False >Thread-287024::DEBUG::2014-01-16 16:45:07,869::task::579::TaskManager.Task::(_updateState) Task=`bf95c9f4-9557-4b62-9bec-f075eec09e84`::moving from state init -> state preparing >Thread-287024::INFO::2014-01-16 16:45:07,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287024::INFO::2014-01-16 16:45:07,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000320241', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025062', 'lastCheck': '8.4', 'valid': True}} >Thread-287024::DEBUG::2014-01-16 16:45:07,870::task::1168::TaskManager.Task::(prepare) Task=`bf95c9f4-9557-4b62-9bec-f075eec09e84`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000320241', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025062', 'lastCheck': '8.4', 'valid': True}} >Thread-287024::DEBUG::2014-01-16 16:45:07,870::task::579::TaskManager.Task::(_updateState) Task=`bf95c9f4-9557-4b62-9bec-f075eec09e84`::moving from state preparing -> state finished >Thread-287024::DEBUG::2014-01-16 16:45:07,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287024::DEBUG::2014-01-16 16:45:07,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287024::DEBUG::2014-01-16 16:45:07,870::task::974::TaskManager.Task::(_decref) Task=`bf95c9f4-9557-4b62-9bec-f075eec09e84`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:08,472::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:45:08,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:45:08,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:45:08,473::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:08,473::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:45:08,474::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:45:08,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:45:09,466::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:45:09,466::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:45:09,467::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:45:09,467::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:45:09,469::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:45:09,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:45:09,487::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000273282 s, 7.5 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:45:09,487::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000273282 s, 7.5 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:45:09,487::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:45:09,487::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:45:09,488::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:45:09,488::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:45:09,488::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:45:09,489::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:45:09,489::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:45:09,489::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:45:09,490::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:45:09,705::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:45:09,707::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:45:09,710::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:45:09,710::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:45:09,711::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:45:09,711::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:45:09,711::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:45:09,712::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:45:09,883::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:45:09,887::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:45:09,904::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000245215 s, 16.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:45:10,134::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:45:10,151::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291131 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:45:10,163::task::579::TaskManager.Task::(_updateState) Task=`0cdb07c5-ed4d-4d7e-881d-b2e683a771de`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:45:10,163::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:45:10,163::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:45:10,164::task::1168::TaskManager.Task::(prepare) Task=`0cdb07c5-ed4d-4d7e-881d-b2e683a771de`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:45:10,164::task::579::TaskManager.Task::(_updateState) Task=`0cdb07c5-ed4d-4d7e-881d-b2e683a771de`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:45:10,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:45:10,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:45:10,164::task::974::TaskManager.Task::(_decref) Task=`0cdb07c5-ed4d-4d7e-881d-b2e683a771de`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:45:10,302::task::579::TaskManager.Task::(_updateState) Task=`70eb9c03-2305-47e5-b69c-d1af5b81f24e`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:45:10,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:45:10,302::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:45:10,302::task::1168::TaskManager.Task::(prepare) Task=`70eb9c03-2305-47e5-b69c-d1af5b81f24e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:45:10,302::task::579::TaskManager.Task::(_updateState) Task=`70eb9c03-2305-47e5-b69c-d1af5b81f24e`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:45:10,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:45:10,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:45:10,303::task::974::TaskManager.Task::(_decref) Task=`70eb9c03-2305-47e5-b69c-d1af5b81f24e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:10,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:45:10,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:45:10,487::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:45:10,686::task::579::TaskManager.Task::(_updateState) Task=`adcbd268-1f8a-4a36-91fa-05b39e1e1268`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:45:10,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:45:10,687::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:45:10,687::task::1168::TaskManager.Task::(prepare) Task=`adcbd268-1f8a-4a36-91fa-05b39e1e1268`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:45:10,687::task::579::TaskManager.Task::(_updateState) Task=`adcbd268-1f8a-4a36-91fa-05b39e1e1268`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:45:10,687::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:45:10,687::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:45:10,687::task::974::TaskManager.Task::(_decref) Task=`adcbd268-1f8a-4a36-91fa-05b39e1e1268`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:45:10,688::task::579::TaskManager.Task::(_updateState) Task=`6849470a-bf58-402b-bf47-63c7344c1ace`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:45:10,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:45:10,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:45:10,688::task::1168::TaskManager.Task::(prepare) Task=`6849470a-bf58-402b-bf47-63c7344c1ace`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:45:10,688::task::579::TaskManager.Task::(_updateState) Task=`6849470a-bf58-402b-bf47-63c7344c1ace`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:45:10,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:45:10,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:45:10,689::task::974::TaskManager.Task::(_decref) Task=`6849470a-bf58-402b-bf47-63c7344c1ace`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:45:10,707::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:11,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:45:11,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:45:11,489::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:45:11,580::task::579::TaskManager.Task::(_updateState) Task=`6016ce9c-1980-4020-be9b-2c002a51bbdb`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:45:11,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:45:11,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:45:11,581::task::1168::TaskManager.Task::(prepare) Task=`6016ce9c-1980-4020-be9b-2c002a51bbdb`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:45:11,581::task::579::TaskManager.Task::(_updateState) Task=`6016ce9c-1980-4020-be9b-2c002a51bbdb`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:45:11,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:45:11,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:45:11,582::task::974::TaskManager.Task::(_decref) Task=`6016ce9c-1980-4020-be9b-2c002a51bbdb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:12,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:45:12,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:45:12,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:45:12,490::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:45:12,540::task::579::TaskManager.Task::(_updateState) Task=`c5807f30-3bee-40e1-ba1a-d1d7225df90b`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:45:12,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:45:12,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:45:12,541::task::1168::TaskManager.Task::(prepare) Task=`c5807f30-3bee-40e1-ba1a-d1d7225df90b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:45:12,541::task::579::TaskManager.Task::(_updateState) Task=`c5807f30-3bee-40e1-ba1a-d1d7225df90b`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:45:12,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:45:12,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:45:12,542::task::974::TaskManager.Task::(_decref) Task=`c5807f30-3bee-40e1-ba1a-d1d7225df90b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:45:12,708::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:13,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:14,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:45:14,493::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:14,710::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:14,710::task::579::TaskManager.Task::(_updateState) Task=`79dcc9a3-7804-45d0-a337-0570a84d6e03`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:45:14,710::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:45:14,711::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:45:14,711::task::1168::TaskManager.Task::(prepare) Task=`79dcc9a3-7804-45d0-a337-0570a84d6e03`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:45:14,711::task::579::TaskManager.Task::(_updateState) Task=`79dcc9a3-7804-45d0-a337-0570a84d6e03`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:45:14,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:45:14,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:45:14,712::task::974::TaskManager.Task::(_decref) Task=`79dcc9a3-7804-45d0-a337-0570a84d6e03`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:45:14,713::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:45:14,714::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:45:14,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:14,721::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:14,722::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:15,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:45:15,785::task::579::TaskManager.Task::(_updateState) Task=`6772a68b-587f-47c4-9b40-f319b4f62239`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:45:15,785::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:45:15,786::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:45:15,786::task::1168::TaskManager.Task::(prepare) Task=`6772a68b-587f-47c4-9b40-f319b4f62239`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:45:15,786::task::579::TaskManager.Task::(_updateState) Task=`6772a68b-587f-47c4-9b40-f319b4f62239`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:45:15,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:45:15,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:45:15,787::task::974::TaskManager.Task::(_decref) Task=`6772a68b-587f-47c4-9b40-f319b4f62239`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:16,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:16,724::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:45:17,363::task::579::TaskManager.Task::(_updateState) Task=`71f042c7-4324-4a3b-bf45-2f82a58aa7fc`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:45:17,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:45:17,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:45:17,365::task::1168::TaskManager.Task::(prepare) Task=`71f042c7-4324-4a3b-bf45-2f82a58aa7fc`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:45:17,365::task::579::TaskManager.Task::(_updateState) Task=`71f042c7-4324-4a3b-bf45-2f82a58aa7fc`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:45:17,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:45:17,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:45:17,366::task::974::TaskManager.Task::(_decref) Task=`71f042c7-4324-4a3b-bf45-2f82a58aa7fc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:17,496::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:18,498::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:18,725::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:45:19,247::task::579::TaskManager.Task::(_updateState) Task=`e0d91788-32df-441c-afda-6228cbf6c96f`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:45:19,247::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:45:19,248::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:45:19,248::task::1168::TaskManager.Task::(prepare) Task=`e0d91788-32df-441c-afda-6228cbf6c96f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:45:19,248::task::579::TaskManager.Task::(_updateState) Task=`e0d91788-32df-441c-afda-6228cbf6c96f`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:45:19,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:45:19,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:45:19,248::task::974::TaskManager.Task::(_decref) Task=`e0d91788-32df-441c-afda-6228cbf6c96f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:19,499::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:19,727::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:45:19,910::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:45:19,927::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000342407 s, 12.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:45:20,160::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:45:20,175::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00031497 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:45:20,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:45:20,500::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:20,728::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:21,501::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:22,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:22,730::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:23,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287030::DEBUG::2014-01-16 16:45:23,605::task::579::TaskManager.Task::(_updateState) Task=`9317c9d8-4d3b-4e9d-8813-e7e1e010a86e`::moving from state init -> state preparing >Thread-287030::INFO::2014-01-16 16:45:23,605::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287030::INFO::2014-01-16 16:45:23,605::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031497', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342407', 'lastCheck': '3.7', 'valid': True}} >Thread-287030::DEBUG::2014-01-16 16:45:23,605::task::1168::TaskManager.Task::(prepare) Task=`9317c9d8-4d3b-4e9d-8813-e7e1e010a86e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031497', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342407', 'lastCheck': '3.7', 'valid': True}} >Thread-287030::DEBUG::2014-01-16 16:45:23,606::task::579::TaskManager.Task::(_updateState) Task=`9317c9d8-4d3b-4e9d-8813-e7e1e010a86e`::moving from state preparing -> state finished >Thread-287030::DEBUG::2014-01-16 16:45:23,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287030::DEBUG::2014-01-16 16:45:23,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287030::DEBUG::2014-01-16 16:45:23,606::task::974::TaskManager.Task::(_decref) Task=`9317c9d8-4d3b-4e9d-8813-e7e1e010a86e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:24,505::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:24,731::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:24,732::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:45:25,420::task::579::TaskManager.Task::(_updateState) Task=`b06c9bce-0000-439f-b840-daff80e4d5c7`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:45:25,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:45:25,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:45:25,422::task::1168::TaskManager.Task::(prepare) Task=`b06c9bce-0000-439f-b840-daff80e4d5c7`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:45:25,422::task::579::TaskManager.Task::(_updateState) Task=`b06c9bce-0000-439f-b840-daff80e4d5c7`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:45:25,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:45:25,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:45:25,423::task::974::TaskManager.Task::(_decref) Task=`b06c9bce-0000-439f-b840-daff80e4d5c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:25,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:45:25,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:45:25,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:26,508::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:45:26,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:26,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:45:27,130::task::579::TaskManager.Task::(_updateState) Task=`d9d2e297-b5e4-4a00-a589-03237de736d5`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:45:27,130::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:45:27,130::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:45:27,130::task::1168::TaskManager.Task::(prepare) Task=`d9d2e297-b5e4-4a00-a589-03237de736d5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:45:27,131::task::579::TaskManager.Task::(_updateState) Task=`d9d2e297-b5e4-4a00-a589-03237de736d5`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:45:27,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:45:27,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:45:27,131::task::974::TaskManager.Task::(_decref) Task=`d9d2e297-b5e4-4a00-a589-03237de736d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:27,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:45:27,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:45:27,510::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:45:28,074::task::579::TaskManager.Task::(_updateState) Task=`5debab3b-7d92-4715-94d0-abe3bec083bf`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:45:28,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:45:28,075::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:45:28,075::task::1168::TaskManager.Task::(prepare) Task=`5debab3b-7d92-4715-94d0-abe3bec083bf`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:45:28,075::task::579::TaskManager.Task::(_updateState) Task=`5debab3b-7d92-4715-94d0-abe3bec083bf`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:45:28,075::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:45:28,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:45:28,076::task::974::TaskManager.Task::(_decref) Task=`5debab3b-7d92-4715-94d0-abe3bec083bf`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:45:28,076::task::579::TaskManager.Task::(_updateState) Task=`27969098-e35a-4168-9e26-ddb8cc459a4f`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:45:28,076::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:45:28,077::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:45:28,077::task::1168::TaskManager.Task::(prepare) Task=`27969098-e35a-4168-9e26-ddb8cc459a4f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:45:28,077::task::579::TaskManager.Task::(_updateState) Task=`27969098-e35a-4168-9e26-ddb8cc459a4f`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:45:28,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:45:28,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:45:28,077::task::974::TaskManager.Task::(_decref) Task=`27969098-e35a-4168-9e26-ddb8cc459a4f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:28,511::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:45:28,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:28,735::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:29,512::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:45:29,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:29,737::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:45:29,737::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:45:29,738::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:45:29,932::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:45:29,949::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287758 s, 14.2 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:45:30,184::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:45:30,200::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000287081 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:45:30,514::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:30,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:45:30,829::task::579::TaskManager.Task::(_updateState) Task=`e85f3e7e-7dcf-4ae6-a1fc-9934114b888a`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:45:30,829::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:45:30,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:45:30,830::task::1168::TaskManager.Task::(prepare) Task=`e85f3e7e-7dcf-4ae6-a1fc-9934114b888a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:45:30,830::task::579::TaskManager.Task::(_updateState) Task=`e85f3e7e-7dcf-4ae6-a1fc-9934114b888a`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:45:30,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:45:30,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:45:30,830::task::974::TaskManager.Task::(_decref) Task=`e85f3e7e-7dcf-4ae6-a1fc-9934114b888a`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:45:30,842::task::579::TaskManager.Task::(_updateState) Task=`39552002-92ba-4ebe-b4a4-00042544d0a3`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:45:30,843::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:45:30,843::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:45:30,844::task::1168::TaskManager.Task::(prepare) Task=`39552002-92ba-4ebe-b4a4-00042544d0a3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:45:30,844::task::579::TaskManager.Task::(_updateState) Task=`39552002-92ba-4ebe-b4a4-00042544d0a3`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:45:30,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:45:30,844::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:45:30,845::task::974::TaskManager.Task::(_decref) Task=`39552002-92ba-4ebe-b4a4-00042544d0a3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:31,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:45:31,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:32,516::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:45:32,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:32,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:33,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:45:33,518::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:45:33,518::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:45:33,518::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:34,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:45:34,520::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:45:34,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:34,742::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:34,744::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:35,521::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:45:35,522::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:45:35,835::task::579::TaskManager.Task::(_updateState) Task=`0d93be6b-17ab-4142-937e-04e2e49fef42`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:45:35,835::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:45:35,836::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:45:35,836::task::1168::TaskManager.Task::(prepare) Task=`0d93be6b-17ab-4142-937e-04e2e49fef42`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:45:35,836::task::579::TaskManager.Task::(_updateState) Task=`0d93be6b-17ab-4142-937e-04e2e49fef42`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:45:35,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:45:35,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:45:35,837::task::974::TaskManager.Task::(_decref) Task=`0d93be6b-17ab-4142-937e-04e2e49fef42`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:36,523::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:45:36,523::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:45:36,523::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:45:36,523::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:36,745::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:37,524::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:45:38,276::task::579::TaskManager.Task::(_updateState) Task=`b0478f52-ad2f-4036-a1ed-b49f6f6db987`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:45:38,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:45:38,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:45:38,277::task::1168::TaskManager.Task::(prepare) Task=`b0478f52-ad2f-4036-a1ed-b49f6f6db987`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:45:38,277::task::579::TaskManager.Task::(_updateState) Task=`b0478f52-ad2f-4036-a1ed-b49f6f6db987`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:45:38,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:45:38,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:45:38,278::task::974::TaskManager.Task::(_decref) Task=`b0478f52-ad2f-4036-a1ed-b49f6f6db987`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:38,525::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:45:38,526::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:45:38,526::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:45:38,526::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:38,526::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:45:38,527::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:45:38,747::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:45:39,130::task::579::TaskManager.Task::(_updateState) Task=`e8e63e5b-9946-4036-9821-f198083a574d`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:45:39,131::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:45:39,131::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:45:39,131::task::1168::TaskManager.Task::(prepare) Task=`e8e63e5b-9946-4036-9821-f198083a574d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:45:39,131::task::579::TaskManager.Task::(_updateState) Task=`e8e63e5b-9946-4036-9821-f198083a574d`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:45:39,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:45:39,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:45:39,132::task::974::TaskManager.Task::(_decref) Task=`e8e63e5b-9946-4036-9821-f198083a574d`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:45:39,133::task::579::TaskManager.Task::(_updateState) Task=`dd36d09d-16aa-4ba5-b405-04c738f9f92c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:45:39,134::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:45:39,134::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:45:39,134::task::1168::TaskManager.Task::(prepare) Task=`dd36d09d-16aa-4ba5-b405-04c738f9f92c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:45:39,134::task::579::TaskManager.Task::(_updateState) Task=`dd36d09d-16aa-4ba5-b405-04c738f9f92c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:45:39,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:45:39,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:45:39,135::task::974::TaskManager.Task::(_decref) Task=`dd36d09d-16aa-4ba5-b405-04c738f9f92c`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:45:39,310::task::579::TaskManager.Task::(_updateState) Task=`be38efc9-d937-49fe-99e2-0cf7554b7605`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:45:39,310::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:45:39,310::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:45:39,311::task::1168::TaskManager.Task::(prepare) Task=`be38efc9-d937-49fe-99e2-0cf7554b7605`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:45:39,311::task::579::TaskManager.Task::(_updateState) Task=`be38efc9-d937-49fe-99e2-0cf7554b7605`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:45:39,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:45:39,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:45:39,311::task::974::TaskManager.Task::(_decref) Task=`be38efc9-d937-49fe-99e2-0cf7554b7605`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:39,528::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287036::DEBUG::2014-01-16 16:45:39,575::task::579::TaskManager.Task::(_updateState) Task=`a5689ff0-45c2-4d62-8acf-8b766167490c`::moving from state init -> state preparing >Thread-287036::INFO::2014-01-16 16:45:39,575::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287036::INFO::2014-01-16 16:45:39,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287081', 'lastCheck': '9.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287758', 'lastCheck': '9.6', 'valid': True}} >Thread-287036::DEBUG::2014-01-16 16:45:39,576::task::1168::TaskManager.Task::(prepare) Task=`a5689ff0-45c2-4d62-8acf-8b766167490c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287081', 'lastCheck': '9.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287758', 'lastCheck': '9.6', 'valid': True}} >Thread-287036::DEBUG::2014-01-16 16:45:39,576::task::579::TaskManager.Task::(_updateState) Task=`a5689ff0-45c2-4d62-8acf-8b766167490c`::moving from state preparing -> state finished >Thread-287036::DEBUG::2014-01-16 16:45:39,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287036::DEBUG::2014-01-16 16:45:39,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287036::DEBUG::2014-01-16 16:45:39,576::task::974::TaskManager.Task::(_decref) Task=`a5689ff0-45c2-4d62-8acf-8b766167490c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:45:39,748::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:45:39,955::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:45:39,973::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000196568 s, 20.8 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 16:45:40,102::task::579::TaskManager.Task::(_updateState) Task=`bd85ef02-87f7-48f4-a434-1f8573f5d53a`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:45:40,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:45:40,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:45:40,103::task::1168::TaskManager.Task::(prepare) Task=`bd85ef02-87f7-48f4-a434-1f8573f5d53a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:45:40,103::task::579::TaskManager.Task::(_updateState) Task=`bd85ef02-87f7-48f4-a434-1f8573f5d53a`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:45:40,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:45:40,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:45:40,104::task::974::TaskManager.Task::(_decref) Task=`bd85ef02-87f7-48f4-a434-1f8573f5d53a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:45:40,209::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:45:40,225::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000389781 s, 936 kB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:45:40,286::task::579::TaskManager.Task::(_updateState) Task=`c8fade30-3d31-42b7-9ece-cae4a86bb321`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:45:40,286::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:45:40,287::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:45:40,287::task::1168::TaskManager.Task::(prepare) Task=`c8fade30-3d31-42b7-9ece-cae4a86bb321`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:45:40,287::task::579::TaskManager.Task::(_updateState) Task=`c8fade30-3d31-42b7-9ece-cae4a86bb321`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:45:40,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:45:40,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:45:40,287::task::974::TaskManager.Task::(_decref) Task=`c8fade30-3d31-42b7-9ece-cae4a86bb321`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:40,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:45:40,531::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:45:40,531::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:40,749::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:41,532::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:45:41,532::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:45:41,533::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:42,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:45:42,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:45:42,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:45:42,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:42,752::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:43,536::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:45:44,122::task::579::TaskManager.Task::(_updateState) Task=`db6c5dff-2461-43b4-be8c-b16d08734bd5`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:45:44,122::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:45:44,123::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:45:44,123::task::1168::TaskManager.Task::(prepare) Task=`db6c5dff-2461-43b4-be8c-b16d08734bd5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:45:44,123::task::579::TaskManager.Task::(_updateState) Task=`db6c5dff-2461-43b4-be8c-b16d08734bd5`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:45:44,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:45:44,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:45:44,123::task::974::TaskManager.Task::(_decref) Task=`db6c5dff-2461-43b4-be8c-b16d08734bd5`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:45:44,124::task::579::TaskManager.Task::(_updateState) Task=`9f58a9f7-06c7-4357-adc3-1f9361ca6a72`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:45:44,124::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:45:44,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:45:44,124::task::1168::TaskManager.Task::(prepare) Task=`9f58a9f7-06c7-4357-adc3-1f9361ca6a72`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:45:44,124::task::579::TaskManager.Task::(_updateState) Task=`9f58a9f7-06c7-4357-adc3-1f9361ca6a72`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:45:44,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:45:44,125::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:45:44,125::task::974::TaskManager.Task::(_decref) Task=`9f58a9f7-06c7-4357-adc3-1f9361ca6a72`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:45:44,125::task::579::TaskManager.Task::(_updateState) Task=`1737d190-e658-409b-ac1e-79c79be9aa31`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:45:44,125::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:45:44,125::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:45:44,126::task::1168::TaskManager.Task::(prepare) Task=`1737d190-e658-409b-ac1e-79c79be9aa31`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:45:44,126::task::579::TaskManager.Task::(_updateState) Task=`1737d190-e658-409b-ac1e-79c79be9aa31`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:45:44,126::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:45:44,126::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:45:44,126::task::974::TaskManager.Task::(_decref) Task=`1737d190-e658-409b-ac1e-79c79be9aa31`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:44,536::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:45:44,537::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:44,754::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:44,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:45:44,756::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:45:44,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:45,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:46,539::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:46,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:47,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:45:47,953::task::579::TaskManager.Task::(_updateState) Task=`52d8ef6f-04dc-4a51-840f-4064ee4c7554`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:45:47,953::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:45:47,953::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:45:47,953::task::1168::TaskManager.Task::(prepare) Task=`52d8ef6f-04dc-4a51-840f-4064ee4c7554`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:45:47,954::task::579::TaskManager.Task::(_updateState) Task=`52d8ef6f-04dc-4a51-840f-4064ee4c7554`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:45:47,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:45:47,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:45:47,954::task::974::TaskManager.Task::(_decref) Task=`52d8ef6f-04dc-4a51-840f-4064ee4c7554`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:48,542::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:48,760::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:49,543::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:49,761::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:45:49,978::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:45:49,995::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000220672 s, 18.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:45:50,235::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:45:50,253::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000269925 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:45:50,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:45:50,544::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:50,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:51,545::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:52,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:45:52,699::task::579::TaskManager.Task::(_updateState) Task=`04d5d860-0b3d-4a83-a3c2-ce9bcfd47cde`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:45:52,699::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:45:52,700::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:45:52,700::task::1168::TaskManager.Task::(prepare) Task=`04d5d860-0b3d-4a83-a3c2-ce9bcfd47cde`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:45:52,700::task::579::TaskManager.Task::(_updateState) Task=`04d5d860-0b3d-4a83-a3c2-ce9bcfd47cde`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:45:52,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:45:52,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:45:52,700::task::974::TaskManager.Task::(_decref) Task=`04d5d860-0b3d-4a83-a3c2-ce9bcfd47cde`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:45:52,763::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:53,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:54,547::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:54,765::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:45:54,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287042::DEBUG::2014-01-16 16:45:55,542::task::579::TaskManager.Task::(_updateState) Task=`2ac333a2-b164-4b2a-9ea6-27eb9f08dba9`::moving from state init -> state preparing >Thread-287042::INFO::2014-01-16 16:45:55,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287042::INFO::2014-01-16 16:45:55,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269925', 'lastCheck': '5.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000220672', 'lastCheck': '5.5', 'valid': True}} >Thread-287042::DEBUG::2014-01-16 16:45:55,542::task::1168::TaskManager.Task::(prepare) Task=`2ac333a2-b164-4b2a-9ea6-27eb9f08dba9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000269925', 'lastCheck': '5.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000220672', 'lastCheck': '5.5', 'valid': True}} >Thread-287042::DEBUG::2014-01-16 16:45:55,542::task::579::TaskManager.Task::(_updateState) Task=`2ac333a2-b164-4b2a-9ea6-27eb9f08dba9`::moving from state preparing -> state finished >Thread-287042::DEBUG::2014-01-16 16:45:55,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287042::DEBUG::2014-01-16 16:45:55,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287042::DEBUG::2014-01-16 16:45:55,543::task::974::TaskManager.Task::(_decref) Task=`2ac333a2-b164-4b2a-9ea6-27eb9f08dba9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:55,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:45:55,549::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:45:55,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:56,550::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:45:56,550::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:56,767::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:45:57,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:45:57,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:45:57,552::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:45:58,553::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:45:58,553::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:58,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:45:59,342::task::579::TaskManager.Task::(_updateState) Task=`9a5211c1-5bae-4979-b98e-4fc70187b288`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:45:59,343::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:45:59,343::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:45:59,343::task::1168::TaskManager.Task::(prepare) Task=`9a5211c1-5bae-4979-b98e-4fc70187b288`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:45:59,343::task::579::TaskManager.Task::(_updateState) Task=`9a5211c1-5bae-4979-b98e-4fc70187b288`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:45:59,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:45:59,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:45:59,344::task::974::TaskManager.Task::(_decref) Task=`9a5211c1-5bae-4979-b98e-4fc70187b288`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:45:59,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:45:59,555::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:45:59,771::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:45:59,771::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:45:59,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:46:00,001::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:46:00,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000282673 s, 14.5 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:46:00,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:46:00,279::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275491 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:46:00,556::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:00,774::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:01,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:46:01,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:02,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:46:02,558::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:02,775::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:03,559::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:46:03,560::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:46:03,560::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:46:03,560::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:04,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:46:04,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:46:04,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:04,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:04,778::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:46:04,921::task::579::TaskManager.Task::(_updateState) Task=`a39e7b1a-77cd-4729-8619-28572ca9a63a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:46:04,921::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:46:04,921::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:46:04,922::task::1168::TaskManager.Task::(prepare) Task=`a39e7b1a-77cd-4729-8619-28572ca9a63a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:46:04,922::task::579::TaskManager.Task::(_updateState) Task=`a39e7b1a-77cd-4729-8619-28572ca9a63a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:46:04,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:46:04,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:46:04,922::task::974::TaskManager.Task::(_decref) Task=`a39e7b1a-77cd-4729-8619-28572ca9a63a`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:46:04,922::task::579::TaskManager.Task::(_updateState) Task=`0eae9963-a1ba-453f-ba2e-bbb5d22460a5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:46:04,923::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:46:04,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:46:04,923::task::1168::TaskManager.Task::(prepare) Task=`0eae9963-a1ba-453f-ba2e-bbb5d22460a5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:46:04,923::task::579::TaskManager.Task::(_updateState) Task=`0eae9963-a1ba-453f-ba2e-bbb5d22460a5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:46:04,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:46:04,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:46:04,923::task::974::TaskManager.Task::(_decref) Task=`0eae9963-a1ba-453f-ba2e-bbb5d22460a5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:05,563::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:46:05,563::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:46:06,026::task::579::TaskManager.Task::(_updateState) Task=`c721696e-ef56-4d91-a257-4b512d0c521b`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:46:06,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:46:06,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:46:06,027::task::1168::TaskManager.Task::(prepare) Task=`c721696e-ef56-4d91-a257-4b512d0c521b`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:46:06,027::task::579::TaskManager.Task::(_updateState) Task=`c721696e-ef56-4d91-a257-4b512d0c521b`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:46:06,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:46:06,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:46:06,027::task::974::TaskManager.Task::(_decref) Task=`c721696e-ef56-4d91-a257-4b512d0c521b`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:46:06,047::task::579::TaskManager.Task::(_updateState) Task=`c4b87cf5-1e3a-4312-96c4-4ab8e6903bc7`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:46:06,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:46:06,048::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:46:06,048::task::1168::TaskManager.Task::(prepare) Task=`c4b87cf5-1e3a-4312-96c4-4ab8e6903bc7`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:46:06,048::task::579::TaskManager.Task::(_updateState) Task=`c4b87cf5-1e3a-4312-96c4-4ab8e6903bc7`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:46:06,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:46:06,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:46:06,049::task::974::TaskManager.Task::(_decref) Task=`c4b87cf5-1e3a-4312-96c4-4ab8e6903bc7`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:46:06,295::task::579::TaskManager.Task::(_updateState) Task=`637fff48-78c5-4476-9822-1dcce9252a30`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:46:06,295::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:46:06,295::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:46:06,295::task::1168::TaskManager.Task::(prepare) Task=`637fff48-78c5-4476-9822-1dcce9252a30`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:46:06,295::task::579::TaskManager.Task::(_updateState) Task=`637fff48-78c5-4476-9822-1dcce9252a30`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:46:06,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:46:06,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:46:06,296::task::974::TaskManager.Task::(_decref) Task=`637fff48-78c5-4476-9822-1dcce9252a30`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:06,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:46:06,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:46:06,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:46:06,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:06,779::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:46:06,945::task::579::TaskManager.Task::(_updateState) Task=`894242df-cacb-4abe-b25f-78b4c4524f8c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:46:06,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:46:06,945::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:46:06,945::task::1168::TaskManager.Task::(prepare) Task=`894242df-cacb-4abe-b25f-78b4c4524f8c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:46:06,945::task::579::TaskManager.Task::(_updateState) Task=`894242df-cacb-4abe-b25f-78b4c4524f8c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:46:06,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:46:06,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:46:06,946::task::974::TaskManager.Task::(_decref) Task=`894242df-cacb-4abe-b25f-78b4c4524f8c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:46:06,946::task::579::TaskManager.Task::(_updateState) Task=`08331c9d-acb0-42df-af12-2bfd0ba7313a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:46:06,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:46:06,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:46:06,947::task::1168::TaskManager.Task::(prepare) Task=`08331c9d-acb0-42df-af12-2bfd0ba7313a`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:46:06,947::task::579::TaskManager.Task::(_updateState) Task=`08331c9d-acb0-42df-af12-2bfd0ba7313a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:46:06,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:46:06,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:46:06,947::task::974::TaskManager.Task::(_decref) Task=`08331c9d-acb0-42df-af12-2bfd0ba7313a`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:46:06,947::task::579::TaskManager.Task::(_updateState) Task=`8653bbe1-a762-42c3-9ab8-827669fd75d2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:46:06,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:46:06,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:46:06,948::task::1168::TaskManager.Task::(prepare) Task=`8653bbe1-a762-42c3-9ab8-827669fd75d2`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:46:06,948::task::579::TaskManager.Task::(_updateState) Task=`8653bbe1-a762-42c3-9ab8-827669fd75d2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:46:06,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:46:06,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:46:06,949::task::974::TaskManager.Task::(_decref) Task=`8653bbe1-a762-42c3-9ab8-827669fd75d2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:07,565::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:46:07,656::task::579::TaskManager.Task::(_updateState) Task=`6c78faac-5c14-403a-ad99-ddea04c47b32`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:46:07,656::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:46:07,657::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:46:07,658::task::1168::TaskManager.Task::(prepare) Task=`6c78faac-5c14-403a-ad99-ddea04c47b32`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:46:07,658::task::579::TaskManager.Task::(_updateState) Task=`6c78faac-5c14-403a-ad99-ddea04c47b32`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:46:07,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:46:07,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:46:07,658::task::974::TaskManager.Task::(_decref) Task=`6c78faac-5c14-403a-ad99-ddea04c47b32`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:46:07,658::task::579::TaskManager.Task::(_updateState) Task=`d1e0da78-5a6a-4634-acc0-f1b748f75672`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:46:07,659::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:46:07,659::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:46:07,659::task::1168::TaskManager.Task::(prepare) Task=`d1e0da78-5a6a-4634-acc0-f1b748f75672`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:46:07,659::task::579::TaskManager.Task::(_updateState) Task=`d1e0da78-5a6a-4634-acc0-f1b748f75672`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:46:07,659::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:46:07,659::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:46:07,659::task::974::TaskManager.Task::(_decref) Task=`d1e0da78-5a6a-4634-acc0-f1b748f75672`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:08,566::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:46:08,566::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:46:08,567::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:46:08,567::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:08,567::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:46:08,567::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:46:08,780::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:09,568::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:09,781::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:46:10,030::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:46:10,053::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218779 s, 18.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:46:10,281::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:46:10,286::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:46:10,287::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:46:10,293::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:46:10,294::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:46:10,294::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:46:10,294::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:46:10,301::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:46:10,319::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279685 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:46:10,321::task::579::TaskManager.Task::(_updateState) Task=`37542933-8c20-451e-8342-a1b8a627dc7d`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:46:10,324::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:46:10,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:46:10,325::task::1168::TaskManager.Task::(prepare) Task=`37542933-8c20-451e-8342-a1b8a627dc7d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:46:10,325::task::579::TaskManager.Task::(_updateState) Task=`37542933-8c20-451e-8342-a1b8a627dc7d`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:46:10,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:46:10,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:46:10,326::task::974::TaskManager.Task::(_decref) Task=`37542933-8c20-451e-8342-a1b8a627dc7d`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:46:10,463::task::579::TaskManager.Task::(_updateState) Task=`4347b759-67f0-45ab-bd5a-5095a5112dcc`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:46:10,463::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:46:10,464::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:46:10,464::task::1168::TaskManager.Task::(prepare) Task=`4347b759-67f0-45ab-bd5a-5095a5112dcc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:46:10,464::task::579::TaskManager.Task::(_updateState) Task=`4347b759-67f0-45ab-bd5a-5095a5112dcc`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:46:10,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:46:10,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:46:10,464::task::974::TaskManager.Task::(_decref) Task=`4347b759-67f0-45ab-bd5a-5095a5112dcc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:10,569::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:46:10,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:46:10,570::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:10,783::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:46:10,907::task::579::TaskManager.Task::(_updateState) Task=`a1f82ddc-8be5-44c3-addb-26ff57862a1b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:46:10,907::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:46:10,907::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:46:10,907::task::1168::TaskManager.Task::(prepare) Task=`a1f82ddc-8be5-44c3-addb-26ff57862a1b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:46:10,908::task::579::TaskManager.Task::(_updateState) Task=`a1f82ddc-8be5-44c3-addb-26ff57862a1b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:46:10,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:46:10,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:46:10,908::task::974::TaskManager.Task::(_decref) Task=`a1f82ddc-8be5-44c3-addb-26ff57862a1b`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:46:10,908::task::579::TaskManager.Task::(_updateState) Task=`a4d97341-47fc-4c31-af5b-07272984e6cd`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:46:10,908::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:46:10,909::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:46:10,909::task::1168::TaskManager.Task::(prepare) Task=`a4d97341-47fc-4c31-af5b-07272984e6cd`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:46:10,909::task::579::TaskManager.Task::(_updateState) Task=`a4d97341-47fc-4c31-af5b-07272984e6cd`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:46:10,909::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:46:10,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:46:10,909::task::974::TaskManager.Task::(_decref) Task=`a4d97341-47fc-4c31-af5b-07272984e6cd`::ref 0 aborting False >Thread-287049::DEBUG::2014-01-16 16:46:11,451::task::579::TaskManager.Task::(_updateState) Task=`3489e82f-dba1-458d-ad69-9808757b978c`::moving from state init -> state preparing >Thread-287049::INFO::2014-01-16 16:46:11,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287049::INFO::2014-01-16 16:46:11,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279685', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218779', 'lastCheck': '1.4', 'valid': True}} >Thread-287049::DEBUG::2014-01-16 16:46:11,451::task::1168::TaskManager.Task::(prepare) Task=`3489e82f-dba1-458d-ad69-9808757b978c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279685', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218779', 'lastCheck': '1.4', 'valid': True}} >Thread-287049::DEBUG::2014-01-16 16:46:11,451::task::579::TaskManager.Task::(_updateState) Task=`3489e82f-dba1-458d-ad69-9808757b978c`::moving from state preparing -> state finished >Thread-287049::DEBUG::2014-01-16 16:46:11,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287049::DEBUG::2014-01-16 16:46:11,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287049::DEBUG::2014-01-16 16:46:11,452::task::974::TaskManager.Task::(_decref) Task=`3489e82f-dba1-458d-ad69-9808757b978c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:11,571::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:46:11,571::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:46:11,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:46:11,756::task::579::TaskManager.Task::(_updateState) Task=`fde7aff6-2c3b-4a5d-84a9-16951c7aea81`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:46:11,756::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:46:11,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:46:11,757::task::1168::TaskManager.Task::(prepare) Task=`fde7aff6-2c3b-4a5d-84a9-16951c7aea81`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:46:11,757::task::579::TaskManager.Task::(_updateState) Task=`fde7aff6-2c3b-4a5d-84a9-16951c7aea81`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:46:11,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:46:11,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:46:11,757::task::974::TaskManager.Task::(_decref) Task=`fde7aff6-2c3b-4a5d-84a9-16951c7aea81`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:12,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:46:12,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:46:12,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:46:12,572::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:46:12,710::task::579::TaskManager.Task::(_updateState) Task=`041a98a0-dcc2-45a0-9bf6-1128b0febcec`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:46:12,710::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:46:12,710::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:46:12,710::task::1168::TaskManager.Task::(prepare) Task=`041a98a0-dcc2-45a0-9bf6-1128b0febcec`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:46:12,710::task::579::TaskManager.Task::(_updateState) Task=`041a98a0-dcc2-45a0-9bf6-1128b0febcec`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:46:12,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:46:12,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:46:12,711::task::974::TaskManager.Task::(_decref) Task=`041a98a0-dcc2-45a0-9bf6-1128b0febcec`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:46:12,784::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:13,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:14,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:46:14,575::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:14,786::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:14,786::task::579::TaskManager.Task::(_updateState) Task=`05c543d9-0a87-4132-a648-ebf568958679`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:46:14,786::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:46:14,787::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:46:14,787::task::1168::TaskManager.Task::(prepare) Task=`05c543d9-0a87-4132-a648-ebf568958679`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:46:14,787::task::579::TaskManager.Task::(_updateState) Task=`05c543d9-0a87-4132-a648-ebf568958679`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:46:14,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:46:14,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:46:14,787::task::974::TaskManager.Task::(_decref) Task=`05c543d9-0a87-4132-a648-ebf568958679`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:46:14,790::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:46:14,790::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:46:14,791::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:14,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:14,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:15,576::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:46:15,965::task::579::TaskManager.Task::(_updateState) Task=`3394e439-6018-4bfd-8d97-b2e147d5dd44`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:46:15,965::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:46:15,965::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:46:15,966::task::1168::TaskManager.Task::(prepare) Task=`3394e439-6018-4bfd-8d97-b2e147d5dd44`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:46:15,966::task::579::TaskManager.Task::(_updateState) Task=`3394e439-6018-4bfd-8d97-b2e147d5dd44`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:46:15,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:46:15,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:46:15,966::task::974::TaskManager.Task::(_decref) Task=`3394e439-6018-4bfd-8d97-b2e147d5dd44`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:16,577::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:16,795::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:46:17,447::task::579::TaskManager.Task::(_updateState) Task=`3e280ee0-5a67-4f8e-89a6-825e8d8a6685`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:46:17,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:46:17,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:46:17,448::task::1168::TaskManager.Task::(prepare) Task=`3e280ee0-5a67-4f8e-89a6-825e8d8a6685`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:46:17,448::task::579::TaskManager.Task::(_updateState) Task=`3e280ee0-5a67-4f8e-89a6-825e8d8a6685`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:46:17,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:46:17,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:46:17,449::task::974::TaskManager.Task::(_decref) Task=`3e280ee0-5a67-4f8e-89a6-825e8d8a6685`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:17,578::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:18,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:18,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:46:19,411::task::579::TaskManager.Task::(_updateState) Task=`cae19ba5-7b46-4a6f-832d-8c777bc2c154`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:46:19,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:46:19,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:46:19,412::task::1168::TaskManager.Task::(prepare) Task=`cae19ba5-7b46-4a6f-832d-8c777bc2c154`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:46:19,412::task::579::TaskManager.Task::(_updateState) Task=`cae19ba5-7b46-4a6f-832d-8c777bc2c154`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:46:19,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:46:19,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:46:19,412::task::974::TaskManager.Task::(_decref) Task=`cae19ba5-7b46-4a6f-832d-8c777bc2c154`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:19,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:19,797::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:46:20,060::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:46:20,077::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000301397 s, 13.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:46:20,332::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:46:20,349::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300606 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:46:20,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:46:20,587::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:20,799::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:21,588::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:22,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:22,800::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:23,591::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:24,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:24,802::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:24,803::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:46:25,490::task::579::TaskManager.Task::(_updateState) Task=`b3a1bd60-c221-4ba8-956d-fc8ecedc1fdb`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:46:25,490::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:46:25,491::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:46:25,491::task::1168::TaskManager.Task::(prepare) Task=`b3a1bd60-c221-4ba8-956d-fc8ecedc1fdb`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:46:25,491::task::579::TaskManager.Task::(_updateState) Task=`b3a1bd60-c221-4ba8-956d-fc8ecedc1fdb`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:46:25,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:46:25,491::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:46:25,491::task::974::TaskManager.Task::(_decref) Task=`b3a1bd60-c221-4ba8-956d-fc8ecedc1fdb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:25,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:46:25,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:46:25,594::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:26,595::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:46:26,596::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:26,804::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287055::DEBUG::2014-01-16 16:46:27,197::task::579::TaskManager.Task::(_updateState) Task=`5c586b2d-4278-4540-b829-85837ec9a427`::moving from state init -> state preparing >Thread-287055::INFO::2014-01-16 16:46:27,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287055::INFO::2014-01-16 16:46:27,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300606', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301397', 'lastCheck': '7.1', 'valid': True}} >Thread-287055::DEBUG::2014-01-16 16:46:27,197::task::1168::TaskManager.Task::(prepare) Task=`5c586b2d-4278-4540-b829-85837ec9a427`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300606', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301397', 'lastCheck': '7.1', 'valid': True}} >Thread-287055::DEBUG::2014-01-16 16:46:27,198::task::579::TaskManager.Task::(_updateState) Task=`5c586b2d-4278-4540-b829-85837ec9a427`::moving from state preparing -> state finished >Thread-287055::DEBUG::2014-01-16 16:46:27,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287055::DEBUG::2014-01-16 16:46:27,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287055::DEBUG::2014-01-16 16:46:27,198::task::974::TaskManager.Task::(_decref) Task=`5c586b2d-4278-4540-b829-85837ec9a427`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 16:46:27,311::task::579::TaskManager.Task::(_updateState) Task=`f1162132-e88f-4f2b-bb50-d66669ef6820`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:46:27,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:46:27,312::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:46:27,312::task::1168::TaskManager.Task::(prepare) Task=`f1162132-e88f-4f2b-bb50-d66669ef6820`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:46:27,312::task::579::TaskManager.Task::(_updateState) Task=`f1162132-e88f-4f2b-bb50-d66669ef6820`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:46:27,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:46:27,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:46:27,313::task::974::TaskManager.Task::(_decref) Task=`f1162132-e88f-4f2b-bb50-d66669ef6820`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:27,597::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:46:27,597::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:46:27,598::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:46:28,462::task::579::TaskManager.Task::(_updateState) Task=`bb49f319-3a73-41c3-885c-2590df5298d5`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:46:28,462::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:46:28,462::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:46:28,463::task::1168::TaskManager.Task::(prepare) Task=`bb49f319-3a73-41c3-885c-2590df5298d5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:46:28,463::task::579::TaskManager.Task::(_updateState) Task=`bb49f319-3a73-41c3-885c-2590df5298d5`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:46:28,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:46:28,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:46:28,463::task::974::TaskManager.Task::(_decref) Task=`bb49f319-3a73-41c3-885c-2590df5298d5`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:46:28,464::task::579::TaskManager.Task::(_updateState) Task=`414ba488-37ed-4edc-a4e4-dabfb4a5f58d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:46:28,464::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:46:28,464::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:46:28,464::task::1168::TaskManager.Task::(prepare) Task=`414ba488-37ed-4edc-a4e4-dabfb4a5f58d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:46:28,464::task::579::TaskManager.Task::(_updateState) Task=`414ba488-37ed-4edc-a4e4-dabfb4a5f58d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:46:28,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:46:28,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:46:28,465::task::974::TaskManager.Task::(_decref) Task=`414ba488-37ed-4edc-a4e4-dabfb4a5f58d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:28,599::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:46:28,599::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:28,805::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:29,600::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:46:29,600::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:29,808::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:46:29,808::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:46:29,811::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:46:30,085::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:46:30,104::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260733 s, 15.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:46:30,359::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:46:30,376::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000265298 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:46:30,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:30,812::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:46:31,003::task::579::TaskManager.Task::(_updateState) Task=`4d19e34d-dc27-4fbf-bb73-1cbe22ca0797`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:46:31,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:46:31,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:46:31,004::task::1168::TaskManager.Task::(prepare) Task=`4d19e34d-dc27-4fbf-bb73-1cbe22ca0797`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:46:31,004::task::579::TaskManager.Task::(_updateState) Task=`4d19e34d-dc27-4fbf-bb73-1cbe22ca0797`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:46:31,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:46:31,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:46:31,005::task::974::TaskManager.Task::(_decref) Task=`4d19e34d-dc27-4fbf-bb73-1cbe22ca0797`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:46:31,027::task::579::TaskManager.Task::(_updateState) Task=`bc341eae-1af4-447c-b801-f65a16d3d599`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:46:31,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:46:31,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:46:31,028::task::1168::TaskManager.Task::(prepare) Task=`bc341eae-1af4-447c-b801-f65a16d3d599`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:46:31,028::task::579::TaskManager.Task::(_updateState) Task=`bc341eae-1af4-447c-b801-f65a16d3d599`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:46:31,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:46:31,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:46:31,028::task::974::TaskManager.Task::(_decref) Task=`bc341eae-1af4-447c-b801-f65a16d3d599`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:31,603::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:46:31,603::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:32,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:46:32,604::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:32,813::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:33,605::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:46:33,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:46:33,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:46:33,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:34,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:46:34,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:46:34,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:34,814::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:34,815::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:35,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:46:35,609::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:46:36,008::task::579::TaskManager.Task::(_updateState) Task=`00150295-6f33-4497-8de2-d49d814c9e21`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:46:36,008::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:46:36,009::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:46:36,009::task::1168::TaskManager.Task::(prepare) Task=`00150295-6f33-4497-8de2-d49d814c9e21`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:46:36,009::task::579::TaskManager.Task::(_updateState) Task=`00150295-6f33-4497-8de2-d49d814c9e21`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:46:36,009::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:46:36,009::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:46:36,010::task::974::TaskManager.Task::(_decref) Task=`00150295-6f33-4497-8de2-d49d814c9e21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:36,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:46:36,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:46:36,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:46:36,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:36,817::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:37,612::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:46:38,441::task::579::TaskManager.Task::(_updateState) Task=`3ec1c925-0999-4e6e-9e01-8dad0093d410`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:46:38,441::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:46:38,441::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:46:38,441::task::1168::TaskManager.Task::(prepare) Task=`3ec1c925-0999-4e6e-9e01-8dad0093d410`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:46:38,442::task::579::TaskManager.Task::(_updateState) Task=`3ec1c925-0999-4e6e-9e01-8dad0093d410`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:46:38,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:46:38,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:46:38,442::task::974::TaskManager.Task::(_decref) Task=`3ec1c925-0999-4e6e-9e01-8dad0093d410`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:38,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:46:38,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:46:38,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:46:38,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:38,614::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:46:38,616::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:46:38,818::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:46:39,318::task::579::TaskManager.Task::(_updateState) Task=`077aa806-c0a8-406a-af01-4c6d3a28c3c1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:46:39,319::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:46:39,319::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:46:39,319::task::1168::TaskManager.Task::(prepare) Task=`077aa806-c0a8-406a-af01-4c6d3a28c3c1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:46:39,319::task::579::TaskManager.Task::(_updateState) Task=`077aa806-c0a8-406a-af01-4c6d3a28c3c1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:46:39,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:46:39,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:46:39,320::task::579::TaskManager.Task::(_updateState) Task=`4b4219d7-0960-4089-ac5c-b73e68fce465`::moving from state init -> state preparing >Thread-16393::DEBUG::2014-01-16 16:46:39,320::task::974::TaskManager.Task::(_decref) Task=`077aa806-c0a8-406a-af01-4c6d3a28c3c1`::ref 0 aborting False >Thread-16398::INFO::2014-01-16 16:46:39,320::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:46:39,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:46:39,321::task::1168::TaskManager.Task::(prepare) Task=`4b4219d7-0960-4089-ac5c-b73e68fce465`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:46:39,321::task::579::TaskManager.Task::(_updateState) Task=`4b4219d7-0960-4089-ac5c-b73e68fce465`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:46:39,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:46:39,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:46:39,321::task::974::TaskManager.Task::(_decref) Task=`4b4219d7-0960-4089-ac5c-b73e68fce465`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:46:39,480::task::579::TaskManager.Task::(_updateState) Task=`ffc39a7c-1aa2-4e28-8e88-a931d45c600c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:46:39,480::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:46:39,480::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:46:39,480::task::1168::TaskManager.Task::(prepare) Task=`ffc39a7c-1aa2-4e28-8e88-a931d45c600c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:46:39,481::task::579::TaskManager.Task::(_updateState) Task=`ffc39a7c-1aa2-4e28-8e88-a931d45c600c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:46:39,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:46:39,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:46:39,481::task::974::TaskManager.Task::(_decref) Task=`ffc39a7c-1aa2-4e28-8e88-a931d45c600c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:39,617::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:39,820::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:46:40,111::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:46:40,130::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000191777 s, 21.4 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 16:46:40,276::task::579::TaskManager.Task::(_updateState) Task=`c1242a1c-a246-48f9-995d-3090b3608d44`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:46:40,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:46:40,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:46:40,277::task::1168::TaskManager.Task::(prepare) Task=`c1242a1c-a246-48f9-995d-3090b3608d44`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:46:40,277::task::579::TaskManager.Task::(_updateState) Task=`c1242a1c-a246-48f9-995d-3090b3608d44`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:46:40,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:46:40,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:46:40,278::task::974::TaskManager.Task::(_decref) Task=`c1242a1c-a246-48f9-995d-3090b3608d44`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:46:40,385::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:46:40,401::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289167 s, 1.3 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:46:40,457::task::579::TaskManager.Task::(_updateState) Task=`2c57b58f-cf50-476d-9ef3-80e1c520c5fa`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:46:40,458::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:46:40,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:46:40,458::task::1168::TaskManager.Task::(prepare) Task=`2c57b58f-cf50-476d-9ef3-80e1c520c5fa`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:46:40,458::task::579::TaskManager.Task::(_updateState) Task=`2c57b58f-cf50-476d-9ef3-80e1c520c5fa`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:46:40,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:46:40,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:46:40,459::task::974::TaskManager.Task::(_decref) Task=`2c57b58f-cf50-476d-9ef3-80e1c520c5fa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:40,618::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:46:40,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:46:40,619::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:40,821::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:41,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:46:41,621::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:46:41,621::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:42,622::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:46:42,622::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:46:42,622::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:46:42,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:42,823::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287061::DEBUG::2014-01-16 16:46:42,958::task::579::TaskManager.Task::(_updateState) Task=`9be0dfd6-8bcc-43a4-90b2-022a122f7178`::moving from state init -> state preparing >Thread-287061::INFO::2014-01-16 16:46:42,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287061::INFO::2014-01-16 16:46:42,958::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289167', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000191777', 'lastCheck': '2.8', 'valid': True}} >Thread-287061::DEBUG::2014-01-16 16:46:42,958::task::1168::TaskManager.Task::(prepare) Task=`9be0dfd6-8bcc-43a4-90b2-022a122f7178`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289167', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000191777', 'lastCheck': '2.8', 'valid': True}} >Thread-287061::DEBUG::2014-01-16 16:46:42,958::task::579::TaskManager.Task::(_updateState) Task=`9be0dfd6-8bcc-43a4-90b2-022a122f7178`::moving from state preparing -> state finished >Thread-287061::DEBUG::2014-01-16 16:46:42,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287061::DEBUG::2014-01-16 16:46:42,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287061::DEBUG::2014-01-16 16:46:42,959::task::974::TaskManager.Task::(_decref) Task=`9be0dfd6-8bcc-43a4-90b2-022a122f7178`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:43,624::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:46:44,452::task::579::TaskManager.Task::(_updateState) Task=`0ca5ffa6-792a-46da-85b2-362074450f54`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:46:44,453::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:46:44,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:46:44,453::task::1168::TaskManager.Task::(prepare) Task=`0ca5ffa6-792a-46da-85b2-362074450f54`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:46:44,453::task::579::TaskManager.Task::(_updateState) Task=`0ca5ffa6-792a-46da-85b2-362074450f54`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:46:44,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:46:44,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:46:44,454::task::974::TaskManager.Task::(_decref) Task=`0ca5ffa6-792a-46da-85b2-362074450f54`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:46:44,454::task::579::TaskManager.Task::(_updateState) Task=`c792b4f0-faee-48d0-a9da-0d5512fa89bc`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:46:44,454::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:46:44,454::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:46:44,454::task::1168::TaskManager.Task::(prepare) Task=`c792b4f0-faee-48d0-a9da-0d5512fa89bc`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:46:44,455::task::579::TaskManager.Task::(_updateState) Task=`c792b4f0-faee-48d0-a9da-0d5512fa89bc`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:46:44,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:46:44,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:46:44,455::task::974::TaskManager.Task::(_decref) Task=`c792b4f0-faee-48d0-a9da-0d5512fa89bc`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:46:44,455::task::579::TaskManager.Task::(_updateState) Task=`a18547ae-4792-4905-b290-b74f4c362c52`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:46:44,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:46:44,456::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:46:44,456::task::1168::TaskManager.Task::(prepare) Task=`a18547ae-4792-4905-b290-b74f4c362c52`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:46:44,456::task::579::TaskManager.Task::(_updateState) Task=`a18547ae-4792-4905-b290-b74f4c362c52`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:46:44,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:46:44,456::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:46:44,456::task::974::TaskManager.Task::(_decref) Task=`a18547ae-4792-4905-b290-b74f4c362c52`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:44,625::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:46:44,625::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:44,825::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:44,827::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:46:44,828::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:46:44,829::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:45,626::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:46,627::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:46,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:47,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:46:48,147::task::579::TaskManager.Task::(_updateState) Task=`9815630c-5bca-467c-9316-7ee1b5c7c5d5`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:46:48,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:46:48,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:46:48,148::task::1168::TaskManager.Task::(prepare) Task=`9815630c-5bca-467c-9316-7ee1b5c7c5d5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:46:48,148::task::579::TaskManager.Task::(_updateState) Task=`9815630c-5bca-467c-9316-7ee1b5c7c5d5`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:46:48,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:46:48,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:46:48,148::task::974::TaskManager.Task::(_decref) Task=`9815630c-5bca-467c-9316-7ee1b5c7c5d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:48,629::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:48,832::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:49,630::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:49,833::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:46:50,136::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:46:50,152::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000262076 s, 15.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:46:50,410::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:46:50,426::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000298945 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:46:50,631::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:46:50,631::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:50,834::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:51,632::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:52,633::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:52,836::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:46:52,884::task::579::TaskManager.Task::(_updateState) Task=`6af0bb9f-a1ca-45ea-9003-57bcce199615`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:46:52,884::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:46:52,884::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:46:52,884::task::1168::TaskManager.Task::(prepare) Task=`6af0bb9f-a1ca-45ea-9003-57bcce199615`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:46:52,885::task::579::TaskManager.Task::(_updateState) Task=`6af0bb9f-a1ca-45ea-9003-57bcce199615`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:46:52,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:46:52,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:46:52,885::task::974::TaskManager.Task::(_decref) Task=`6af0bb9f-a1ca-45ea-9003-57bcce199615`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:53,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:54,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:54,837::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:46:54,838::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:55,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:46:55,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:46:55,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:56,638::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:46:56,638::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:56,840::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:46:57,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:46:57,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:46:57,639::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:46:58,641::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:46:58,641::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287067::DEBUG::2014-01-16 16:46:58,795::task::579::TaskManager.Task::(_updateState) Task=`61195946-7b3b-4e48-8791-6edfcd141420`::moving from state init -> state preparing >Thread-287067::INFO::2014-01-16 16:46:58,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287067::INFO::2014-01-16 16:46:58,796::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298945', 'lastCheck': '8.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262076', 'lastCheck': '8.6', 'valid': True}} >Thread-287067::DEBUG::2014-01-16 16:46:58,796::task::1168::TaskManager.Task::(prepare) Task=`61195946-7b3b-4e48-8791-6edfcd141420`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298945', 'lastCheck': '8.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262076', 'lastCheck': '8.6', 'valid': True}} >Thread-287067::DEBUG::2014-01-16 16:46:58,796::task::579::TaskManager.Task::(_updateState) Task=`61195946-7b3b-4e48-8791-6edfcd141420`::moving from state preparing -> state finished >Thread-287067::DEBUG::2014-01-16 16:46:58,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287067::DEBUG::2014-01-16 16:46:58,797::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287067::DEBUG::2014-01-16 16:46:58,797::task::974::TaskManager.Task::(_decref) Task=`61195946-7b3b-4e48-8791-6edfcd141420`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:46:58,847::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:46:59,512::task::579::TaskManager.Task::(_updateState) Task=`33f25c86-5886-4e25-bb79-8407f3cf30ed`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:46:59,512::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:46:59,513::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:46:59,513::task::1168::TaskManager.Task::(prepare) Task=`33f25c86-5886-4e25-bb79-8407f3cf30ed`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:46:59,513::task::579::TaskManager.Task::(_updateState) Task=`33f25c86-5886-4e25-bb79-8407f3cf30ed`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:46:59,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:46:59,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:46:59,513::task::974::TaskManager.Task::(_decref) Task=`33f25c86-5886-4e25-bb79-8407f3cf30ed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:46:59,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:46:59,642::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:46:59,849::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:46:59,849::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:46:59,851::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:47:00,158::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:47:00,176::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000215561 s, 19.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:47:00,434::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:47:00,450::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00030239 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:47:00,644::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:00,852::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:01,645::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:47:01,645::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:02,647::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:47:02,647::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:02,853::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:03,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:47:03,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:47:03,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:47:03,649::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:04,650::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:47:04,650::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:47:04,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:04,854::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:04,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:47:05,156::task::579::TaskManager.Task::(_updateState) Task=`9497b0b9-fdf2-4a40-b531-32928cd96e04`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:47:05,157::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:47:05,157::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:47:05,157::task::1168::TaskManager.Task::(prepare) Task=`9497b0b9-fdf2-4a40-b531-32928cd96e04`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:47:05,157::task::579::TaskManager.Task::(_updateState) Task=`9497b0b9-fdf2-4a40-b531-32928cd96e04`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:47:05,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:47:05,158::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:47:05,158::task::974::TaskManager.Task::(_decref) Task=`9497b0b9-fdf2-4a40-b531-32928cd96e04`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:47:05,158::task::579::TaskManager.Task::(_updateState) Task=`5605c344-ce29-4e32-b90d-89d69d03ce45`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:47:05,158::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:47:05,158::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:47:05,159::task::1168::TaskManager.Task::(prepare) Task=`5605c344-ce29-4e32-b90d-89d69d03ce45`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:47:05,159::task::579::TaskManager.Task::(_updateState) Task=`5605c344-ce29-4e32-b90d-89d69d03ce45`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:47:05,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:47:05,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:47:05,159::task::974::TaskManager.Task::(_decref) Task=`5605c344-ce29-4e32-b90d-89d69d03ce45`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:05,652::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:47:05,652::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:47:06,102::task::579::TaskManager.Task::(_updateState) Task=`a8a676d2-4e45-45c6-bf7b-36c8c90d3924`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:47:06,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:47:06,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:47:06,103::task::1168::TaskManager.Task::(prepare) Task=`a8a676d2-4e45-45c6-bf7b-36c8c90d3924`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:47:06,104::task::579::TaskManager.Task::(_updateState) Task=`a8a676d2-4e45-45c6-bf7b-36c8c90d3924`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:47:06,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:47:06,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:47:06,104::task::974::TaskManager.Task::(_decref) Task=`a8a676d2-4e45-45c6-bf7b-36c8c90d3924`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:47:06,119::task::579::TaskManager.Task::(_updateState) Task=`a3299691-e091-4b4e-9675-c5ef64d35941`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:47:06,119::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:47:06,121::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:47:06,121::task::1168::TaskManager.Task::(prepare) Task=`a3299691-e091-4b4e-9675-c5ef64d35941`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:47:06,121::task::579::TaskManager.Task::(_updateState) Task=`a3299691-e091-4b4e-9675-c5ef64d35941`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:47:06,121::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:47:06,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:47:06,121::task::974::TaskManager.Task::(_decref) Task=`a3299691-e091-4b4e-9675-c5ef64d35941`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:47:06,497::task::579::TaskManager.Task::(_updateState) Task=`c7b8eed5-0418-43c4-91fc-fb68eaafbbc8`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:47:06,497::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:47:06,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:47:06,498::task::1168::TaskManager.Task::(prepare) Task=`c7b8eed5-0418-43c4-91fc-fb68eaafbbc8`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:47:06,498::task::579::TaskManager.Task::(_updateState) Task=`c7b8eed5-0418-43c4-91fc-fb68eaafbbc8`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:47:06,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:47:06,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:47:06,498::task::974::TaskManager.Task::(_decref) Task=`c7b8eed5-0418-43c4-91fc-fb68eaafbbc8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:06,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:47:06,654::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:47:06,654::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:47:06,654::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:06,856::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:47:07,528::task::579::TaskManager.Task::(_updateState) Task=`e1e8f405-b394-40c0-a113-765c737efa81`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:47:07,528::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:47:07,528::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:47:07,529::task::1168::TaskManager.Task::(prepare) Task=`e1e8f405-b394-40c0-a113-765c737efa81`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:47:07,529::task::579::TaskManager.Task::(_updateState) Task=`e1e8f405-b394-40c0-a113-765c737efa81`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:47:07,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:47:07,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:47:07,529::task::974::TaskManager.Task::(_decref) Task=`e1e8f405-b394-40c0-a113-765c737efa81`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:47:07,529::task::579::TaskManager.Task::(_updateState) Task=`0e7e691a-3d55-431a-bd10-3bfa41b65270`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:47:07,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:47:07,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:47:07,530::task::1168::TaskManager.Task::(prepare) Task=`0e7e691a-3d55-431a-bd10-3bfa41b65270`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:47:07,530::task::579::TaskManager.Task::(_updateState) Task=`0e7e691a-3d55-431a-bd10-3bfa41b65270`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:47:07,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:47:07,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:47:07,531::task::974::TaskManager.Task::(_decref) Task=`0e7e691a-3d55-431a-bd10-3bfa41b65270`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:47:07,531::task::579::TaskManager.Task::(_updateState) Task=`97351688-1f9d-4b8c-b8ae-1bb4f56958cb`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:47:07,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:47:07,531::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:47:07,531::task::1168::TaskManager.Task::(prepare) Task=`97351688-1f9d-4b8c-b8ae-1bb4f56958cb`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:47:07,532::task::579::TaskManager.Task::(_updateState) Task=`97351688-1f9d-4b8c-b8ae-1bb4f56958cb`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:47:07,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:47:07,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:47:07,532::task::974::TaskManager.Task::(_decref) Task=`97351688-1f9d-4b8c-b8ae-1bb4f56958cb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:07,655::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:47:07,750::task::579::TaskManager.Task::(_updateState) Task=`3ca62be1-1d65-4982-9d09-c0553babf88f`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:47:07,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:47:07,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:47:07,751::task::1168::TaskManager.Task::(prepare) Task=`3ca62be1-1d65-4982-9d09-c0553babf88f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:47:07,751::task::579::TaskManager.Task::(_updateState) Task=`3ca62be1-1d65-4982-9d09-c0553babf88f`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:47:07,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:47:07,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:47:07,752::task::974::TaskManager.Task::(_decref) Task=`3ca62be1-1d65-4982-9d09-c0553babf88f`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:47:07,752::task::579::TaskManager.Task::(_updateState) Task=`b731a950-f27b-420a-8fa6-f5c88d3e1082`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:47:07,752::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:47:07,753::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:47:07,753::task::1168::TaskManager.Task::(prepare) Task=`b731a950-f27b-420a-8fa6-f5c88d3e1082`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:47:07,753::task::579::TaskManager.Task::(_updateState) Task=`b731a950-f27b-420a-8fa6-f5c88d3e1082`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:47:07,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:47:07,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:47:07,753::task::974::TaskManager.Task::(_decref) Task=`b731a950-f27b-420a-8fa6-f5c88d3e1082`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:08,656::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:47:08,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:47:08,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:47:08,657::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:08,657::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:47:08,657::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:47:08,858::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:09,658::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:09,859::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:47:10,181::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:47:10,197::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000280055 s, 14.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:47:10,459::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:47:10,475::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000280381 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:47:10,504::task::579::TaskManager.Task::(_updateState) Task=`bf2a5a3b-c09a-4b77-881c-0e23c23aba78`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:47:10,504::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:47:10,504::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:47:10,505::task::1168::TaskManager.Task::(prepare) Task=`bf2a5a3b-c09a-4b77-881c-0e23c23aba78`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:47:10,505::task::579::TaskManager.Task::(_updateState) Task=`bf2a5a3b-c09a-4b77-881c-0e23c23aba78`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:47:10,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:47:10,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:47:10,505::task::974::TaskManager.Task::(_decref) Task=`bf2a5a3b-c09a-4b77-881c-0e23c23aba78`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:47:10,642::task::579::TaskManager.Task::(_updateState) Task=`a6aa2da8-9eca-42f5-8576-2732575c272d`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:47:10,642::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:47:10,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:47:10,643::task::1168::TaskManager.Task::(prepare) Task=`a6aa2da8-9eca-42f5-8576-2732575c272d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:47:10,643::task::579::TaskManager.Task::(_updateState) Task=`a6aa2da8-9eca-42f5-8576-2732575c272d`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:47:10,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:47:10,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:47:10,643::task::974::TaskManager.Task::(_decref) Task=`a6aa2da8-9eca-42f5-8576-2732575c272d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:10,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:47:10,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:47:10,660::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:10,861::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:47:11,149::task::579::TaskManager.Task::(_updateState) Task=`f7610850-da09-4266-be1e-b1ea2faa5931`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:47:11,149::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:47:11,149::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:47:11,150::task::1168::TaskManager.Task::(prepare) Task=`f7610850-da09-4266-be1e-b1ea2faa5931`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:47:11,150::task::579::TaskManager.Task::(_updateState) Task=`f7610850-da09-4266-be1e-b1ea2faa5931`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:47:11,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:47:11,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:47:11,150::task::974::TaskManager.Task::(_decref) Task=`f7610850-da09-4266-be1e-b1ea2faa5931`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:47:11,151::task::579::TaskManager.Task::(_updateState) Task=`2477776c-3bfc-4c93-bd7c-b4d5cb7aa58f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:47:11,151::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:47:11,151::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:47:11,151::task::1168::TaskManager.Task::(prepare) Task=`2477776c-3bfc-4c93-bd7c-b4d5cb7aa58f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:47:11,152::task::579::TaskManager.Task::(_updateState) Task=`2477776c-3bfc-4c93-bd7c-b4d5cb7aa58f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:47:11,152::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:47:11,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:47:11,152::task::974::TaskManager.Task::(_decref) Task=`2477776c-3bfc-4c93-bd7c-b4d5cb7aa58f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:11,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:47:11,661::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:47:11,661::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:47:11,927::task::579::TaskManager.Task::(_updateState) Task=`381747e9-cbcc-427d-88bb-d9a6ebc886ae`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:47:11,928::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:47:11,928::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:47:11,928::task::1168::TaskManager.Task::(prepare) Task=`381747e9-cbcc-427d-88bb-d9a6ebc886ae`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:47:11,928::task::579::TaskManager.Task::(_updateState) Task=`381747e9-cbcc-427d-88bb-d9a6ebc886ae`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:47:11,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:47:11,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:47:11,929::task::974::TaskManager.Task::(_decref) Task=`381747e9-cbcc-427d-88bb-d9a6ebc886ae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:12,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:47:12,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:47:12,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:47:12,662::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:12,862::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:47:12,888::task::579::TaskManager.Task::(_updateState) Task=`23dc6e3c-a89b-49ae-a60b-13b5cb93e513`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:47:12,888::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:47:12,889::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:47:12,889::task::1168::TaskManager.Task::(prepare) Task=`23dc6e3c-a89b-49ae-a60b-13b5cb93e513`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:47:12,889::task::579::TaskManager.Task::(_updateState) Task=`23dc6e3c-a89b-49ae-a60b-13b5cb93e513`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:47:12,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:47:12,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:47:12,889::task::974::TaskManager.Task::(_decref) Task=`23dc6e3c-a89b-49ae-a60b-13b5cb93e513`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:13,663::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287073::DEBUG::2014-01-16 16:47:14,544::task::579::TaskManager.Task::(_updateState) Task=`6244b954-5ab4-42d2-83f4-402af120d71e`::moving from state init -> state preparing >Thread-287073::INFO::2014-01-16 16:47:14,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287073::INFO::2014-01-16 16:47:14,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000280381', 'lastCheck': '4.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280055', 'lastCheck': '4.3', 'valid': True}} >Thread-287073::DEBUG::2014-01-16 16:47:14,545::task::1168::TaskManager.Task::(prepare) Task=`6244b954-5ab4-42d2-83f4-402af120d71e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000280381', 'lastCheck': '4.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280055', 'lastCheck': '4.3', 'valid': True}} >Thread-287073::DEBUG::2014-01-16 16:47:14,545::task::579::TaskManager.Task::(_updateState) Task=`6244b954-5ab4-42d2-83f4-402af120d71e`::moving from state preparing -> state finished >Thread-287073::DEBUG::2014-01-16 16:47:14,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287073::DEBUG::2014-01-16 16:47:14,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287073::DEBUG::2014-01-16 16:47:14,546::task::974::TaskManager.Task::(_decref) Task=`6244b954-5ab4-42d2-83f4-402af120d71e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:14,664::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:47:14,664::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:14,863::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:14,864::task::579::TaskManager.Task::(_updateState) Task=`8454bfa6-ad60-4cd9-b225-fdf79ad28fb4`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:47:14,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:47:14,864::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:47:14,865::task::1168::TaskManager.Task::(prepare) Task=`8454bfa6-ad60-4cd9-b225-fdf79ad28fb4`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:47:14,865::task::579::TaskManager.Task::(_updateState) Task=`8454bfa6-ad60-4cd9-b225-fdf79ad28fb4`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:47:14,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:47:14,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:47:14,865::task::974::TaskManager.Task::(_decref) Task=`8454bfa6-ad60-4cd9-b225-fdf79ad28fb4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:47:14,867::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:47:14,867::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:47:14,868::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:14,870::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:14,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:15,665::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:47:16,147::task::579::TaskManager.Task::(_updateState) Task=`08842066-b302-4c0d-a8c5-3a80b544e7ed`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:47:16,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:47:16,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:47:16,148::task::1168::TaskManager.Task::(prepare) Task=`08842066-b302-4c0d-a8c5-3a80b544e7ed`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:47:16,148::task::579::TaskManager.Task::(_updateState) Task=`08842066-b302-4c0d-a8c5-3a80b544e7ed`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:47:16,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:47:16,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:47:16,148::task::974::TaskManager.Task::(_decref) Task=`08842066-b302-4c0d-a8c5-3a80b544e7ed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:16,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:16,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:47:17,523::task::579::TaskManager.Task::(_updateState) Task=`b8e94eef-40ae-498d-be41-d5ce959c904d`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:47:17,524::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:47:17,525::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:47:17,525::task::1168::TaskManager.Task::(prepare) Task=`b8e94eef-40ae-498d-be41-d5ce959c904d`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:47:17,525::task::579::TaskManager.Task::(_updateState) Task=`b8e94eef-40ae-498d-be41-d5ce959c904d`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:47:17,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:47:17,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:47:17,525::task::974::TaskManager.Task::(_decref) Task=`b8e94eef-40ae-498d-be41-d5ce959c904d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:17,668::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:18,669::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:18,873::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:47:19,592::task::579::TaskManager.Task::(_updateState) Task=`f324b376-160d-4db7-a3f1-8227ac7571bf`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:47:19,593::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:47:19,593::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:47:19,593::task::1168::TaskManager.Task::(prepare) Task=`f324b376-160d-4db7-a3f1-8227ac7571bf`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:47:19,593::task::579::TaskManager.Task::(_updateState) Task=`f324b376-160d-4db7-a3f1-8227ac7571bf`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:47:19,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:47:19,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:47:19,594::task::974::TaskManager.Task::(_decref) Task=`f324b376-160d-4db7-a3f1-8227ac7571bf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:19,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:19,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:47:20,203::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:47:20,220::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000291932 s, 14.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:47:20,483::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:47:20,500::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266461 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:47:20,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:47:20,672::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:20,876::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:21,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:22,674::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:22,877::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:23,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:24,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:24,879::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:24,879::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:47:25,557::task::579::TaskManager.Task::(_updateState) Task=`f2e07411-71b6-40b0-b74a-ce3609dedd00`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:47:25,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:47:25,558::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:47:25,559::task::1168::TaskManager.Task::(prepare) Task=`f2e07411-71b6-40b0-b74a-ce3609dedd00`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:47:25,559::task::579::TaskManager.Task::(_updateState) Task=`f2e07411-71b6-40b0-b74a-ce3609dedd00`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:47:25,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:47:25,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:47:25,559::task::974::TaskManager.Task::(_decref) Task=`f2e07411-71b6-40b0-b74a-ce3609dedd00`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:25,677::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:47:25,678::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:47:25,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:26,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:47:26,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:26,881::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:47:27,496::task::579::TaskManager.Task::(_updateState) Task=`313d43b8-0592-41f3-b6c9-8b3b7dc25c4a`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:47:27,497::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:47:27,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:47:27,497::task::1168::TaskManager.Task::(prepare) Task=`313d43b8-0592-41f3-b6c9-8b3b7dc25c4a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:47:27,498::task::579::TaskManager.Task::(_updateState) Task=`313d43b8-0592-41f3-b6c9-8b3b7dc25c4a`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:47:27,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:47:27,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:47:27,498::task::974::TaskManager.Task::(_decref) Task=`313d43b8-0592-41f3-b6c9-8b3b7dc25c4a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:27,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:47:27,681::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:47:27,681::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:28,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:47:28,682::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:47:28,839::task::579::TaskManager.Task::(_updateState) Task=`5809c0c0-5d9b-42a9-b233-dc2d86dc41ce`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:47:28,839::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:47:28,840::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:47:28,840::task::1168::TaskManager.Task::(prepare) Task=`5809c0c0-5d9b-42a9-b233-dc2d86dc41ce`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:47:28,840::task::579::TaskManager.Task::(_updateState) Task=`5809c0c0-5d9b-42a9-b233-dc2d86dc41ce`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:47:28,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:47:28,840::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:47:28,840::task::974::TaskManager.Task::(_decref) Task=`5809c0c0-5d9b-42a9-b233-dc2d86dc41ce`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:47:28,841::task::579::TaskManager.Task::(_updateState) Task=`b44562a0-8ca6-48fe-8d67-b4eac467cd26`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:47:28,841::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:47:28,841::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:47:28,841::task::1168::TaskManager.Task::(prepare) Task=`b44562a0-8ca6-48fe-8d67-b4eac467cd26`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:47:28,841::task::579::TaskManager.Task::(_updateState) Task=`b44562a0-8ca6-48fe-8d67-b4eac467cd26`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:47:28,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:47:28,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:47:28,842::task::974::TaskManager.Task::(_decref) Task=`b44562a0-8ca6-48fe-8d67-b4eac467cd26`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:47:28,883::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:29,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:47:29,683::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:29,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:47:29,885::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:47:29,886::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:47:30,225::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:47:30,242::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000253457 s, 16.2 MB/s\n'; <rc> = 0 >Thread-287079::DEBUG::2014-01-16 16:47:30,323::task::579::TaskManager.Task::(_updateState) Task=`10886191-c363-4652-8af0-272031176b63`::moving from state init -> state preparing >Thread-287079::INFO::2014-01-16 16:47:30,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287079::INFO::2014-01-16 16:47:30,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266461', 'lastCheck': '9.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253457', 'lastCheck': '0.1', 'valid': True}} >Thread-287079::DEBUG::2014-01-16 16:47:30,324::task::1168::TaskManager.Task::(prepare) Task=`10886191-c363-4652-8af0-272031176b63`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266461', 'lastCheck': '9.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253457', 'lastCheck': '0.1', 'valid': True}} >Thread-287079::DEBUG::2014-01-16 16:47:30,324::task::579::TaskManager.Task::(_updateState) Task=`10886191-c363-4652-8af0-272031176b63`::moving from state preparing -> state finished >Thread-287079::DEBUG::2014-01-16 16:47:30,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287079::DEBUG::2014-01-16 16:47:30,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287079::DEBUG::2014-01-16 16:47:30,325::task::974::TaskManager.Task::(_decref) Task=`10886191-c363-4652-8af0-272031176b63`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:47:30,508::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:47:30,526::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000324095 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:47:30,684::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:30,887::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:47:31,176::task::579::TaskManager.Task::(_updateState) Task=`b13d2fc1-60e0-4433-b217-f9d0e60e5ea6`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:47:31,176::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:47:31,177::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:47:31,177::task::1168::TaskManager.Task::(prepare) Task=`b13d2fc1-60e0-4433-b217-f9d0e60e5ea6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:47:31,177::task::579::TaskManager.Task::(_updateState) Task=`b13d2fc1-60e0-4433-b217-f9d0e60e5ea6`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:47:31,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:47:31,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:47:31,178::task::974::TaskManager.Task::(_decref) Task=`b13d2fc1-60e0-4433-b217-f9d0e60e5ea6`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:47:31,198::task::579::TaskManager.Task::(_updateState) Task=`2b116061-5bfe-48c0-8beb-cbbb514781b3`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:47:31,198::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:47:31,199::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:47:31,199::task::1168::TaskManager.Task::(prepare) Task=`2b116061-5bfe-48c0-8beb-cbbb514781b3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:47:31,199::task::579::TaskManager.Task::(_updateState) Task=`2b116061-5bfe-48c0-8beb-cbbb514781b3`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:47:31,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:47:31,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:47:31,199::task::974::TaskManager.Task::(_decref) Task=`2b116061-5bfe-48c0-8beb-cbbb514781b3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:31,685::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:47:31,686::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:32,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:47:32,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:32,889::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:33,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:47:33,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:47:33,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:47:33,689::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:34,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:47:34,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:47:34,690::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:34,890::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:34,891::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:35,691::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:47:35,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:47:36,191::task::579::TaskManager.Task::(_updateState) Task=`b7811be4-5bc4-49ab-aee0-919bd72bf58c`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:47:36,192::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:47:36,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:47:36,192::task::1168::TaskManager.Task::(prepare) Task=`b7811be4-5bc4-49ab-aee0-919bd72bf58c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:47:36,192::task::579::TaskManager.Task::(_updateState) Task=`b7811be4-5bc4-49ab-aee0-919bd72bf58c`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:47:36,192::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:47:36,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:47:36,193::task::974::TaskManager.Task::(_decref) Task=`b7811be4-5bc4-49ab-aee0-919bd72bf58c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:36,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:47:36,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:47:36,693::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:47:36,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:36,892::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:37,694::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 16:47:38,605::task::579::TaskManager.Task::(_updateState) Task=`a2bf2644-5fda-4db8-b2ac-740b3f358dfd`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:47:38,605::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:47:38,606::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:47:38,606::task::1168::TaskManager.Task::(prepare) Task=`a2bf2644-5fda-4db8-b2ac-740b3f358dfd`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:47:38,606::task::579::TaskManager.Task::(_updateState) Task=`a2bf2644-5fda-4db8-b2ac-740b3f358dfd`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:47:38,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:47:38,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:47:38,606::task::974::TaskManager.Task::(_decref) Task=`a2bf2644-5fda-4db8-b2ac-740b3f358dfd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:38,695::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:47:38,695::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:47:38,696::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:47:38,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:38,696::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:47:38,697::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:47:38,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:47:39,529::task::579::TaskManager.Task::(_updateState) Task=`d36fde56-b4d5-4685-8bdd-8e5ab49ca673`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:47:39,529::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:47:39,529::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:47:39,529::task::1168::TaskManager.Task::(prepare) Task=`d36fde56-b4d5-4685-8bdd-8e5ab49ca673`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:47:39,529::task::579::TaskManager.Task::(_updateState) Task=`d36fde56-b4d5-4685-8bdd-8e5ab49ca673`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:47:39,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:47:39,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:47:39,530::task::974::TaskManager.Task::(_decref) Task=`d36fde56-b4d5-4685-8bdd-8e5ab49ca673`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:47:39,534::task::579::TaskManager.Task::(_updateState) Task=`85f6455f-d909-4916-b5a4-0d6365e8130c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:47:39,535::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:47:39,535::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:47:39,535::task::1168::TaskManager.Task::(prepare) Task=`85f6455f-d909-4916-b5a4-0d6365e8130c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:47:39,535::task::579::TaskManager.Task::(_updateState) Task=`85f6455f-d909-4916-b5a4-0d6365e8130c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:47:39,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:47:39,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:47:39,536::task::974::TaskManager.Task::(_decref) Task=`85f6455f-d909-4916-b5a4-0d6365e8130c`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:47:39,652::task::579::TaskManager.Task::(_updateState) Task=`f580cc64-a221-421b-ae3d-81ee4873d261`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:47:39,652::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:47:39,653::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:47:39,653::task::1168::TaskManager.Task::(prepare) Task=`f580cc64-a221-421b-ae3d-81ee4873d261`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:47:39,653::task::579::TaskManager.Task::(_updateState) Task=`f580cc64-a221-421b-ae3d-81ee4873d261`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:47:39,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:47:39,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:47:39,653::task::974::TaskManager.Task::(_decref) Task=`f580cc64-a221-421b-ae3d-81ee4873d261`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:39,698::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:39,894::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:47:40,248::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:47:40,265::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000198139 s, 20.7 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 16:47:40,441::task::579::TaskManager.Task::(_updateState) Task=`fb963433-abec-4f8e-b509-bb901ba04bd1`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:47:40,441::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:47:40,441::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:47:40,442::task::1168::TaskManager.Task::(prepare) Task=`fb963433-abec-4f8e-b509-bb901ba04bd1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:47:40,442::task::579::TaskManager.Task::(_updateState) Task=`fb963433-abec-4f8e-b509-bb901ba04bd1`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:47:40,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:47:40,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:47:40,442::task::974::TaskManager.Task::(_decref) Task=`fb963433-abec-4f8e-b509-bb901ba04bd1`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:47:40,535::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:47:40,552::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000294217 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:47:40,626::task::579::TaskManager.Task::(_updateState) Task=`709bad34-cf18-4504-99ba-cc2b5a56b7d8`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:47:40,626::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:47:40,627::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:47:40,627::task::1168::TaskManager.Task::(prepare) Task=`709bad34-cf18-4504-99ba-cc2b5a56b7d8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:47:40,627::task::579::TaskManager.Task::(_updateState) Task=`709bad34-cf18-4504-99ba-cc2b5a56b7d8`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:47:40,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:47:40,627::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:47:40,628::task::974::TaskManager.Task::(_decref) Task=`709bad34-cf18-4504-99ba-cc2b5a56b7d8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:40,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:47:40,700::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:47:40,700::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:40,896::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:41,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:47:41,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:47:41,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:42,702::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:47:42,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:47:42,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:47:42,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:42,897::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:43,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:44,706::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:47:44,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:47:44,729::task::579::TaskManager.Task::(_updateState) Task=`a155de19-41e8-411c-9c30-c4c46dcf9865`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:47:44,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:47:44,730::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:47:44,730::task::1168::TaskManager.Task::(prepare) Task=`a155de19-41e8-411c-9c30-c4c46dcf9865`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:47:44,730::task::579::TaskManager.Task::(_updateState) Task=`a155de19-41e8-411c-9c30-c4c46dcf9865`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:47:44,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:47:44,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:47:44,731::task::974::TaskManager.Task::(_decref) Task=`a155de19-41e8-411c-9c30-c4c46dcf9865`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:47:44,731::task::579::TaskManager.Task::(_updateState) Task=`00ce203d-59ed-429e-98ed-172faf8c888e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:47:44,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:47:44,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:47:44,732::task::1168::TaskManager.Task::(prepare) Task=`00ce203d-59ed-429e-98ed-172faf8c888e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:47:44,732::task::579::TaskManager.Task::(_updateState) Task=`00ce203d-59ed-429e-98ed-172faf8c888e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:47:44,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:47:44,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:47:44,732::task::974::TaskManager.Task::(_decref) Task=`00ce203d-59ed-429e-98ed-172faf8c888e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:47:44,732::task::579::TaskManager.Task::(_updateState) Task=`2e8ee04d-e46f-4902-bd37-722d2347dc45`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:47:44,733::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:47:44,733::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:47:44,733::task::1168::TaskManager.Task::(prepare) Task=`2e8ee04d-e46f-4902-bd37-722d2347dc45`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:47:44,733::task::579::TaskManager.Task::(_updateState) Task=`2e8ee04d-e46f-4902-bd37-722d2347dc45`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:47:44,733::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:47:44,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:47:44,734::task::974::TaskManager.Task::(_decref) Task=`2e8ee04d-e46f-4902-bd37-722d2347dc45`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:47:44,899::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:44,901::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:47:44,901::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:47:44,902::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:45,707::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287085::DEBUG::2014-01-16 16:47:46,070::task::579::TaskManager.Task::(_updateState) Task=`00a06062-c245-40e5-b8fc-7fd5c19c7f8c`::moving from state init -> state preparing >Thread-287085::INFO::2014-01-16 16:47:46,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287085::INFO::2014-01-16 16:47:46,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294217', 'lastCheck': '5.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000198139', 'lastCheck': '5.8', 'valid': True}} >Thread-287085::DEBUG::2014-01-16 16:47:46,070::task::1168::TaskManager.Task::(prepare) Task=`00a06062-c245-40e5-b8fc-7fd5c19c7f8c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294217', 'lastCheck': '5.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000198139', 'lastCheck': '5.8', 'valid': True}} >Thread-287085::DEBUG::2014-01-16 16:47:46,070::task::579::TaskManager.Task::(_updateState) Task=`00a06062-c245-40e5-b8fc-7fd5c19c7f8c`::moving from state preparing -> state finished >Thread-287085::DEBUG::2014-01-16 16:47:46,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287085::DEBUG::2014-01-16 16:47:46,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287085::DEBUG::2014-01-16 16:47:46,071::task::974::TaskManager.Task::(_decref) Task=`00a06062-c245-40e5-b8fc-7fd5c19c7f8c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:46,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:46,903::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:47,709::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:47:48,318::task::579::TaskManager.Task::(_updateState) Task=`c849a775-c1cf-489b-8816-6b775624bf30`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:47:48,319::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:47:48,319::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:47:48,319::task::1168::TaskManager.Task::(prepare) Task=`c849a775-c1cf-489b-8816-6b775624bf30`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:47:48,319::task::579::TaskManager.Task::(_updateState) Task=`c849a775-c1cf-489b-8816-6b775624bf30`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:47:48,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:47:48,319::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:47:48,320::task::974::TaskManager.Task::(_decref) Task=`c849a775-c1cf-489b-8816-6b775624bf30`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:48,711::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:48,905::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:49,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:49,906::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:47:50,271::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:47:50,287::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000324927 s, 12.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:47:50,560::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:47:50,577::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000299892 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:47:50,713::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:47:50,713::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:50,908::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:51,714::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:52,715::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:52,909::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:47:53,062::task::579::TaskManager.Task::(_updateState) Task=`a9c9e746-c470-40c2-95f8-c89ff8c709db`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:47:53,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:47:53,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:47:53,063::task::1168::TaskManager.Task::(prepare) Task=`a9c9e746-c470-40c2-95f8-c89ff8c709db`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:47:53,063::task::579::TaskManager.Task::(_updateState) Task=`a9c9e746-c470-40c2-95f8-c89ff8c709db`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:47:53,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:47:53,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:47:53,064::task::974::TaskManager.Task::(_decref) Task=`a9c9e746-c470-40c2-95f8-c89ff8c709db`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:53,716::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:54,717::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:54,910::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:47:54,911::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:55,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:47:55,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:47:55,718::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:56,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:47:56,720::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:56,913::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:47:57,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:47:57,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:47:57,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:47:58,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:47:58,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:58,915::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:47:59,676::task::579::TaskManager.Task::(_updateState) Task=`46ab503e-0b0d-42fd-8742-6527822a35c7`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:47:59,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:47:59,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:47:59,676::task::1168::TaskManager.Task::(prepare) Task=`46ab503e-0b0d-42fd-8742-6527822a35c7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:47:59,677::task::579::TaskManager.Task::(_updateState) Task=`46ab503e-0b0d-42fd-8742-6527822a35c7`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:47:59,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:47:59,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:47:59,677::task::974::TaskManager.Task::(_decref) Task=`46ab503e-0b0d-42fd-8742-6527822a35c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:47:59,724::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:47:59,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:47:59,916::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:47:59,917::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:47:59,918::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >libvirtEventLoop::DEBUG::2014-01-16 16:48:00,246::vm::2305::vm.Vm::(_rtcUpdate) vmId=`3ac853f1-a6ef-44aa-9695-5140e0d1b086`::new rtc offset -1 >Thread-22::DEBUG::2014-01-16 16:48:00,292::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:48:00,308::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210744 s, 19.4 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:48:00,588::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:48:00,607::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000265796 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:48:00,725::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:00,919::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >libvirtEventLoop::DEBUG::2014-01-16 16:48:01,660::vm::2262::vm.Vm::(onReboot) vmId=`3ac853f1-a6ef-44aa-9695-5140e0d1b086`::reboot event >VM Channels Listener::DEBUG::2014-01-16 16:48:01,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:48:01,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287091::DEBUG::2014-01-16 16:48:02,382::task::579::TaskManager.Task::(_updateState) Task=`4abbd182-b41f-4c00-902c-dbb5e5983615`::moving from state init -> state preparing >Thread-287091::INFO::2014-01-16 16:48:02,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287091::INFO::2014-01-16 16:48:02,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265796', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000210744', 'lastCheck': '2.1', 'valid': True}} >Thread-287091::DEBUG::2014-01-16 16:48:02,382::task::1168::TaskManager.Task::(prepare) Task=`4abbd182-b41f-4c00-902c-dbb5e5983615`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000265796', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000210744', 'lastCheck': '2.1', 'valid': True}} >Thread-287091::DEBUG::2014-01-16 16:48:02,382::task::579::TaskManager.Task::(_updateState) Task=`4abbd182-b41f-4c00-902c-dbb5e5983615`::moving from state preparing -> state finished >Thread-287091::DEBUG::2014-01-16 16:48:02,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287091::DEBUG::2014-01-16 16:48:02,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287091::DEBUG::2014-01-16 16:48:02,383::task::974::TaskManager.Task::(_decref) Task=`4abbd182-b41f-4c00-902c-dbb5e5983615`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:02,727::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:48:02,727::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:02,920::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:03,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:48:03,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:48:03,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:48:03,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:04,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:48:04,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:48:04,730::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:04,922::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:04,923::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:48:05,379::task::579::TaskManager.Task::(_updateState) Task=`206f1581-5ba4-44e1-973c-3aded6500993`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:48:05,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:48:05,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:48:05,380::task::1168::TaskManager.Task::(prepare) Task=`206f1581-5ba4-44e1-973c-3aded6500993`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:48:05,380::task::579::TaskManager.Task::(_updateState) Task=`206f1581-5ba4-44e1-973c-3aded6500993`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:48:05,380::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:48:05,380::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:48:05,380::task::974::TaskManager.Task::(_decref) Task=`206f1581-5ba4-44e1-973c-3aded6500993`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:48:05,381::task::579::TaskManager.Task::(_updateState) Task=`3952eaa5-770f-4559-883f-3281bcb9f9ae`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:48:05,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:48:05,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:48:05,381::task::1168::TaskManager.Task::(prepare) Task=`3952eaa5-770f-4559-883f-3281bcb9f9ae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:48:05,381::task::579::TaskManager.Task::(_updateState) Task=`3952eaa5-770f-4559-883f-3281bcb9f9ae`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:48:05,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:48:05,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:48:05,382::task::974::TaskManager.Task::(_decref) Task=`3952eaa5-770f-4559-883f-3281bcb9f9ae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:05,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:48:05,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287095::DEBUG::2014-01-16 16:48:06,032::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287095::DEBUG::2014-01-16 16:48:06,032::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '0.23', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.75', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >Thread-53040::DEBUG::2014-01-16 16:48:06,189::task::579::TaskManager.Task::(_updateState) Task=`5a061f58-57e8-4812-a136-f739d1fc0c8f`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:48:06,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:48:06,190::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:48:06,190::task::1168::TaskManager.Task::(prepare) Task=`5a061f58-57e8-4812-a136-f739d1fc0c8f`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:48:06,190::task::579::TaskManager.Task::(_updateState) Task=`5a061f58-57e8-4812-a136-f739d1fc0c8f`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:48:06,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:48:06,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:48:06,190::task::974::TaskManager.Task::(_decref) Task=`5a061f58-57e8-4812-a136-f739d1fc0c8f`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:48:06,197::task::579::TaskManager.Task::(_updateState) Task=`ac102940-e791-4539-942c-c667669249cc`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:48:06,197::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:48:06,198::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:48:06,198::task::1168::TaskManager.Task::(prepare) Task=`ac102940-e791-4539-942c-c667669249cc`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:48:06,198::task::579::TaskManager.Task::(_updateState) Task=`ac102940-e791-4539-942c-c667669249cc`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:48:06,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:48:06,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:48:06,198::task::974::TaskManager.Task::(_decref) Task=`ac102940-e791-4539-942c-c667669249cc`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:48:06,662::task::579::TaskManager.Task::(_updateState) Task=`171c9c80-f6a1-48b3-b11b-35c6c57532f5`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:48:06,663::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:48:06,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:48:06,663::task::1168::TaskManager.Task::(prepare) Task=`171c9c80-f6a1-48b3-b11b-35c6c57532f5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:48:06,663::task::579::TaskManager.Task::(_updateState) Task=`171c9c80-f6a1-48b3-b11b-35c6c57532f5`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:48:06,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:48:06,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:48:06,664::task::974::TaskManager.Task::(_decref) Task=`171c9c80-f6a1-48b3-b11b-35c6c57532f5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:06,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:48:06,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:48:06,732::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:48:06,732::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:06,924::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:07,733::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:48:07,847::task::579::TaskManager.Task::(_updateState) Task=`5ee365e8-422b-4101-ade3-94663f55cd86`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:48:07,848::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:48:07,848::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:48:07,848::task::1168::TaskManager.Task::(prepare) Task=`5ee365e8-422b-4101-ade3-94663f55cd86`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:48:07,848::task::579::TaskManager.Task::(_updateState) Task=`5ee365e8-422b-4101-ade3-94663f55cd86`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:48:07,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:48:07,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:48:07,849::task::974::TaskManager.Task::(_decref) Task=`5ee365e8-422b-4101-ade3-94663f55cd86`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:48:07,849::task::579::TaskManager.Task::(_updateState) Task=`415812f3-0af0-4294-b299-87c8571cd423`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:48:07,849::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:48:07,849::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:48:07,850::task::1168::TaskManager.Task::(prepare) Task=`415812f3-0af0-4294-b299-87c8571cd423`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:48:07,850::task::579::TaskManager.Task::(_updateState) Task=`415812f3-0af0-4294-b299-87c8571cd423`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:48:07,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:48:07,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:48:07,850::task::974::TaskManager.Task::(_decref) Task=`415812f3-0af0-4294-b299-87c8571cd423`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:48:08,108::task::579::TaskManager.Task::(_updateState) Task=`4b6187dd-8311-4f3b-b9d8-265e98072376`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:48:08,108::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:48:08,108::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:48:08,108::task::1168::TaskManager.Task::(prepare) Task=`4b6187dd-8311-4f3b-b9d8-265e98072376`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:48:08,108::task::579::TaskManager.Task::(_updateState) Task=`4b6187dd-8311-4f3b-b9d8-265e98072376`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:48:08,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:48:08,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:48:08,109::task::974::TaskManager.Task::(_decref) Task=`4b6187dd-8311-4f3b-b9d8-265e98072376`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:48:08,109::task::579::TaskManager.Task::(_updateState) Task=`a673cc9e-8d40-4cc6-8f1e-23647d724751`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:48:08,109::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:48:08,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:48:08,110::task::1168::TaskManager.Task::(prepare) Task=`a673cc9e-8d40-4cc6-8f1e-23647d724751`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:48:08,110::task::579::TaskManager.Task::(_updateState) Task=`a673cc9e-8d40-4cc6-8f1e-23647d724751`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:48:08,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:48:08,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:48:08,110::task::974::TaskManager.Task::(_decref) Task=`a673cc9e-8d40-4cc6-8f1e-23647d724751`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:48:08,110::task::579::TaskManager.Task::(_updateState) Task=`25e8f5af-497d-4edd-b090-d0c05dade78a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:48:08,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:48:08,111::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:48:08,111::task::1168::TaskManager.Task::(prepare) Task=`25e8f5af-497d-4edd-b090-d0c05dade78a`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:48:08,111::task::579::TaskManager.Task::(_updateState) Task=`25e8f5af-497d-4edd-b090-d0c05dade78a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:48:08,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:48:08,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:48:08,111::task::974::TaskManager.Task::(_decref) Task=`25e8f5af-497d-4edd-b090-d0c05dade78a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:08,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:48:08,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:48:08,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:48:08,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:08,735::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:48:08,735::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:48:08,925::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287097::DEBUG::2014-01-16 16:48:09,128::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287097::DEBUG::2014-01-16 16:48:09,129::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '15.51', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.83', 'elapsedTime': '7', 'vmType': 'kvm', 'cpuSys': '5.45', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:09,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:09,926::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:48:10,314::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:48:10,331::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000167422 s, 24.5 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:48:10,619::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:48:10,637::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264763 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:48:10,642::task::579::TaskManager.Task::(_updateState) Task=`739fa194-c4f4-486c-a925-2b373b60ecb3`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:48:10,642::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:48:10,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:48:10,643::task::1168::TaskManager.Task::(prepare) Task=`739fa194-c4f4-486c-a925-2b373b60ecb3`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:48:10,643::task::579::TaskManager.Task::(_updateState) Task=`739fa194-c4f4-486c-a925-2b373b60ecb3`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:48:10,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:48:10,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:48:10,644::task::974::TaskManager.Task::(_decref) Task=`739fa194-c4f4-486c-a925-2b373b60ecb3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:10,737::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:48:10,738::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:48:10,738::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 16:48:10,815::task::579::TaskManager.Task::(_updateState) Task=`01a3982b-b0a3-4451-a034-75dc7c335806`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:48:10,815::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:48:10,815::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:48:10,816::task::1168::TaskManager.Task::(prepare) Task=`01a3982b-b0a3-4451-a034-75dc7c335806`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:48:10,816::task::579::TaskManager.Task::(_updateState) Task=`01a3982b-b0a3-4451-a034-75dc7c335806`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:48:10,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:48:10,816::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:48:10,816::task::974::TaskManager.Task::(_decref) Task=`01a3982b-b0a3-4451-a034-75dc7c335806`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:48:10,928::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:48:11,361::task::579::TaskManager.Task::(_updateState) Task=`03e1e69d-939d-4b70-8ed6-4d748536d988`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:48:11,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:48:11,361::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:48:11,361::task::1168::TaskManager.Task::(prepare) Task=`03e1e69d-939d-4b70-8ed6-4d748536d988`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:48:11,361::task::579::TaskManager.Task::(_updateState) Task=`03e1e69d-939d-4b70-8ed6-4d748536d988`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:48:11,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:48:11,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:48:11,362::task::974::TaskManager.Task::(_decref) Task=`03e1e69d-939d-4b70-8ed6-4d748536d988`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:48:11,362::task::579::TaskManager.Task::(_updateState) Task=`19a6a543-f3cc-4634-a02a-def25969379f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:48:11,362::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:48:11,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:48:11,363::task::1168::TaskManager.Task::(prepare) Task=`19a6a543-f3cc-4634-a02a-def25969379f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:48:11,363::task::579::TaskManager.Task::(_updateState) Task=`19a6a543-f3cc-4634-a02a-def25969379f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:48:11,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:48:11,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:48:11,363::task::974::TaskManager.Task::(_decref) Task=`19a6a543-f3cc-4634-a02a-def25969379f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:11,739::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:48:11,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:48:11,740::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:48:12,094::task::579::TaskManager.Task::(_updateState) Task=`145bdcbd-492d-4ed0-a79c-3f162bfb0b9e`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:48:12,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:48:12,095::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:48:12,095::task::1168::TaskManager.Task::(prepare) Task=`145bdcbd-492d-4ed0-a79c-3f162bfb0b9e`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:48:12,095::task::579::TaskManager.Task::(_updateState) Task=`145bdcbd-492d-4ed0-a79c-3f162bfb0b9e`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:48:12,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:48:12,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:48:12,096::task::974::TaskManager.Task::(_decref) Task=`145bdcbd-492d-4ed0-a79c-3f162bfb0b9e`::ref 0 aborting False >Thread-287099::DEBUG::2014-01-16 16:48:12,224::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287099::DEBUG::2014-01-16 16:48:12,225::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '15.51', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.92', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '5.45', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:12,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:48:12,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:48:12,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:48:12,741::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:12,929::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:48:13,060::task::579::TaskManager.Task::(_updateState) Task=`58daeceb-64f9-4767-9777-5ac5d53fdad5`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:48:13,061::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:48:13,061::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:48:13,061::task::1168::TaskManager.Task::(prepare) Task=`58daeceb-64f9-4767-9777-5ac5d53fdad5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:48:13,061::task::579::TaskManager.Task::(_updateState) Task=`58daeceb-64f9-4767-9777-5ac5d53fdad5`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:48:13,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:48:13,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:48:13,062::task::974::TaskManager.Task::(_decref) Task=`58daeceb-64f9-4767-9777-5ac5d53fdad5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:13,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:14,743::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:48:14,743::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:14,930::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:14,931::task::579::TaskManager.Task::(_updateState) Task=`4e2c69ef-283b-414d-b24b-5eb3037e1af7`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:48:14,931::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:48:14,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:48:14,931::task::1168::TaskManager.Task::(prepare) Task=`4e2c69ef-283b-414d-b24b-5eb3037e1af7`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:48:14,932::task::579::TaskManager.Task::(_updateState) Task=`4e2c69ef-283b-414d-b24b-5eb3037e1af7`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:48:14,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:48:14,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:48:14,932::task::974::TaskManager.Task::(_decref) Task=`4e2c69ef-283b-414d-b24b-5eb3037e1af7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:48:14,934::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:48:14,934::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:48:14,935::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:14,937::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:14,938::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287101::DEBUG::2014-01-16 16:48:15,321::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287101::DEBUG::2014-01-16 16:48:15,322::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '15.51', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.01', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '5.45', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:15,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:48:16,345::task::579::TaskManager.Task::(_updateState) Task=`2e212d6d-7617-49ec-a7b5-58b0a1c74711`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:48:16,345::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:48:16,346::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:48:16,346::task::1168::TaskManager.Task::(prepare) Task=`2e212d6d-7617-49ec-a7b5-58b0a1c74711`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:48:16,346::task::579::TaskManager.Task::(_updateState) Task=`2e212d6d-7617-49ec-a7b5-58b0a1c74711`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:48:16,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:48:16,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:48:16,346::task::974::TaskManager.Task::(_decref) Task=`2e212d6d-7617-49ec-a7b5-58b0a1c74711`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:16,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:16,939::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:48:17,612::task::579::TaskManager.Task::(_updateState) Task=`496acf86-a2d5-45a7-b65c-c51aaac06150`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:48:17,613::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:48:17,613::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:48:17,613::task::1168::TaskManager.Task::(prepare) Task=`496acf86-a2d5-45a7-b65c-c51aaac06150`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:48:17,613::task::579::TaskManager.Task::(_updateState) Task=`496acf86-a2d5-45a7-b65c-c51aaac06150`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:48:17,613::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:48:17,613::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:48:17,613::task::974::TaskManager.Task::(_decref) Task=`496acf86-a2d5-45a7-b65c-c51aaac06150`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:17,748::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287102::DEBUG::2014-01-16 16:48:18,377::task::579::TaskManager.Task::(_updateState) Task=`a556a51b-a51e-49e0-a20a-16962251c1d0`::moving from state init -> state preparing >Thread-287102::INFO::2014-01-16 16:48:18,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287102::INFO::2014-01-16 16:48:18,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264763', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000167422', 'lastCheck': '8.0', 'valid': True}} >Thread-287102::DEBUG::2014-01-16 16:48:18,378::task::1168::TaskManager.Task::(prepare) Task=`a556a51b-a51e-49e0-a20a-16962251c1d0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264763', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000167422', 'lastCheck': '8.0', 'valid': True}} >Thread-287102::DEBUG::2014-01-16 16:48:18,378::task::579::TaskManager.Task::(_updateState) Task=`a556a51b-a51e-49e0-a20a-16962251c1d0`::moving from state preparing -> state finished >Thread-287102::DEBUG::2014-01-16 16:48:18,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287102::DEBUG::2014-01-16 16:48:18,379::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287102::DEBUG::2014-01-16 16:48:18,379::task::974::TaskManager.Task::(_decref) Task=`a556a51b-a51e-49e0-a20a-16962251c1d0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:18,749::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:18,940::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:19,750::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:48:19,766::task::579::TaskManager.Task::(_updateState) Task=`f77e9fc5-dc79-40bc-ae88-78e0dbeba32b`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:48:19,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:48:19,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:48:19,767::task::1168::TaskManager.Task::(prepare) Task=`f77e9fc5-dc79-40bc-ae88-78e0dbeba32b`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:48:19,767::task::579::TaskManager.Task::(_updateState) Task=`f77e9fc5-dc79-40bc-ae88-78e0dbeba32b`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:48:19,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:48:19,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:48:19,767::task::974::TaskManager.Task::(_decref) Task=`f77e9fc5-dc79-40bc-ae88-78e0dbeba32b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:48:19,941::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:48:20,338::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:48:20,355::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000236459 s, 17.3 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:48:20,647::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:48:20,667::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000371023 s, 984 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:48:20,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:48:20,752::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:20,943::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:21,753::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287105::DEBUG::2014-01-16 16:48:21,912::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287105::DEBUG::2014-01-16 16:48:21,912::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '48.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '22.08', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:22,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:22,944::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:23,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:24,757::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:24,946::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:24,947::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287107::DEBUG::2014-01-16 16:48:25,009::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287107::DEBUG::2014-01-16 16:48:25,009::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '48.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.67', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '22.08', 'appsList': [], 'guestIPs': ''}]} >Thread-15207::DEBUG::2014-01-16 16:48:25,621::task::579::TaskManager.Task::(_updateState) Task=`48ca80bf-7012-473a-8f80-1fd5736b4ebd`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:48:25,621::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:48:25,621::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:48:25,621::task::1168::TaskManager.Task::(prepare) Task=`48ca80bf-7012-473a-8f80-1fd5736b4ebd`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:48:25,622::task::579::TaskManager.Task::(_updateState) Task=`48ca80bf-7012-473a-8f80-1fd5736b4ebd`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:48:25,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:48:25,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:48:25,622::task::974::TaskManager.Task::(_decref) Task=`48ca80bf-7012-473a-8f80-1fd5736b4ebd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:25,757::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:48:25,758::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:48:25,758::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:26,759::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:48:26,760::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:26,948::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:48:27,673::task::579::TaskManager.Task::(_updateState) Task=`d4c60359-cf28-4591-bbf3-e9e76fa09491`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:48:27,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:48:27,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:48:27,673::task::1168::TaskManager.Task::(prepare) Task=`d4c60359-cf28-4591-bbf3-e9e76fa09491`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:48:27,673::task::579::TaskManager.Task::(_updateState) Task=`d4c60359-cf28-4591-bbf3-e9e76fa09491`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:48:27,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:48:27,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:48:27,674::task::974::TaskManager.Task::(_decref) Task=`d4c60359-cf28-4591-bbf3-e9e76fa09491`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:27,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:48:27,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:48:27,761::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287109::DEBUG::2014-01-16 16:48:28,117::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287109::DEBUG::2014-01-16 16:48:28,118::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '48.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.77', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '22.08', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:28,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:48:28,763::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:28,949::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:48:29,209::task::579::TaskManager.Task::(_updateState) Task=`2ff178de-406c-448e-a1aa-f62a4cbd8c3e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:48:29,210::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:48:29,210::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:48:29,210::task::1168::TaskManager.Task::(prepare) Task=`2ff178de-406c-448e-a1aa-f62a4cbd8c3e`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:48:29,210::task::579::TaskManager.Task::(_updateState) Task=`2ff178de-406c-448e-a1aa-f62a4cbd8c3e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:48:29,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:48:29,210::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:48:29,211::task::974::TaskManager.Task::(_decref) Task=`2ff178de-406c-448e-a1aa-f62a4cbd8c3e`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:48:29,211::task::579::TaskManager.Task::(_updateState) Task=`86453ebe-c197-4bfe-b50b-fb7dba5e61c7`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:48:29,211::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:48:29,211::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:48:29,211::task::1168::TaskManager.Task::(prepare) Task=`86453ebe-c197-4bfe-b50b-fb7dba5e61c7`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:48:29,211::task::579::TaskManager.Task::(_updateState) Task=`86453ebe-c197-4bfe-b50b-fb7dba5e61c7`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:48:29,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:48:29,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:48:29,212::task::974::TaskManager.Task::(_decref) Task=`86453ebe-c197-4bfe-b50b-fb7dba5e61c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:29,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:48:29,764::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:29,951::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:48:29,952::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:48:29,953::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:48:30,360::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:48:30,377::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000280389 s, 14.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:48:30,676::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:48:30,693::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000285955 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:48:30,765::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:30,954::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:48:31,355::task::579::TaskManager.Task::(_updateState) Task=`b7b17803-443a-4315-89d9-65688c0005fe`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:48:31,356::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:48:31,356::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:48:31,356::task::1168::TaskManager.Task::(prepare) Task=`b7b17803-443a-4315-89d9-65688c0005fe`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:48:31,356::task::579::TaskManager.Task::(_updateState) Task=`b7b17803-443a-4315-89d9-65688c0005fe`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:48:31,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:48:31,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:48:31,358::task::974::TaskManager.Task::(_decref) Task=`b7b17803-443a-4315-89d9-65688c0005fe`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:48:31,365::task::579::TaskManager.Task::(_updateState) Task=`cca15405-2ec9-43d2-a7d6-8af832b790a8`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:48:31,367::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:48:31,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:48:31,372::task::1168::TaskManager.Task::(prepare) Task=`cca15405-2ec9-43d2-a7d6-8af832b790a8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:48:31,373::task::579::TaskManager.Task::(_updateState) Task=`cca15405-2ec9-43d2-a7d6-8af832b790a8`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:48:31,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:48:31,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:48:31,378::task::974::TaskManager.Task::(_decref) Task=`cca15405-2ec9-43d2-a7d6-8af832b790a8`::ref 0 aborting False >Thread-287111::DEBUG::2014-01-16 16:48:31,433::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287111::DEBUG::2014-01-16 16:48:31,434::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '48.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '1073741824', 'writeLatency': '9510647', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '952736', 'readRate': '0.00', 'truesize': '1073741824', 'writeRate': '1633.39'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.08', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '22.08', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:31,766::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:48:31,767::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:32,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:48:32,768::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:32,956::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:33,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:48:33,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:48:33,770::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:48:33,770::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287112::DEBUG::2014-01-16 16:48:34,488::task::579::TaskManager.Task::(_updateState) Task=`798c5374-a7f6-48db-8ff0-404ffcd9d1c3`::moving from state init -> state preparing >Thread-287112::INFO::2014-01-16 16:48:34,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287112::INFO::2014-01-16 16:48:34,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000285955', 'lastCheck': '3.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280389', 'lastCheck': '4.1', 'valid': True}} >Thread-287112::DEBUG::2014-01-16 16:48:34,488::task::1168::TaskManager.Task::(prepare) Task=`798c5374-a7f6-48db-8ff0-404ffcd9d1c3`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000285955', 'lastCheck': '3.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280389', 'lastCheck': '4.1', 'valid': True}} >Thread-287112::DEBUG::2014-01-16 16:48:34,489::task::579::TaskManager.Task::(_updateState) Task=`798c5374-a7f6-48db-8ff0-404ffcd9d1c3`::moving from state preparing -> state finished >Thread-287112::DEBUG::2014-01-16 16:48:34,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287112::DEBUG::2014-01-16 16:48:34,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287112::DEBUG::2014-01-16 16:48:34,489::task::974::TaskManager.Task::(_decref) Task=`798c5374-a7f6-48db-8ff0-404ffcd9d1c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:34,771::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:48:34,771::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:48:34,771::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:34,958::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:34,959::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:35,772::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:48:35,772::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:48:36,370::task::579::TaskManager.Task::(_updateState) Task=`56502193-dad1-4d93-8698-172b6075c08b`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:48:36,370::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:48:36,371::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:48:36,371::task::1168::TaskManager.Task::(prepare) Task=`56502193-dad1-4d93-8698-172b6075c08b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:48:36,371::task::579::TaskManager.Task::(_updateState) Task=`56502193-dad1-4d93-8698-172b6075c08b`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:48:36,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:48:36,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:48:36,371::task::974::TaskManager.Task::(_decref) Task=`56502193-dad1-4d93-8698-172b6075c08b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:36,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:48:36,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:48:36,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:48:36,774::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:36,961::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:37,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287115::DEBUG::2014-01-16 16:48:38,013::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287115::DEBUG::2014-01-16 16:48:38,013::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '0.27', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.65', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-3168::DEBUG::2014-01-16 16:48:38,773::task::579::TaskManager.Task::(_updateState) Task=`27b55626-dcb8-48cb-acb2-2ce174ed468c`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:48:38,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:48:38,774::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:48:38,774::task::1168::TaskManager.Task::(prepare) Task=`27b55626-dcb8-48cb-acb2-2ce174ed468c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:48:38,774::task::579::TaskManager.Task::(_updateState) Task=`27b55626-dcb8-48cb-acb2-2ce174ed468c`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:48:38,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:48:38,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:48:38,775::task::974::TaskManager.Task::(_decref) Task=`27b55626-dcb8-48cb-acb2-2ce174ed468c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:38,776::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:48:38,777::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:48:38,777::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:48:38,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:38,777::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:48:38,778::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:48:38,962::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:48:39,703::task::579::TaskManager.Task::(_updateState) Task=`061d61e9-3163-429e-ae31-7ae4f7c4600e`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:48:39,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:48:39,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:48:39,704::task::1168::TaskManager.Task::(prepare) Task=`061d61e9-3163-429e-ae31-7ae4f7c4600e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:48:39,704::task::579::TaskManager.Task::(_updateState) Task=`061d61e9-3163-429e-ae31-7ae4f7c4600e`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:48:39,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:48:39,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:48:39,705::task::974::TaskManager.Task::(_decref) Task=`061d61e9-3163-429e-ae31-7ae4f7c4600e`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:48:39,708::task::579::TaskManager.Task::(_updateState) Task=`d59cbd84-a353-40d1-ae1f-1513dfedd883`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:48:39,708::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:48:39,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:48:39,709::task::1168::TaskManager.Task::(prepare) Task=`d59cbd84-a353-40d1-ae1f-1513dfedd883`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:48:39,709::task::579::TaskManager.Task::(_updateState) Task=`d59cbd84-a353-40d1-ae1f-1513dfedd883`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:48:39,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:48:39,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:48:39,709::task::974::TaskManager.Task::(_decref) Task=`d59cbd84-a353-40d1-ae1f-1513dfedd883`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:39,779::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-69607::DEBUG::2014-01-16 16:48:39,811::task::579::TaskManager.Task::(_updateState) Task=`714af5d6-9cfa-4b73-ab83-cd8de444425c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:48:39,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:48:39,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:48:39,811::task::1168::TaskManager.Task::(prepare) Task=`714af5d6-9cfa-4b73-ab83-cd8de444425c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:48:39,811::task::579::TaskManager.Task::(_updateState) Task=`714af5d6-9cfa-4b73-ab83-cd8de444425c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:48:39,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:48:39,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:48:39,812::task::974::TaskManager.Task::(_decref) Task=`714af5d6-9cfa-4b73-ab83-cd8de444425c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:48:39,964::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:48:40,383::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:48:40,401::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000220604 s, 18.6 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 16:48:40,599::task::579::TaskManager.Task::(_updateState) Task=`7a5bad7a-0d69-4c7f-8bac-4789282f4bc3`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:48:40,599::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:48:40,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:48:40,600::task::1168::TaskManager.Task::(prepare) Task=`7a5bad7a-0d69-4c7f-8bac-4789282f4bc3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:48:40,600::task::579::TaskManager.Task::(_updateState) Task=`7a5bad7a-0d69-4c7f-8bac-4789282f4bc3`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:48:40,600::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:48:40,600::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:48:40,600::task::974::TaskManager.Task::(_decref) Task=`7a5bad7a-0d69-4c7f-8bac-4789282f4bc3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:48:40,701::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:48:40,717::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000263627 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:48:40,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:48:40,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:48:40,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 16:48:40,783::task::579::TaskManager.Task::(_updateState) Task=`60f34016-f8f7-4f8f-bb76-d92de95a25b9`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:48:40,783::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:48:40,783::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:48:40,783::task::1168::TaskManager.Task::(prepare) Task=`60f34016-f8f7-4f8f-bb76-d92de95a25b9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:48:40,784::task::579::TaskManager.Task::(_updateState) Task=`60f34016-f8f7-4f8f-bb76-d92de95a25b9`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:48:40,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:48:40,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:48:40,784::task::974::TaskManager.Task::(_decref) Task=`60f34016-f8f7-4f8f-bb76-d92de95a25b9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:48:40,965::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287117::DEBUG::2014-01-16 16:48:41,110::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287117::DEBUG::2014-01-16 16:48:41,110::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '0.27', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.70', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:41,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:48:41,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:48:41,782::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:42,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:48:42,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:48:42,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:48:42,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:42,966::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:43,785::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287119::DEBUG::2014-01-16 16:48:44,205::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287119::DEBUG::2014-01-16 16:48:44,206::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '0.27', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.79', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:44,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:48:44,786::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:44,968::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:44,970::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:48:44,970::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:48:44,972::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:48:44,995::task::579::TaskManager.Task::(_updateState) Task=`4559b623-f31d-4b84-97e5-63d6bb77ca7d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:48:44,996::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:48:44,996::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:48:44,996::task::1168::TaskManager.Task::(prepare) Task=`4559b623-f31d-4b84-97e5-63d6bb77ca7d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:48:44,996::task::579::TaskManager.Task::(_updateState) Task=`4559b623-f31d-4b84-97e5-63d6bb77ca7d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:48:44,996::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:48:44,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:48:44,997::task::974::TaskManager.Task::(_decref) Task=`4559b623-f31d-4b84-97e5-63d6bb77ca7d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:48:44,997::task::579::TaskManager.Task::(_updateState) Task=`d6374aa3-060e-4866-86f9-afa6941199b1`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:48:44,997::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:48:44,997::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:48:44,997::task::1168::TaskManager.Task::(prepare) Task=`d6374aa3-060e-4866-86f9-afa6941199b1`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:48:44,998::task::579::TaskManager.Task::(_updateState) Task=`d6374aa3-060e-4866-86f9-afa6941199b1`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:48:44,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:48:44,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:48:44,998::task::974::TaskManager.Task::(_decref) Task=`d6374aa3-060e-4866-86f9-afa6941199b1`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:48:44,998::task::579::TaskManager.Task::(_updateState) Task=`535c83b9-7e68-44dd-9bd0-f768e9c2a355`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:48:44,998::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:48:44,999::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:48:44,999::task::1168::TaskManager.Task::(prepare) Task=`535c83b9-7e68-44dd-9bd0-f768e9c2a355`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:48:44,999::task::579::TaskManager.Task::(_updateState) Task=`535c83b9-7e68-44dd-9bd0-f768e9c2a355`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:48:44,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:48:44,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:48:44,999::task::974::TaskManager.Task::(_decref) Task=`535c83b9-7e68-44dd-9bd0-f768e9c2a355`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:45,786::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:46,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:46,973::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287121::DEBUG::2014-01-16 16:48:47,303::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287121::DEBUG::2014-01-16 16:48:47,303::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '0.27', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.88', 'elapsedTime': '45', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:47,788::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:48:48,477::task::579::TaskManager.Task::(_updateState) Task=`238cfa97-6082-48f7-a559-ef40fe10f272`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:48:48,477::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:48:48,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:48:48,478::task::1168::TaskManager.Task::(prepare) Task=`238cfa97-6082-48f7-a559-ef40fe10f272`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:48:48,478::task::579::TaskManager.Task::(_updateState) Task=`238cfa97-6082-48f7-a559-ef40fe10f272`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:48:48,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:48:48,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:48:48,478::task::974::TaskManager.Task::(_decref) Task=`238cfa97-6082-48f7-a559-ef40fe10f272`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:48,789::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:48,975::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:49,791::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:49,976::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287122::DEBUG::2014-01-16 16:48:50,364::task::579::TaskManager.Task::(_updateState) Task=`845b4b32-0240-4650-967d-8107ba77ed37`::moving from state init -> state preparing >Thread-287122::INFO::2014-01-16 16:48:50,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287122::INFO::2014-01-16 16:48:50,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263627', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000220604', 'lastCheck': '10.0', 'valid': True}} >Thread-287122::DEBUG::2014-01-16 16:48:50,364::task::1168::TaskManager.Task::(prepare) Task=`845b4b32-0240-4650-967d-8107ba77ed37`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263627', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000220604', 'lastCheck': '10.0', 'valid': True}} >Thread-287122::DEBUG::2014-01-16 16:48:50,364::task::579::TaskManager.Task::(_updateState) Task=`845b4b32-0240-4650-967d-8107ba77ed37`::moving from state preparing -> state finished >Thread-287122::DEBUG::2014-01-16 16:48:50,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287122::DEBUG::2014-01-16 16:48:50,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287122::DEBUG::2014-01-16 16:48:50,365::task::974::TaskManager.Task::(_decref) Task=`845b4b32-0240-4650-967d-8107ba77ed37`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:48:50,406::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:48:50,444::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000209829 s, 19.5 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:48:50,726::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:48:50,744::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00028363 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:48:50,792::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:48:50,792::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:50,978::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:51,793::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:52,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:52,979::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:48:53,240::task::579::TaskManager.Task::(_updateState) Task=`7840460d-5067-4a89-93a4-95670c5debd3`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:48:53,240::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:48:53,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:48:53,240::task::1168::TaskManager.Task::(prepare) Task=`7840460d-5067-4a89-93a4-95670c5debd3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:48:53,240::task::579::TaskManager.Task::(_updateState) Task=`7840460d-5067-4a89-93a4-95670c5debd3`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:48:53,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:48:53,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:48:53,241::task::974::TaskManager.Task::(_decref) Task=`7840460d-5067-4a89-93a4-95670c5debd3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:48:53,796::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287125::DEBUG::2014-01-16 16:48:53,980::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287125::DEBUG::2014-01-16 16:48:53,980::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.01', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.54', 'elapsedTime': '52', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:54,797::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:54,980::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:48:54,981::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:55,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:48:55,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:48:55,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:56,800::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:48:56,800::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:56,983::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287127::DEBUG::2014-01-16 16:48:57,077::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287127::DEBUG::2014-01-16 16:48:57,077::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.01', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.63', 'elapsedTime': '55', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:48:57,801::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:48:57,802::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:48:57,802::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:48:58,803::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:48:58,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:48:58,984::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:48:59,805::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:48:59,805::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:48:59,835::task::579::TaskManager.Task::(_updateState) Task=`349a9ecb-65af-4510-a659-df043d69da2a`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:48:59,836::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:48:59,836::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:48:59,836::task::1168::TaskManager.Task::(prepare) Task=`349a9ecb-65af-4510-a659-df043d69da2a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:48:59,836::task::579::TaskManager.Task::(_updateState) Task=`349a9ecb-65af-4510-a659-df043d69da2a`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:48:59,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:48:59,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:48:59,837::task::974::TaskManager.Task::(_decref) Task=`349a9ecb-65af-4510-a659-df043d69da2a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:48:59,986::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:48:59,986::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:48:59,988::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287129::DEBUG::2014-01-16 16:49:00,174::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287129::DEBUG::2014-01-16 16:49:00,174::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.01', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.72', 'elapsedTime': '58', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 16:49:00,465::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:49:00,482::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000290205 s, 14.1 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:49:00,753::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:49:00,774::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276066 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:49:00,807::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:00,989::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:01,809::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:49:01,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:02,810::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:49:02,811::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:02,990::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287131::DEBUG::2014-01-16 16:49:03,333::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287131::DEBUG::2014-01-16 16:49:03,333::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -1L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.01', 'disks': {u'vda': {'readLatency': '881432', 'apparentsize': '1073741824', 'writeLatency': '3377337', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '731281', 'readRate': '1260666.62', 'truesize': '1073741824', 'writeRate': '34372.61'}, u'hdc': {'readLatency': '13929', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.87', 'elapsedTime': '61', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 16:49:03,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:49:03,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:49:03,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:49:03,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:04,813::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:49:04,814::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:49:04,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:04,991::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:04,992::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:49:05,602::task::579::TaskManager.Task::(_updateState) Task=`2488e329-ccb6-4bc6-8a59-f40c32b7ecbb`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:49:05,603::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:49:05,603::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:49:05,603::task::1168::TaskManager.Task::(prepare) Task=`2488e329-ccb6-4bc6-8a59-f40c32b7ecbb`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:49:05,603::task::579::TaskManager.Task::(_updateState) Task=`2488e329-ccb6-4bc6-8a59-f40c32b7ecbb`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:49:05,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:49:05,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:49:05,604::task::974::TaskManager.Task::(_decref) Task=`2488e329-ccb6-4bc6-8a59-f40c32b7ecbb`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:49:05,604::task::579::TaskManager.Task::(_updateState) Task=`e9902160-42cc-478c-8d46-733f6492e3ab`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:49:05,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:49:05,605::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:49:05,605::task::1168::TaskManager.Task::(prepare) Task=`e9902160-42cc-478c-8d46-733f6492e3ab`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:49:05,605::task::579::TaskManager.Task::(_updateState) Task=`e9902160-42cc-478c-8d46-733f6492e3ab`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:49:05,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:49:05,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:49:05,605::task::974::TaskManager.Task::(_decref) Task=`e9902160-42cc-478c-8d46-733f6492e3ab`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:05,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:49:05,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:49:06,252::task::579::TaskManager.Task::(_updateState) Task=`cf076f41-4e79-43f6-b7d9-ed08b52e02a6`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:49:06,253::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:49:06,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:49:06,253::task::1168::TaskManager.Task::(prepare) Task=`cf076f41-4e79-43f6-b7d9-ed08b52e02a6`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:49:06,253::task::579::TaskManager.Task::(_updateState) Task=`cf076f41-4e79-43f6-b7d9-ed08b52e02a6`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:49:06,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:49:06,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:49:06,253::task::974::TaskManager.Task::(_decref) Task=`cf076f41-4e79-43f6-b7d9-ed08b52e02a6`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:49:06,267::task::579::TaskManager.Task::(_updateState) Task=`36fce244-820d-467b-84a6-32d33fe94809`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:49:06,267::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:49:06,268::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:49:06,268::task::1168::TaskManager.Task::(prepare) Task=`36fce244-820d-467b-84a6-32d33fe94809`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:49:06,268::task::579::TaskManager.Task::(_updateState) Task=`36fce244-820d-467b-84a6-32d33fe94809`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:49:06,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:49:06,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:49:06,268::task::974::TaskManager.Task::(_decref) Task=`36fce244-820d-467b-84a6-32d33fe94809`::ref 0 aborting False >Thread-287132::DEBUG::2014-01-16 16:49:06,398::task::579::TaskManager.Task::(_updateState) Task=`6f59a584-b955-4670-ac43-1a2bf4135cbb`::moving from state init -> state preparing >Thread-287132::INFO::2014-01-16 16:49:06,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287132::INFO::2014-01-16 16:49:06,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276066', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290205', 'lastCheck': '5.9', 'valid': True}} >Thread-287132::DEBUG::2014-01-16 16:49:06,399::task::1168::TaskManager.Task::(prepare) Task=`6f59a584-b955-4670-ac43-1a2bf4135cbb`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276066', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290205', 'lastCheck': '5.9', 'valid': True}} >Thread-287132::DEBUG::2014-01-16 16:49:06,399::task::579::TaskManager.Task::(_updateState) Task=`6f59a584-b955-4670-ac43-1a2bf4135cbb`::moving from state preparing -> state finished >Thread-287132::DEBUG::2014-01-16 16:49:06,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287132::DEBUG::2014-01-16 16:49:06,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287132::DEBUG::2014-01-16 16:49:06,400::task::974::TaskManager.Task::(_decref) Task=`6f59a584-b955-4670-ac43-1a2bf4135cbb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:06,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:49:06,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:49:06,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:49:06,817::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:49:06,822::task::579::TaskManager.Task::(_updateState) Task=`f5a3e9db-93d3-4730-8a90-8ffb06471c46`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:49:06,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:49:06,822::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:49:06,822::task::1168::TaskManager.Task::(prepare) Task=`f5a3e9db-93d3-4730-8a90-8ffb06471c46`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:49:06,823::task::579::TaskManager.Task::(_updateState) Task=`f5a3e9db-93d3-4730-8a90-8ffb06471c46`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:49:06,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:49:06,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:49:06,823::task::974::TaskManager.Task::(_decref) Task=`f5a3e9db-93d3-4730-8a90-8ffb06471c46`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:06,993::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:07,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:49:07,935::task::579::TaskManager.Task::(_updateState) Task=`4f6ff028-1999-4e05-93c7-0cc2fb194028`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:49:07,935::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:49:07,935::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:49:07,936::task::1168::TaskManager.Task::(prepare) Task=`4f6ff028-1999-4e05-93c7-0cc2fb194028`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:49:07,936::task::579::TaskManager.Task::(_updateState) Task=`4f6ff028-1999-4e05-93c7-0cc2fb194028`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:49:07,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:49:07,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:49:07,936::task::974::TaskManager.Task::(_decref) Task=`4f6ff028-1999-4e05-93c7-0cc2fb194028`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:49:07,936::task::579::TaskManager.Task::(_updateState) Task=`670709d4-fbe4-469d-83ce-a7bd92c19d78`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:49:07,937::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:49:07,937::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:49:07,937::task::1168::TaskManager.Task::(prepare) Task=`670709d4-fbe4-469d-83ce-a7bd92c19d78`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:49:07,937::task::579::TaskManager.Task::(_updateState) Task=`670709d4-fbe4-469d-83ce-a7bd92c19d78`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:49:07,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:49:07,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:49:07,938::task::974::TaskManager.Task::(_decref) Task=`670709d4-fbe4-469d-83ce-a7bd92c19d78`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:49:08,685::task::579::TaskManager.Task::(_updateState) Task=`3f901698-aa7a-4692-a275-3cad79935b32`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:49:08,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:49:08,686::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:49:08,686::task::1168::TaskManager.Task::(prepare) Task=`3f901698-aa7a-4692-a275-3cad79935b32`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:49:08,686::task::579::TaskManager.Task::(_updateState) Task=`3f901698-aa7a-4692-a275-3cad79935b32`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:49:08,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:49:08,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:49:08,687::task::974::TaskManager.Task::(_decref) Task=`3f901698-aa7a-4692-a275-3cad79935b32`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:49:08,687::task::579::TaskManager.Task::(_updateState) Task=`2b886729-bdd2-4d64-8af0-05c5b1c3c3cf`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:49:08,687::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:49:08,687::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:49:08,687::task::1168::TaskManager.Task::(prepare) Task=`2b886729-bdd2-4d64-8af0-05c5b1c3c3cf`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:49:08,688::task::579::TaskManager.Task::(_updateState) Task=`2b886729-bdd2-4d64-8af0-05c5b1c3c3cf`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:49:08,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:49:08,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:49:08,688::task::974::TaskManager.Task::(_decref) Task=`2b886729-bdd2-4d64-8af0-05c5b1c3c3cf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:49:08,688::task::579::TaskManager.Task::(_updateState) Task=`4496459f-c60a-4797-8b6a-392f38ef5a90`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:49:08,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:49:08,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:49:08,689::task::1168::TaskManager.Task::(prepare) Task=`4496459f-c60a-4797-8b6a-392f38ef5a90`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:49:08,689::task::579::TaskManager.Task::(_updateState) Task=`4496459f-c60a-4797-8b6a-392f38ef5a90`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:49:08,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:49:08,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:49:08,689::task::974::TaskManager.Task::(_decref) Task=`4496459f-c60a-4797-8b6a-392f38ef5a90`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:08,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:49:08,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:49:08,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:49:08,821::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:08,821::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:49:08,821::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:49:08,995::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:09,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:09,996::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:49:10,488::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:49:10,506::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000273789 s, 15.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:49:10,782::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:49:10,798::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272026 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:49:10,802::task::579::TaskManager.Task::(_updateState) Task=`4823b797-e0d4-4b01-8714-82c78bce9bf6`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:49:10,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:49:10,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:49:10,806::task::1168::TaskManager.Task::(prepare) Task=`4823b797-e0d4-4b01-8714-82c78bce9bf6`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:49:10,806::task::579::TaskManager.Task::(_updateState) Task=`4823b797-e0d4-4b01-8714-82c78bce9bf6`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:49:10,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:49:10,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:49:10,807::task::974::TaskManager.Task::(_decref) Task=`4823b797-e0d4-4b01-8714-82c78bce9bf6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:10,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:49:10,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:49:10,823::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 16:49:10,974::task::579::TaskManager.Task::(_updateState) Task=`1860eb88-c1e3-465a-b84a-337d5f582a5d`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:49:10,975::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:49:10,975::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:49:10,975::task::1168::TaskManager.Task::(prepare) Task=`1860eb88-c1e3-465a-b84a-337d5f582a5d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:49:10,975::task::579::TaskManager.Task::(_updateState) Task=`1860eb88-c1e3-465a-b84a-337d5f582a5d`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:49:10,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:49:10,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:49:10,976::task::974::TaskManager.Task::(_decref) Task=`1860eb88-c1e3-465a-b84a-337d5f582a5d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:10,997::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 16:49:11,578::task::579::TaskManager.Task::(_updateState) Task=`bac59f1f-2a75-47cc-9ae8-8524dced0cd9`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:49:11,579::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:49:11,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:49:11,579::task::1168::TaskManager.Task::(prepare) Task=`bac59f1f-2a75-47cc-9ae8-8524dced0cd9`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:49:11,579::task::579::TaskManager.Task::(_updateState) Task=`bac59f1f-2a75-47cc-9ae8-8524dced0cd9`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:49:11,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:49:11,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:49:11,580::task::974::TaskManager.Task::(_decref) Task=`bac59f1f-2a75-47cc-9ae8-8524dced0cd9`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:49:11,580::task::579::TaskManager.Task::(_updateState) Task=`3cb716f2-b865-465b-bacc-cdccc15d49df`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:49:11,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:49:11,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:49:11,581::task::1168::TaskManager.Task::(prepare) Task=`3cb716f2-b865-465b-bacc-cdccc15d49df`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:49:11,581::task::579::TaskManager.Task::(_updateState) Task=`3cb716f2-b865-465b-bacc-cdccc15d49df`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:49:11,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:49:11,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:49:11,581::task::974::TaskManager.Task::(_decref) Task=`3cb716f2-b865-465b-bacc-cdccc15d49df`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:11,825::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:49:11,825::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:49:11,825::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:49:12,256::task::579::TaskManager.Task::(_updateState) Task=`cb1e74e6-9b3f-476f-b742-00b388c21e3e`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:49:12,257::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:49:12,257::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:49:12,257::task::1168::TaskManager.Task::(prepare) Task=`cb1e74e6-9b3f-476f-b742-00b388c21e3e`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:49:12,257::task::579::TaskManager.Task::(_updateState) Task=`cb1e74e6-9b3f-476f-b742-00b388c21e3e`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:49:12,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:49:12,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:49:12,258::task::974::TaskManager.Task::(_decref) Task=`cb1e74e6-9b3f-476f-b742-00b388c21e3e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:12,827::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:49:12,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:49:12,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:49:12,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:12,999::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:49:13,224::task::579::TaskManager.Task::(_updateState) Task=`bae322f1-eff2-4643-8a57-c3bdc924d3b3`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:49:13,224::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:49:13,225::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:49:13,225::task::1168::TaskManager.Task::(prepare) Task=`bae322f1-eff2-4643-8a57-c3bdc924d3b3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:49:13,225::task::579::TaskManager.Task::(_updateState) Task=`bae322f1-eff2-4643-8a57-c3bdc924d3b3`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:49:13,225::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:49:13,225::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:49:13,226::task::974::TaskManager.Task::(_decref) Task=`bae322f1-eff2-4643-8a57-c3bdc924d3b3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:13,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:14,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:49:14,835::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:15,000::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:15,001::task::579::TaskManager.Task::(_updateState) Task=`e2d8cc1c-1c4f-41fc-9b2d-527f37f97cea`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:49:15,001::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:49:15,001::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:49:15,001::task::1168::TaskManager.Task::(prepare) Task=`e2d8cc1c-1c4f-41fc-9b2d-527f37f97cea`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:49:15,001::task::579::TaskManager.Task::(_updateState) Task=`e2d8cc1c-1c4f-41fc-9b2d-527f37f97cea`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:49:15,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:49:15,002::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:49:15,002::task::974::TaskManager.Task::(_decref) Task=`e2d8cc1c-1c4f-41fc-9b2d-527f37f97cea`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:15,004::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:49:15,004::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:49:15,005::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:15,007::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:15,008::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:15,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:49:16,521::task::579::TaskManager.Task::(_updateState) Task=`06eb4605-4361-4837-a73f-311c90b5fba2`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:49:16,521::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:49:16,522::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:49:16,522::task::1168::TaskManager.Task::(prepare) Task=`06eb4605-4361-4837-a73f-311c90b5fba2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:49:16,522::task::579::TaskManager.Task::(_updateState) Task=`06eb4605-4361-4837-a73f-311c90b5fba2`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:49:16,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:49:16,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:49:16,522::task::974::TaskManager.Task::(_decref) Task=`06eb4605-4361-4837-a73f-311c90b5fba2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:16,838::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:17,010::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:49:17,688::task::579::TaskManager.Task::(_updateState) Task=`8edee1bb-8df1-4485-a6ca-b1aba273526a`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:49:17,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:49:17,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:49:17,689::task::1168::TaskManager.Task::(prepare) Task=`8edee1bb-8df1-4485-a6ca-b1aba273526a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:49:17,689::task::579::TaskManager.Task::(_updateState) Task=`8edee1bb-8df1-4485-a6ca-b1aba273526a`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:49:17,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:49:17,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:49:17,689::task::974::TaskManager.Task::(_decref) Task=`8edee1bb-8df1-4485-a6ca-b1aba273526a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:17,838::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:18,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:19,011::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:19,841::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:49:19,927::task::579::TaskManager.Task::(_updateState) Task=`197bc82a-fc33-4bcb-ae26-3b6de972de47`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:49:19,927::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:49:19,927::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:49:19,927::task::1168::TaskManager.Task::(prepare) Task=`197bc82a-fc33-4bcb-ae26-3b6de972de47`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:49:19,927::task::579::TaskManager.Task::(_updateState) Task=`197bc82a-fc33-4bcb-ae26-3b6de972de47`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:49:19,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:49:19,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:49:19,928::task::974::TaskManager.Task::(_decref) Task=`197bc82a-fc33-4bcb-ae26-3b6de972de47`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:20,012::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:49:20,511::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:49:20,528::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319503 s, 12.8 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:49:20,812::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:49:20,828::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272639 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:49:20,843::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:49:20,845::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:21,014::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:21,847::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287138::DEBUG::2014-01-16 16:49:22,273::task::579::TaskManager.Task::(_updateState) Task=`0d330a49-17fc-44cc-b05d-adab9dccce01`::moving from state init -> state preparing >Thread-287138::INFO::2014-01-16 16:49:22,274::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287138::INFO::2014-01-16 16:49:22,274::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272639', 'lastCheck': '1.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319503', 'lastCheck': '1.7', 'valid': True}} >Thread-287138::DEBUG::2014-01-16 16:49:22,275::task::1168::TaskManager.Task::(prepare) Task=`0d330a49-17fc-44cc-b05d-adab9dccce01`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272639', 'lastCheck': '1.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319503', 'lastCheck': '1.7', 'valid': True}} >Thread-287138::DEBUG::2014-01-16 16:49:22,275::task::579::TaskManager.Task::(_updateState) Task=`0d330a49-17fc-44cc-b05d-adab9dccce01`::moving from state preparing -> state finished >Thread-287138::DEBUG::2014-01-16 16:49:22,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287138::DEBUG::2014-01-16 16:49:22,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287138::DEBUG::2014-01-16 16:49:22,275::task::974::TaskManager.Task::(_decref) Task=`0d330a49-17fc-44cc-b05d-adab9dccce01`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:22,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:23,015::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:23,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:24,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:25,016::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:25,018::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:49:25,681::task::579::TaskManager.Task::(_updateState) Task=`3d94df85-6ac4-40e5-9068-018e1324c245`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:49:25,682::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:49:25,682::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:49:25,682::task::1168::TaskManager.Task::(prepare) Task=`3d94df85-6ac4-40e5-9068-018e1324c245`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:49:25,683::task::579::TaskManager.Task::(_updateState) Task=`3d94df85-6ac4-40e5-9068-018e1324c245`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:49:25,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:49:25,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:49:25,683::task::974::TaskManager.Task::(_decref) Task=`3d94df85-6ac4-40e5-9068-018e1324c245`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:25,851::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:49:25,851::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:49:25,851::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:26,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:49:26,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:27,019::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 16:49:27,833::task::579::TaskManager.Task::(_updateState) Task=`8b057942-9b1b-4330-8689-d64a7469e4da`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:49:27,833::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:49:27,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:49:27,834::task::1168::TaskManager.Task::(prepare) Task=`8b057942-9b1b-4330-8689-d64a7469e4da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:49:27,834::task::579::TaskManager.Task::(_updateState) Task=`8b057942-9b1b-4330-8689-d64a7469e4da`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:49:27,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:49:27,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:49:27,834::task::974::TaskManager.Task::(_decref) Task=`8b057942-9b1b-4330-8689-d64a7469e4da`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:27,854::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:49:27,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:49:27,855::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:28,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:49:28,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:29,020::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:49:29,575::task::579::TaskManager.Task::(_updateState) Task=`d823cde4-4b48-411d-9331-f335db96a3b6`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:49:29,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:49:29,575::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:49:29,575::task::1168::TaskManager.Task::(prepare) Task=`d823cde4-4b48-411d-9331-f335db96a3b6`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:49:29,576::task::579::TaskManager.Task::(_updateState) Task=`d823cde4-4b48-411d-9331-f335db96a3b6`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:49:29,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:49:29,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:49:29,576::task::974::TaskManager.Task::(_decref) Task=`d823cde4-4b48-411d-9331-f335db96a3b6`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:49:29,577::task::579::TaskManager.Task::(_updateState) Task=`01673503-a9ef-43c3-bf27-3563840e04cb`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:49:29,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:49:29,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:49:29,577::task::1168::TaskManager.Task::(prepare) Task=`01673503-a9ef-43c3-bf27-3563840e04cb`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:49:29,577::task::579::TaskManager.Task::(_updateState) Task=`01673503-a9ef-43c3-bf27-3563840e04cb`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:49:29,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:49:29,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:49:29,578::task::974::TaskManager.Task::(_decref) Task=`01673503-a9ef-43c3-bf27-3563840e04cb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:29,858::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:49:29,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:30,022::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:49:30,022::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:49:30,030::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:49:30,533::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:49:30,551::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022546 s, 18.2 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:49:30,837::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:49:30,856::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281378 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:49:30,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:31,031::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 16:49:31,522::task::579::TaskManager.Task::(_updateState) Task=`61f601b7-91dc-43af-8acf-dd6cddc920af`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:49:31,522::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:49:31,522::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:49:31,523::task::1168::TaskManager.Task::(prepare) Task=`61f601b7-91dc-43af-8acf-dd6cddc920af`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:49:31,523::task::579::TaskManager.Task::(_updateState) Task=`61f601b7-91dc-43af-8acf-dd6cddc920af`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:49:31,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:49:31,523::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:49:31,523::task::974::TaskManager.Task::(_decref) Task=`61f601b7-91dc-43af-8acf-dd6cddc920af`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:49:31,540::task::579::TaskManager.Task::(_updateState) Task=`df95a8af-cfd2-43d6-b298-ac7d12a5415d`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:49:31,540::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:49:31,540::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:49:31,540::task::1168::TaskManager.Task::(prepare) Task=`df95a8af-cfd2-43d6-b298-ac7d12a5415d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:49:31,540::task::579::TaskManager.Task::(_updateState) Task=`df95a8af-cfd2-43d6-b298-ac7d12a5415d`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:49:31,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:49:31,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:49:31,541::task::974::TaskManager.Task::(_decref) Task=`df95a8af-cfd2-43d6-b298-ac7d12a5415d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:31,859::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:49:31,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:32,860::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:49:32,861::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:33,032::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:33,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:49:33,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:49:33,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:49:33,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:34,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:49:34,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:49:34,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:35,034::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:35,035::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:35,866::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:49:35,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:49:36,561::task::579::TaskManager.Task::(_updateState) Task=`b7c5a039-a6ef-45f2-8d0e-f441f90622d4`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:49:36,561::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:49:36,562::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:49:36,562::task::1168::TaskManager.Task::(prepare) Task=`b7c5a039-a6ef-45f2-8d0e-f441f90622d4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:49:36,562::task::579::TaskManager.Task::(_updateState) Task=`b7c5a039-a6ef-45f2-8d0e-f441f90622d4`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:49:36,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:49:36,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:49:36,563::task::974::TaskManager.Task::(_decref) Task=`b7c5a039-a6ef-45f2-8d0e-f441f90622d4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:36,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:49:36,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:49:36,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:49:36,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:37,036::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:37,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287144::DEBUG::2014-01-16 16:49:38,252::task::579::TaskManager.Task::(_updateState) Task=`36901d4a-c0d7-489f-99ea-d277219b7e17`::moving from state init -> state preparing >Thread-287144::INFO::2014-01-16 16:49:38,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287144::INFO::2014-01-16 16:49:38,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281378', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022546', 'lastCheck': '7.7', 'valid': True}} >Thread-287144::DEBUG::2014-01-16 16:49:38,252::task::1168::TaskManager.Task::(prepare) Task=`36901d4a-c0d7-489f-99ea-d277219b7e17`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281378', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022546', 'lastCheck': '7.7', 'valid': True}} >Thread-287144::DEBUG::2014-01-16 16:49:38,253::task::579::TaskManager.Task::(_updateState) Task=`36901d4a-c0d7-489f-99ea-d277219b7e17`::moving from state preparing -> state finished >Thread-287144::DEBUG::2014-01-16 16:49:38,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287144::DEBUG::2014-01-16 16:49:38,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287144::DEBUG::2014-01-16 16:49:38,253::task::974::TaskManager.Task::(_decref) Task=`36901d4a-c0d7-489f-99ea-d277219b7e17`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:38,869::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:49:38,870::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:49:38,870::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:49:38,870::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:38,870::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:49:38,871::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-3168::DEBUG::2014-01-16 16:49:38,939::task::579::TaskManager.Task::(_updateState) Task=`2eec0afa-dc9b-43aa-8cae-80705cb2a280`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:49:38,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:49:38,939::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:49:38,939::task::1168::TaskManager.Task::(prepare) Task=`2eec0afa-dc9b-43aa-8cae-80705cb2a280`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:49:38,940::task::579::TaskManager.Task::(_updateState) Task=`2eec0afa-dc9b-43aa-8cae-80705cb2a280`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:49:38,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:49:38,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:49:38,940::task::974::TaskManager.Task::(_decref) Task=`2eec0afa-dc9b-43aa-8cae-80705cb2a280`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:39,037::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:39,872::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:49:39,889::task::579::TaskManager.Task::(_updateState) Task=`e4f0ef5e-93b7-4e05-bd8b-5b398b644a6a`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:49:39,890::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:49:39,890::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:49:39,890::task::1168::TaskManager.Task::(prepare) Task=`e4f0ef5e-93b7-4e05-bd8b-5b398b644a6a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:49:39,890::task::579::TaskManager.Task::(_updateState) Task=`e4f0ef5e-93b7-4e05-bd8b-5b398b644a6a`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:49:39,891::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:49:39,891::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:49:39,891::task::974::TaskManager.Task::(_decref) Task=`e4f0ef5e-93b7-4e05-bd8b-5b398b644a6a`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:49:39,894::task::579::TaskManager.Task::(_updateState) Task=`781cc0de-4b6e-4990-a9a9-b7da693ca231`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:49:39,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:49:39,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:49:39,895::task::1168::TaskManager.Task::(prepare) Task=`781cc0de-4b6e-4990-a9a9-b7da693ca231`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:49:39,895::task::579::TaskManager.Task::(_updateState) Task=`781cc0de-4b6e-4990-a9a9-b7da693ca231`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:49:39,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:49:39,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:49:39,895::task::974::TaskManager.Task::(_decref) Task=`781cc0de-4b6e-4990-a9a9-b7da693ca231`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:49:39,974::task::579::TaskManager.Task::(_updateState) Task=`deb19c4a-c992-4b05-a523-2b38230406d2`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:49:39,974::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:49:39,974::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:49:39,974::task::1168::TaskManager.Task::(prepare) Task=`deb19c4a-c992-4b05-a523-2b38230406d2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:49:39,974::task::579::TaskManager.Task::(_updateState) Task=`deb19c4a-c992-4b05-a523-2b38230406d2`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:49:39,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:49:39,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:49:39,975::task::974::TaskManager.Task::(_decref) Task=`deb19c4a-c992-4b05-a523-2b38230406d2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:40,038::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:49:40,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:49:40,576::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000239107 s, 17.1 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 16:49:40,756::task::579::TaskManager.Task::(_updateState) Task=`eb51e069-b3e5-40ae-9bd7-13bb636b37e3`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:49:40,757::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:49:40,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:49:40,757::task::1168::TaskManager.Task::(prepare) Task=`eb51e069-b3e5-40ae-9bd7-13bb636b37e3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:49:40,758::task::579::TaskManager.Task::(_updateState) Task=`eb51e069-b3e5-40ae-9bd7-13bb636b37e3`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:49:40,758::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:49:40,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:49:40,758::task::974::TaskManager.Task::(_decref) Task=`eb51e069-b3e5-40ae-9bd7-13bb636b37e3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:49:40,863::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:49:40,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:49:40,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:49:40,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:49:40,893::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000332519 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:49:40,945::task::579::TaskManager.Task::(_updateState) Task=`d8e449d7-14bd-4310-96ae-350b946185a0`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:49:40,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:49:40,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:49:40,946::task::1168::TaskManager.Task::(prepare) Task=`d8e449d7-14bd-4310-96ae-350b946185a0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:49:40,946::task::579::TaskManager.Task::(_updateState) Task=`d8e449d7-14bd-4310-96ae-350b946185a0`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:49:40,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:49:40,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:49:40,946::task::974::TaskManager.Task::(_decref) Task=`d8e449d7-14bd-4310-96ae-350b946185a0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:49:41,040::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:41,891::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:49:41,891::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:49:41,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:42,892::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:49:42,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:49:42,895::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:49:42,896::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:43,041::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:43,899::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:44,900::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:49:44,901::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:45,042::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:45,044::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:49:45,044::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:49:45,045::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:49:45,269::task::579::TaskManager.Task::(_updateState) Task=`f964d677-db78-4c93-a7c1-93bef4d90bba`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:49:45,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:49:45,270::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:49:45,270::task::1168::TaskManager.Task::(prepare) Task=`f964d677-db78-4c93-a7c1-93bef4d90bba`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:49:45,270::task::579::TaskManager.Task::(_updateState) Task=`f964d677-db78-4c93-a7c1-93bef4d90bba`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:49:45,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:49:45,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:49:45,271::task::974::TaskManager.Task::(_decref) Task=`f964d677-db78-4c93-a7c1-93bef4d90bba`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:49:45,271::task::579::TaskManager.Task::(_updateState) Task=`a5df604b-f518-4680-b1c0-5ceed71cdd36`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:49:45,271::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:49:45,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:49:45,272::task::1168::TaskManager.Task::(prepare) Task=`a5df604b-f518-4680-b1c0-5ceed71cdd36`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:49:45,272::task::579::TaskManager.Task::(_updateState) Task=`a5df604b-f518-4680-b1c0-5ceed71cdd36`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:49:45,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:49:45,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:49:45,272::task::974::TaskManager.Task::(_decref) Task=`a5df604b-f518-4680-b1c0-5ceed71cdd36`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:49:45,272::task::579::TaskManager.Task::(_updateState) Task=`87b4e43c-180a-4d4a-8a04-e99025658db7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:49:45,273::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:49:45,273::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:49:45,273::task::1168::TaskManager.Task::(prepare) Task=`87b4e43c-180a-4d4a-8a04-e99025658db7`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:49:45,273::task::579::TaskManager.Task::(_updateState) Task=`87b4e43c-180a-4d4a-8a04-e99025658db7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:49:45,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:49:45,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:49:45,274::task::974::TaskManager.Task::(_decref) Task=`87b4e43c-180a-4d4a-8a04-e99025658db7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:45,902::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:46,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:47,047::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:47,904::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:49:48,635::task::579::TaskManager.Task::(_updateState) Task=`5688f282-8b94-4a68-8edd-59cfed8680df`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:49:48,642::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:49:48,642::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:49:48,642::task::1168::TaskManager.Task::(prepare) Task=`5688f282-8b94-4a68-8edd-59cfed8680df`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:49:48,643::task::579::TaskManager.Task::(_updateState) Task=`5688f282-8b94-4a68-8edd-59cfed8680df`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:49:48,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:49:48,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:49:48,643::task::974::TaskManager.Task::(_decref) Task=`5688f282-8b94-4a68-8edd-59cfed8680df`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:48,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:49,048::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:49,907::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:50,049::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:49:50,582::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:49:50,598::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026329 s, 15.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:49:50,902::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:49:50,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:49:50,926::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:49:50,933::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000276108 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:49:51,051::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:51,929::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:52,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:53,052::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:49:53,415::task::579::TaskManager.Task::(_updateState) Task=`e3694b6e-981a-4b66-b378-731c7b990735`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:49:53,415::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:49:53,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:49:53,416::task::1168::TaskManager.Task::(prepare) Task=`e3694b6e-981a-4b66-b378-731c7b990735`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:49:53,416::task::579::TaskManager.Task::(_updateState) Task=`e3694b6e-981a-4b66-b378-731c7b990735`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:49:53,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:49:53,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:49:53,417::task::974::TaskManager.Task::(_decref) Task=`e3694b6e-981a-4b66-b378-731c7b990735`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:53,932::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287150::DEBUG::2014-01-16 16:49:54,037::task::579::TaskManager.Task::(_updateState) Task=`4ef4cd2b-93b7-4ddb-8de7-b84264444f06`::moving from state init -> state preparing >Thread-287150::INFO::2014-01-16 16:49:54,038::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287150::INFO::2014-01-16 16:49:54,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276108', 'lastCheck': '3.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026329', 'lastCheck': '3.4', 'valid': True}} >Thread-287150::DEBUG::2014-01-16 16:49:54,038::task::1168::TaskManager.Task::(prepare) Task=`4ef4cd2b-93b7-4ddb-8de7-b84264444f06`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000276108', 'lastCheck': '3.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026329', 'lastCheck': '3.4', 'valid': True}} >Thread-287150::DEBUG::2014-01-16 16:49:54,038::task::579::TaskManager.Task::(_updateState) Task=`4ef4cd2b-93b7-4ddb-8de7-b84264444f06`::moving from state preparing -> state finished >Thread-287150::DEBUG::2014-01-16 16:49:54,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287150::DEBUG::2014-01-16 16:49:54,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287150::DEBUG::2014-01-16 16:49:54,039::task::974::TaskManager.Task::(_decref) Task=`4ef4cd2b-93b7-4ddb-8de7-b84264444f06`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:49:54,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:55,053::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:49:55,054::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:55,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:49:55,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:49:55,935::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:56,936::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:49:56,937::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:57,056::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:57,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:49:57,938::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:49:57,939::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:49:58,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:49:58,939::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:49:59,057::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:49:59,940::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:49:59,940::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:49:59,993::task::579::TaskManager.Task::(_updateState) Task=`0569cc38-0799-4d5d-b1c5-eecb8de4dd3b`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:49:59,993::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:49:59,994::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:49:59,994::task::1168::TaskManager.Task::(prepare) Task=`0569cc38-0799-4d5d-b1c5-eecb8de4dd3b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:49:59,994::task::579::TaskManager.Task::(_updateState) Task=`0569cc38-0799-4d5d-b1c5-eecb8de4dd3b`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:49:59,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:49:59,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:49:59,994::task::974::TaskManager.Task::(_decref) Task=`0569cc38-0799-4d5d-b1c5-eecb8de4dd3b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:50:00,059::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:50:00,059::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:50:00,060::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:50:00,604::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:50:00,621::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000231543 s, 17.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-01-16 16:50:00,941::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:50:00,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:50:00,970::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000259315 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:50:01,062::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:01,964::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:50:01,965::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:02,966::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:50:02,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:03,063::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:03,967::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:50:03,968::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:50:03,968::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:50:03,968::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:04,969::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:50:04,970::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:50:04,970::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:05,065::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:05,072::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:50:05,828::task::579::TaskManager.Task::(_updateState) Task=`3512d5f0-8241-4ae4-b229-a7ababf70e95`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:50:05,828::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:50:05,829::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:50:05,829::task::1168::TaskManager.Task::(prepare) Task=`3512d5f0-8241-4ae4-b229-a7ababf70e95`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:50:05,829::task::579::TaskManager.Task::(_updateState) Task=`3512d5f0-8241-4ae4-b229-a7ababf70e95`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:50:05,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:50:05,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:50:05,829::task::974::TaskManager.Task::(_decref) Task=`3512d5f0-8241-4ae4-b229-a7ababf70e95`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:50:05,830::task::579::TaskManager.Task::(_updateState) Task=`b4b890be-7573-406e-a1db-8a95e065779b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:50:05,830::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:50:05,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:50:05,830::task::1168::TaskManager.Task::(prepare) Task=`b4b890be-7573-406e-a1db-8a95e065779b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:50:05,830::task::579::TaskManager.Task::(_updateState) Task=`b4b890be-7573-406e-a1db-8a95e065779b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:50:05,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:50:05,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:50:05,831::task::974::TaskManager.Task::(_decref) Task=`b4b890be-7573-406e-a1db-8a95e065779b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:05,971::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:50:05,971::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:50:06,329::task::579::TaskManager.Task::(_updateState) Task=`c0fa7cfa-db53-4e5b-82f0-2164c9d2a11c`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:50:06,329::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:50:06,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:50:06,331::task::1168::TaskManager.Task::(prepare) Task=`c0fa7cfa-db53-4e5b-82f0-2164c9d2a11c`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:50:06,331::task::579::TaskManager.Task::(_updateState) Task=`c0fa7cfa-db53-4e5b-82f0-2164c9d2a11c`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:50:06,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:50:06,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:50:06,331::task::974::TaskManager.Task::(_decref) Task=`c0fa7cfa-db53-4e5b-82f0-2164c9d2a11c`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:50:06,340::task::579::TaskManager.Task::(_updateState) Task=`c874ce1d-ad82-4316-bad0-e2142e8f5f40`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:50:06,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:50:06,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:50:06,341::task::1168::TaskManager.Task::(prepare) Task=`c874ce1d-ad82-4316-bad0-e2142e8f5f40`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:50:06,341::task::579::TaskManager.Task::(_updateState) Task=`c874ce1d-ad82-4316-bad0-e2142e8f5f40`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:50:06,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:50:06,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:50:06,342::task::974::TaskManager.Task::(_decref) Task=`c874ce1d-ad82-4316-bad0-e2142e8f5f40`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:06,973::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:50:06,973::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:50:06,973::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:50:06,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:50:06,984::task::579::TaskManager.Task::(_updateState) Task=`15c9ed96-f87e-43f2-95e4-2df55aecaa2b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:50:06,984::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:50:06,984::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:50:06,984::task::1168::TaskManager.Task::(prepare) Task=`15c9ed96-f87e-43f2-95e4-2df55aecaa2b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:50:06,985::task::579::TaskManager.Task::(_updateState) Task=`15c9ed96-f87e-43f2-95e4-2df55aecaa2b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:50:06,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:50:06,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:50:06,985::task::974::TaskManager.Task::(_decref) Task=`15c9ed96-f87e-43f2-95e4-2df55aecaa2b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:50:07,073::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:07,975::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:50:08,024::task::579::TaskManager.Task::(_updateState) Task=`f31271af-e895-46c5-b214-129df4280c9e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:50:08,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:50:08,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:50:08,025::task::1168::TaskManager.Task::(prepare) Task=`f31271af-e895-46c5-b214-129df4280c9e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:50:08,025::task::579::TaskManager.Task::(_updateState) Task=`f31271af-e895-46c5-b214-129df4280c9e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:50:08,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:50:08,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:50:08,026::task::974::TaskManager.Task::(_decref) Task=`f31271af-e895-46c5-b214-129df4280c9e`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:50:08,026::task::579::TaskManager.Task::(_updateState) Task=`1a223723-f264-4f70-a3fb-e23238eabfa5`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:50:08,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:50:08,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:50:08,027::task::1168::TaskManager.Task::(prepare) Task=`1a223723-f264-4f70-a3fb-e23238eabfa5`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:50:08,027::task::579::TaskManager.Task::(_updateState) Task=`1a223723-f264-4f70-a3fb-e23238eabfa5`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:50:08,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:50:08,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:50:08,027::task::974::TaskManager.Task::(_decref) Task=`1a223723-f264-4f70-a3fb-e23238eabfa5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:08,975::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:50:08,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:50:08,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:50:08,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:08,976::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:50:08,977::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:50:09,075::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:50:09,268::task::579::TaskManager.Task::(_updateState) Task=`2ccb1b14-bdca-4182-871f-9649bdb98b18`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:50:09,268::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:50:09,269::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:50:09,269::task::1168::TaskManager.Task::(prepare) Task=`2ccb1b14-bdca-4182-871f-9649bdb98b18`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:50:09,269::task::579::TaskManager.Task::(_updateState) Task=`2ccb1b14-bdca-4182-871f-9649bdb98b18`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:50:09,269::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:50:09,269::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:50:09,269::task::974::TaskManager.Task::(_decref) Task=`2ccb1b14-bdca-4182-871f-9649bdb98b18`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:50:09,270::task::579::TaskManager.Task::(_updateState) Task=`0baa337e-8d7b-4d50-88ca-7450f0e6fb53`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:50:09,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:50:09,270::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:50:09,270::task::1168::TaskManager.Task::(prepare) Task=`0baa337e-8d7b-4d50-88ca-7450f0e6fb53`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:50:09,270::task::579::TaskManager.Task::(_updateState) Task=`0baa337e-8d7b-4d50-88ca-7450f0e6fb53`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:50:09,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:50:09,271::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:50:09,271::task::974::TaskManager.Task::(_decref) Task=`0baa337e-8d7b-4d50-88ca-7450f0e6fb53`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:50:09,271::task::579::TaskManager.Task::(_updateState) Task=`9b7f10eb-ec56-42a3-9f0d-b97d3aaa02f9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:50:09,271::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:50:09,272::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:50:09,272::task::1168::TaskManager.Task::(prepare) Task=`9b7f10eb-ec56-42a3-9f0d-b97d3aaa02f9`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:50:09,272::task::579::TaskManager.Task::(_updateState) Task=`9b7f10eb-ec56-42a3-9f0d-b97d3aaa02f9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:50:09,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:50:09,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:50:09,272::task::974::TaskManager.Task::(_decref) Task=`9b7f10eb-ec56-42a3-9f0d-b97d3aaa02f9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:09,978::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:10,076::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287156::DEBUG::2014-01-16 16:50:10,081::task::579::TaskManager.Task::(_updateState) Task=`c942b097-7278-4aa9-9998-a846ca325e72`::moving from state init -> state preparing >Thread-287156::INFO::2014-01-16 16:50:10,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287156::INFO::2014-01-16 16:50:10,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259315', 'lastCheck': '9.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231543', 'lastCheck': '9.5', 'valid': True}} >Thread-287156::DEBUG::2014-01-16 16:50:10,082::task::1168::TaskManager.Task::(prepare) Task=`c942b097-7278-4aa9-9998-a846ca325e72`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259315', 'lastCheck': '9.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231543', 'lastCheck': '9.5', 'valid': True}} >Thread-287156::DEBUG::2014-01-16 16:50:10,082::task::579::TaskManager.Task::(_updateState) Task=`c942b097-7278-4aa9-9998-a846ca325e72`::moving from state preparing -> state finished >Thread-287156::DEBUG::2014-01-16 16:50:10,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287156::DEBUG::2014-01-16 16:50:10,082::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287156::DEBUG::2014-01-16 16:50:10,083::task::974::TaskManager.Task::(_decref) Task=`c942b097-7278-4aa9-9998-a846ca325e72`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:50:10,624::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:50:10,625::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:50:10,625::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:50:10,625::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:50:10,628::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:50:10,644::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000250289 s, 8.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:10,644::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000250289 s, 8.2 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:50:10,644::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:50:10,645::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:50:10,645::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:50:10,645::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:50:10,645::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:50:10,646::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:50:10,646::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:50:10,646::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:50:10,647::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 16:50:10,889::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:10,892::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:50:10,893::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:50:10,894::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:50:10,894::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:50:10,894::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 16:50:10,895::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:50:10,979::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:50:10,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:50:10,985::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 16:50:10,991::task::579::TaskManager.Task::(_updateState) Task=`2ccd093e-c039-43aa-8330-3a52ffb5ae88`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:50:10,995::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:50:10,999::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:50:11,000::task::1168::TaskManager.Task::(prepare) Task=`2ccd093e-c039-43aa-8330-3a52ffb5ae88`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:50:11,002::task::579::TaskManager.Task::(_updateState) Task=`2ccd093e-c039-43aa-8330-3a52ffb5ae88`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:50:11,003::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:50:11,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:50:11,007::task::974::TaskManager.Task::(_decref) Task=`2ccd093e-c039-43aa-8330-3a52ffb5ae88`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:50:11,010::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:50:11,028::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000280936 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:11,073::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:11,076::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:50:11,093::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:50:11,096::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000243796 s, 16.8 MB/s\n'; <rc> = 0 >Thread-26403::DEBUG::2014-01-16 16:50:11,142::task::579::TaskManager.Task::(_updateState) Task=`a95c0202-2242-456d-b975-ae4c63f322f4`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:50:11,142::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:50:11,142::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:50:11,142::task::1168::TaskManager.Task::(prepare) Task=`a95c0202-2242-456d-b975-ae4c63f322f4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:50:11,143::task::579::TaskManager.Task::(_updateState) Task=`a95c0202-2242-456d-b975-ae4c63f322f4`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:50:11,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:50:11,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:50:11,143::task::974::TaskManager.Task::(_decref) Task=`a95c0202-2242-456d-b975-ae4c63f322f4`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:50:11,795::task::579::TaskManager.Task::(_updateState) Task=`c88ccdae-e270-468b-8ba2-4d86b4b8b0dc`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:50:11,795::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:50:11,796::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:50:11,796::task::1168::TaskManager.Task::(prepare) Task=`c88ccdae-e270-468b-8ba2-4d86b4b8b0dc`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:50:11,796::task::579::TaskManager.Task::(_updateState) Task=`c88ccdae-e270-468b-8ba2-4d86b4b8b0dc`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:50:11,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:50:11,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:50:11,797::task::974::TaskManager.Task::(_decref) Task=`c88ccdae-e270-468b-8ba2-4d86b4b8b0dc`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:50:11,797::task::579::TaskManager.Task::(_updateState) Task=`1a57a4cf-8fe8-431f-9cff-e9390fc12ae8`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:50:11,797::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:50:11,797::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:50:11,797::task::1168::TaskManager.Task::(prepare) Task=`1a57a4cf-8fe8-431f-9cff-e9390fc12ae8`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:50:11,798::task::579::TaskManager.Task::(_updateState) Task=`1a57a4cf-8fe8-431f-9cff-e9390fc12ae8`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:50:11,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:50:11,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:50:11,798::task::974::TaskManager.Task::(_decref) Task=`1a57a4cf-8fe8-431f-9cff-e9390fc12ae8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:11,989::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:50:11,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:50:11,990::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:50:12,439::task::579::TaskManager.Task::(_updateState) Task=`91183b5b-87d1-422f-a73c-d86de31b8b32`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:50:12,439::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:50:12,440::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:50:12,440::task::1168::TaskManager.Task::(prepare) Task=`91183b5b-87d1-422f-a73c-d86de31b8b32`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:50:12,440::task::579::TaskManager.Task::(_updateState) Task=`91183b5b-87d1-422f-a73c-d86de31b8b32`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:50:12,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:50:12,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:50:12,440::task::974::TaskManager.Task::(_decref) Task=`91183b5b-87d1-422f-a73c-d86de31b8b32`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:12,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:50:12,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:50:12,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:50:12,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:13,096::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:50:13,403::task::579::TaskManager.Task::(_updateState) Task=`40270550-e4b5-46dd-a8f4-bef8d6a74be9`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:50:13,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:50:13,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:50:13,404::task::1168::TaskManager.Task::(prepare) Task=`40270550-e4b5-46dd-a8f4-bef8d6a74be9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:50:13,404::task::579::TaskManager.Task::(_updateState) Task=`40270550-e4b5-46dd-a8f4-bef8d6a74be9`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:50:13,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:50:13,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:50:13,405::task::974::TaskManager.Task::(_decref) Task=`40270550-e4b5-46dd-a8f4-bef8d6a74be9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:13,993::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:14,995::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:50:14,995::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:15,098::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:15,099::task::579::TaskManager.Task::(_updateState) Task=`32a261f7-3c73-4a17-82e5-0860a954ca5a`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:50:15,099::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:50:15,100::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:50:15,100::task::1168::TaskManager.Task::(prepare) Task=`32a261f7-3c73-4a17-82e5-0860a954ca5a`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:50:15,100::task::579::TaskManager.Task::(_updateState) Task=`32a261f7-3c73-4a17-82e5-0860a954ca5a`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:50:15,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:50:15,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:50:15,101::task::974::TaskManager.Task::(_decref) Task=`32a261f7-3c73-4a17-82e5-0860a954ca5a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:50:15,103::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:50:15,103::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:50:15,110::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:15,113::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:15,114::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:15,996::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:50:16,695::task::579::TaskManager.Task::(_updateState) Task=`b693d8ed-7a5d-4691-83da-bdeaab8af3ae`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:50:16,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:50:16,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:50:16,696::task::1168::TaskManager.Task::(prepare) Task=`b693d8ed-7a5d-4691-83da-bdeaab8af3ae`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:50:16,696::task::579::TaskManager.Task::(_updateState) Task=`b693d8ed-7a5d-4691-83da-bdeaab8af3ae`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:50:16,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:50:16,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:50:16,696::task::974::TaskManager.Task::(_decref) Task=`b693d8ed-7a5d-4691-83da-bdeaab8af3ae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:16,997::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:17,116::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:50:17,765::task::579::TaskManager.Task::(_updateState) Task=`8f140b61-8db4-489c-8112-413b95c5ba1e`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:50:17,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:50:17,767::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:50:17,767::task::1168::TaskManager.Task::(prepare) Task=`8f140b61-8db4-489c-8112-413b95c5ba1e`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:50:17,767::task::579::TaskManager.Task::(_updateState) Task=`8f140b61-8db4-489c-8112-413b95c5ba1e`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:50:17,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:50:17,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:50:17,767::task::974::TaskManager.Task::(_decref) Task=`8f140b61-8db4-489c-8112-413b95c5ba1e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:17,998::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:19,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:19,117::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:20,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:50:20,116::task::579::TaskManager.Task::(_updateState) Task=`05c31c51-e017-4a28-874e-1ac2b7574438`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:50:20,117::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:50:20,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:50:20,117::task::1168::TaskManager.Task::(prepare) Task=`05c31c51-e017-4a28-874e-1ac2b7574438`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:50:20,117::task::579::TaskManager.Task::(_updateState) Task=`05c31c51-e017-4a28-874e-1ac2b7574438`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:50:20,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:50:20,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:50:20,118::task::974::TaskManager.Task::(_decref) Task=`05c31c51-e017-4a28-874e-1ac2b7574438`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:50:20,119::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:21,001::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:50:21,001::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:50:21,035::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:50:21,052::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000324964 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:21,102::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:50:21,117::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000315343 s, 13.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:50:21,121::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:22,002::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:23,003::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:23,122::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:24,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:25,005::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:25,123::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:25,125::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:50:25,754::task::579::TaskManager.Task::(_updateState) Task=`d2bc582d-ce37-4f7f-9a70-aecfdc2458f3`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:50:25,754::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:50:25,755::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:50:25,756::task::1168::TaskManager.Task::(prepare) Task=`d2bc582d-ce37-4f7f-9a70-aecfdc2458f3`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:50:25,756::task::579::TaskManager.Task::(_updateState) Task=`d2bc582d-ce37-4f7f-9a70-aecfdc2458f3`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:50:25,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:50:25,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:50:25,756::task::974::TaskManager.Task::(_decref) Task=`d2bc582d-ce37-4f7f-9a70-aecfdc2458f3`::ref 0 aborting False >Thread-287162::DEBUG::2014-01-16 16:50:25,953::task::579::TaskManager.Task::(_updateState) Task=`c2b7fcec-3090-40c0-9daa-bc6b7687248b`::moving from state init -> state preparing >Thread-287162::INFO::2014-01-16 16:50:25,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287162::INFO::2014-01-16 16:50:25,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324964', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315343', 'lastCheck': '4.8', 'valid': True}} >Thread-287162::DEBUG::2014-01-16 16:50:25,953::task::1168::TaskManager.Task::(prepare) Task=`c2b7fcec-3090-40c0-9daa-bc6b7687248b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324964', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315343', 'lastCheck': '4.8', 'valid': True}} >Thread-287162::DEBUG::2014-01-16 16:50:25,953::task::579::TaskManager.Task::(_updateState) Task=`c2b7fcec-3090-40c0-9daa-bc6b7687248b`::moving from state preparing -> state finished >Thread-287162::DEBUG::2014-01-16 16:50:25,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287162::DEBUG::2014-01-16 16:50:25,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287162::DEBUG::2014-01-16 16:50:25,954::task::974::TaskManager.Task::(_decref) Task=`c2b7fcec-3090-40c0-9daa-bc6b7687248b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:26,006::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:50:26,006::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:50:26,007::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:27,008::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:50:27,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:27,126::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:28,009::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >Thread-189046::DEBUG::2014-01-16 16:50:28,010::task::579::TaskManager.Task::(_updateState) Task=`291ddab2-4eb8-47f1-bc0f-1833678204de`::moving from state init -> state preparing >VM Channels Listener::DEBUG::2014-01-16 16:50:28,010::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >Thread-189046::INFO::2014-01-16 16:50:28,010::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >VM Channels Listener::DEBUG::2014-01-16 16:50:28,011::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::INFO::2014-01-16 16:50:28,012::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:50:28,012::task::1168::TaskManager.Task::(prepare) Task=`291ddab2-4eb8-47f1-bc0f-1833678204de`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:50:28,012::task::579::TaskManager.Task::(_updateState) Task=`291ddab2-4eb8-47f1-bc0f-1833678204de`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:50:28,012::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:50:28,012::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:50:28,012::task::974::TaskManager.Task::(_decref) Task=`291ddab2-4eb8-47f1-bc0f-1833678204de`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:29,012::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:50:29,013::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:29,127::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:50:29,944::task::579::TaskManager.Task::(_updateState) Task=`7d675490-0038-42fd-80e8-6ac4f7fb588b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:50:29,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:50:29,945::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:50:29,945::task::1168::TaskManager.Task::(prepare) Task=`7d675490-0038-42fd-80e8-6ac4f7fb588b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:50:29,945::task::579::TaskManager.Task::(_updateState) Task=`7d675490-0038-42fd-80e8-6ac4f7fb588b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:50:29,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:50:29,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:50:29,946::task::974::TaskManager.Task::(_decref) Task=`7d675490-0038-42fd-80e8-6ac4f7fb588b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:50:29,946::task::579::TaskManager.Task::(_updateState) Task=`1f213527-984f-430f-97e2-051bc92a4188`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:50:29,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:50:29,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:50:29,947::task::1168::TaskManager.Task::(prepare) Task=`1f213527-984f-430f-97e2-051bc92a4188`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:50:29,947::task::579::TaskManager.Task::(_updateState) Task=`1f213527-984f-430f-97e2-051bc92a4188`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:50:29,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:50:29,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:50:29,947::task::974::TaskManager.Task::(_decref) Task=`1f213527-984f-430f-97e2-051bc92a4188`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:30,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:50:30,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:30,129::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:50:30,129::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:50:30,130::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:31,015::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:50:31,060::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:50:31,077::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000298672 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:31,123::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:50:31,138::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:50:31,142::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000326184 s, 12.6 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:50:31,686::task::579::TaskManager.Task::(_updateState) Task=`91a6e2e3-a4b8-4491-b337-d5d4105ee591`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:50:31,687::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:50:31,687::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:50:31,687::task::1168::TaskManager.Task::(prepare) Task=`91a6e2e3-a4b8-4491-b337-d5d4105ee591`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:50:31,687::task::579::TaskManager.Task::(_updateState) Task=`91a6e2e3-a4b8-4491-b337-d5d4105ee591`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:50:31,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:50:31,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:50:31,688::task::974::TaskManager.Task::(_decref) Task=`91a6e2e3-a4b8-4491-b337-d5d4105ee591`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:50:31,708::task::579::TaskManager.Task::(_updateState) Task=`a150d89a-62dd-40e2-ae80-0093cd08220f`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:50:31,708::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:50:31,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:50:31,709::task::1168::TaskManager.Task::(prepare) Task=`a150d89a-62dd-40e2-ae80-0093cd08220f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:50:31,709::task::579::TaskManager.Task::(_updateState) Task=`a150d89a-62dd-40e2-ae80-0093cd08220f`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:50:31,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:50:31,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:50:31,709::task::974::TaskManager.Task::(_decref) Task=`a150d89a-62dd-40e2-ae80-0093cd08220f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:32,016::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:50:32,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:33,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:50:33,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:33,142::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:34,019::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:50:34,024::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:50:34,024::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:50:34,024::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:35,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:50:35,025::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:50:35,025::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:35,143::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:35,144::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:36,026::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:50:36,027::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:50:36,730::task::579::TaskManager.Task::(_updateState) Task=`231b7617-2ec2-4912-8a97-6e6339e14eff`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:50:36,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:50:36,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:50:36,731::task::1168::TaskManager.Task::(prepare) Task=`231b7617-2ec2-4912-8a97-6e6339e14eff`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:50:36,731::task::579::TaskManager.Task::(_updateState) Task=`231b7617-2ec2-4912-8a97-6e6339e14eff`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:50:36,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:50:36,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:50:36,732::task::974::TaskManager.Task::(_decref) Task=`231b7617-2ec2-4912-8a97-6e6339e14eff`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:37,027::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:50:37,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:50:37,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:50:37,029::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:37,145::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:38,029::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:39,030::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:50:39,030::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:50:39,031::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:50:39,031::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:39,031::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:50:39,032::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-3168::DEBUG::2014-01-16 16:50:39,107::task::579::TaskManager.Task::(_updateState) Task=`51bd3e92-e833-490d-81f2-b5a04911e53b`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:50:39,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:50:39,107::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:50:39,108::task::1168::TaskManager.Task::(prepare) Task=`51bd3e92-e833-490d-81f2-b5a04911e53b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:50:39,108::task::579::TaskManager.Task::(_updateState) Task=`51bd3e92-e833-490d-81f2-b5a04911e53b`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:50:39,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:50:39,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:50:39,108::task::974::TaskManager.Task::(_decref) Task=`51bd3e92-e833-490d-81f2-b5a04911e53b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:50:39,146::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:40,033::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:50:40,080::task::579::TaskManager.Task::(_updateState) Task=`cbdbc860-4668-43e7-a13b-a1a316833f73`::moving from state init -> state preparing >Thread-16398::DEBUG::2014-01-16 16:50:40,080::task::579::TaskManager.Task::(_updateState) Task=`897349dc-9a91-4339-a237-d079e96fe164`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:50:40,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16398::INFO::2014-01-16 16:50:40,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16393::INFO::2014-01-16 16:50:40,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::INFO::2014-01-16 16:50:40,082::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:50:40,082::task::1168::TaskManager.Task::(prepare) Task=`cbdbc860-4668-43e7-a13b-a1a316833f73`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:50:40,082::task::1168::TaskManager.Task::(prepare) Task=`897349dc-9a91-4339-a237-d079e96fe164`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:50:40,082::task::579::TaskManager.Task::(_updateState) Task=`cbdbc860-4668-43e7-a13b-a1a316833f73`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:50:40,082::task::579::TaskManager.Task::(_updateState) Task=`897349dc-9a91-4339-a237-d079e96fe164`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:50:40,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:50:40,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:50:40,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:50:40,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:50:40,084::task::974::TaskManager.Task::(_decref) Task=`cbdbc860-4668-43e7-a13b-a1a316833f73`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:50:40,084::task::974::TaskManager.Task::(_decref) Task=`897349dc-9a91-4339-a237-d079e96fe164`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:50:40,148::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-69607::DEBUG::2014-01-16 16:50:40,160::task::579::TaskManager.Task::(_updateState) Task=`a1cc496d-0902-4853-a833-b63ab2c5393a`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:50:40,160::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:50:40,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:50:40,160::task::1168::TaskManager.Task::(prepare) Task=`a1cc496d-0902-4853-a833-b63ab2c5393a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:50:40,160::task::579::TaskManager.Task::(_updateState) Task=`a1cc496d-0902-4853-a833-b63ab2c5393a`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:50:40,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:50:40,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:50:40,161::task::974::TaskManager.Task::(_decref) Task=`a1cc496d-0902-4853-a833-b63ab2c5393a`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:50:40,921::task::579::TaskManager.Task::(_updateState) Task=`d79eaa0b-d0b9-45fa-8ec4-1a965b8808c9`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:50:40,921::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:50:40,921::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:50:40,921::task::1168::TaskManager.Task::(prepare) Task=`d79eaa0b-d0b9-45fa-8ec4-1a965b8808c9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:50:40,921::task::579::TaskManager.Task::(_updateState) Task=`d79eaa0b-d0b9-45fa-8ec4-1a965b8808c9`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:50:40,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:50:40,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:50:40,922::task::974::TaskManager.Task::(_decref) Task=`d79eaa0b-d0b9-45fa-8ec4-1a965b8808c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:41,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:50:41,035::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:50:41,035::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:50:41,085::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:50:41,103::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000256531 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:50:41,113::task::579::TaskManager.Task::(_updateState) Task=`140b7c48-7e5e-4ef1-a330-23961d61f020`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:50:41,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:50:41,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:50:41,114::task::1168::TaskManager.Task::(prepare) Task=`140b7c48-7e5e-4ef1-a330-23961d61f020`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:50:41,114::task::579::TaskManager.Task::(_updateState) Task=`140b7c48-7e5e-4ef1-a330-23961d61f020`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:50:41,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:50:41,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:50:41,115::task::974::TaskManager.Task::(_decref) Task=`140b7c48-7e5e-4ef1-a330-23961d61f020`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:50:41,147::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:50:41,164::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:50:41,168::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000284432 s, 14.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:50:42,036::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:50:42,036::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:50:42,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287168::DEBUG::2014-01-16 16:50:42,516::task::579::TaskManager.Task::(_updateState) Task=`0a168651-f500-4c5c-b5cf-f66465c4cafe`::moving from state init -> state preparing >Thread-287168::INFO::2014-01-16 16:50:42,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287168::INFO::2014-01-16 16:50:42,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256531', 'lastCheck': '1.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284432', 'lastCheck': '1.3', 'valid': True}} >Thread-287168::DEBUG::2014-01-16 16:50:42,517::task::1168::TaskManager.Task::(prepare) Task=`0a168651-f500-4c5c-b5cf-f66465c4cafe`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000256531', 'lastCheck': '1.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284432', 'lastCheck': '1.3', 'valid': True}} >Thread-287168::DEBUG::2014-01-16 16:50:42,517::task::579::TaskManager.Task::(_updateState) Task=`0a168651-f500-4c5c-b5cf-f66465c4cafe`::moving from state preparing -> state finished >Thread-287168::DEBUG::2014-01-16 16:50:42,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287168::DEBUG::2014-01-16 16:50:42,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287168::DEBUG::2014-01-16 16:50:42,518::task::974::TaskManager.Task::(_decref) Task=`0a168651-f500-4c5c-b5cf-f66465c4cafe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:43,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:50:43,040::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:50:43,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:50:43,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:43,167::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:44,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:45,046::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:50:45,047::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:45,168::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:45,170::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:50:45,170::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:50:45,172::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:50:45,549::task::579::TaskManager.Task::(_updateState) Task=`49d09047-61b3-486c-8790-06443845f3fb`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:50:45,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:50:45,550::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:50:45,550::task::1168::TaskManager.Task::(prepare) Task=`49d09047-61b3-486c-8790-06443845f3fb`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:50:45,550::task::579::TaskManager.Task::(_updateState) Task=`49d09047-61b3-486c-8790-06443845f3fb`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:50:45,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:50:45,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:50:45,550::task::974::TaskManager.Task::(_decref) Task=`49d09047-61b3-486c-8790-06443845f3fb`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:50:45,551::task::579::TaskManager.Task::(_updateState) Task=`97451d71-c714-459f-8640-77d5fdac59a6`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:50:45,551::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:50:45,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:50:45,551::task::1168::TaskManager.Task::(prepare) Task=`97451d71-c714-459f-8640-77d5fdac59a6`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:50:45,551::task::579::TaskManager.Task::(_updateState) Task=`97451d71-c714-459f-8640-77d5fdac59a6`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:50:45,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:50:45,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:50:45,552::task::974::TaskManager.Task::(_decref) Task=`97451d71-c714-459f-8640-77d5fdac59a6`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:50:45,552::task::579::TaskManager.Task::(_updateState) Task=`aca7cb62-2a85-4335-8b9b-54931adc6bad`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:50:45,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:50:45,552::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:50:45,553::task::1168::TaskManager.Task::(prepare) Task=`aca7cb62-2a85-4335-8b9b-54931adc6bad`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:50:45,553::task::579::TaskManager.Task::(_updateState) Task=`aca7cb62-2a85-4335-8b9b-54931adc6bad`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:50:45,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:50:45,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:50:45,553::task::974::TaskManager.Task::(_decref) Task=`aca7cb62-2a85-4335-8b9b-54931adc6bad`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:46,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:47,050::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:47,173::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:48,051::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:50:48,803::task::579::TaskManager.Task::(_updateState) Task=`b1eac27b-723a-4c2b-a697-c3a61dfabb6b`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:50:48,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:50:48,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:50:48,804::task::1168::TaskManager.Task::(prepare) Task=`b1eac27b-723a-4c2b-a697-c3a61dfabb6b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:50:48,804::task::579::TaskManager.Task::(_updateState) Task=`b1eac27b-723a-4c2b-a697-c3a61dfabb6b`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:50:48,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:50:48,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:50:48,804::task::974::TaskManager.Task::(_decref) Task=`b1eac27b-723a-4c2b-a697-c3a61dfabb6b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:49,052::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:49,174::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:50,054::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:50,175::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:51,055::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:50:51,055::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:50:51,111::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:50:51,128::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00025636 s, 1.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:50:51,174::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:50:51,193::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:50:51,197::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000234809 s, 17.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:50:52,056::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:53,057::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:53,196::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:50:53,607::task::579::TaskManager.Task::(_updateState) Task=`7a7ea242-2338-408b-b2c6-c48da555f456`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:50:53,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:50:53,608::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:50:53,608::task::1168::TaskManager.Task::(prepare) Task=`7a7ea242-2338-408b-b2c6-c48da555f456`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:50:53,608::task::579::TaskManager.Task::(_updateState) Task=`7a7ea242-2338-408b-b2c6-c48da555f456`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:50:53,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:50:53,608::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:50:53,609::task::974::TaskManager.Task::(_decref) Task=`7a7ea242-2338-408b-b2c6-c48da555f456`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:54,058::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:55,060::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:55,197::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:50:55,198::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:56,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:50:56,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:50:56,061::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:50:57,062::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:50:57,063::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:57,199::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:50:58,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:50:58,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:50:58,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287174::DEBUG::2014-01-16 16:50:58,272::task::579::TaskManager.Task::(_updateState) Task=`706cd7c6-c6e4-4580-81e6-8086e5d5b372`::moving from state init -> state preparing >Thread-287174::INFO::2014-01-16 16:50:58,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287174::INFO::2014-01-16 16:50:58,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025636', 'lastCheck': '7.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234809', 'lastCheck': '7.1', 'valid': True}} >Thread-287174::DEBUG::2014-01-16 16:50:58,272::task::1168::TaskManager.Task::(prepare) Task=`706cd7c6-c6e4-4580-81e6-8086e5d5b372`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025636', 'lastCheck': '7.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234809', 'lastCheck': '7.1', 'valid': True}} >Thread-287174::DEBUG::2014-01-16 16:50:58,272::task::579::TaskManager.Task::(_updateState) Task=`706cd7c6-c6e4-4580-81e6-8086e5d5b372`::moving from state preparing -> state finished >Thread-287174::DEBUG::2014-01-16 16:50:58,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287174::DEBUG::2014-01-16 16:50:58,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287174::DEBUG::2014-01-16 16:50:58,273::task::974::TaskManager.Task::(_decref) Task=`706cd7c6-c6e4-4580-81e6-8086e5d5b372`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:50:59,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:50:59,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:50:59,201::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:00,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:51:00,066::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:51:00,157::task::579::TaskManager.Task::(_updateState) Task=`b3ac13eb-053e-424b-a90d-9326b222e527`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:51:00,157::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:51:00,158::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:51:00,158::task::1168::TaskManager.Task::(prepare) Task=`b3ac13eb-053e-424b-a90d-9326b222e527`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:51:00,158::task::579::TaskManager.Task::(_updateState) Task=`b3ac13eb-053e-424b-a90d-9326b222e527`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:51:00,158::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:51:00,158::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:51:00,159::task::974::TaskManager.Task::(_decref) Task=`b3ac13eb-053e-424b-a90d-9326b222e527`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:51:00,203::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:51:00,203::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:51:00,204::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:01,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:51:01,136::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:51:01,153::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000247609 s, 1.5 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:51:01,202::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:51:01,218::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:51:01,221::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000205723 s, 19.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:51:02,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:51:02,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:03,070::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:51:03,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:03,221::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:04,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:51:04,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:51:04,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:51:04,071::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:05,072::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:51:05,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:51:05,073::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:05,222::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:05,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 16:51:06,055::task::579::TaskManager.Task::(_updateState) Task=`5331d120-39fa-4ffd-b47b-83be9527bf23`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:51:06,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:51:06,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:51:06,056::task::1168::TaskManager.Task::(prepare) Task=`5331d120-39fa-4ffd-b47b-83be9527bf23`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:51:06,056::task::579::TaskManager.Task::(_updateState) Task=`5331d120-39fa-4ffd-b47b-83be9527bf23`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:51:06,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:51:06,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:51:06,057::task::974::TaskManager.Task::(_decref) Task=`5331d120-39fa-4ffd-b47b-83be9527bf23`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:51:06,057::task::579::TaskManager.Task::(_updateState) Task=`edbacdad-8e65-4dec-ada9-439febcdc3bf`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:51:06,057::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:51:06,057::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:51:06,057::task::1168::TaskManager.Task::(prepare) Task=`edbacdad-8e65-4dec-ada9-439febcdc3bf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:51:06,058::task::579::TaskManager.Task::(_updateState) Task=`edbacdad-8e65-4dec-ada9-439febcdc3bf`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:51:06,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:51:06,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:51:06,058::task::974::TaskManager.Task::(_decref) Task=`edbacdad-8e65-4dec-ada9-439febcdc3bf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:06,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:51:06,074::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:51:06,406::task::579::TaskManager.Task::(_updateState) Task=`327c8495-765a-463b-92e0-1248768f54e9`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:51:06,407::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:51:06,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:51:06,408::task::1168::TaskManager.Task::(prepare) Task=`327c8495-765a-463b-92e0-1248768f54e9`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:51:06,408::task::579::TaskManager.Task::(_updateState) Task=`327c8495-765a-463b-92e0-1248768f54e9`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:51:06,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:51:06,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:51:06,409::task::974::TaskManager.Task::(_decref) Task=`327c8495-765a-463b-92e0-1248768f54e9`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:51:06,412::task::579::TaskManager.Task::(_updateState) Task=`e06a56c3-bc0b-4996-8ca4-f699b2b5d464`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:51:06,412::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:51:06,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:51:06,413::task::1168::TaskManager.Task::(prepare) Task=`e06a56c3-bc0b-4996-8ca4-f699b2b5d464`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:51:06,413::task::579::TaskManager.Task::(_updateState) Task=`e06a56c3-bc0b-4996-8ca4-f699b2b5d464`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:51:06,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:51:06,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:51:06,413::task::974::TaskManager.Task::(_decref) Task=`e06a56c3-bc0b-4996-8ca4-f699b2b5d464`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:07,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:51:07,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:51:07,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:51:07,075::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 16:51:07,169::task::579::TaskManager.Task::(_updateState) Task=`7eb0e973-c472-4a06-9d70-56d0b45d8a8f`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:51:07,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:51:07,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:51:07,170::task::1168::TaskManager.Task::(prepare) Task=`7eb0e973-c472-4a06-9d70-56d0b45d8a8f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:51:07,170::task::579::TaskManager.Task::(_updateState) Task=`7eb0e973-c472-4a06-9d70-56d0b45d8a8f`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:51:07,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:51:07,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:51:07,170::task::974::TaskManager.Task::(_decref) Task=`7eb0e973-c472-4a06-9d70-56d0b45d8a8f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:51:07,224::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:08,077::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:51:08,116::task::579::TaskManager.Task::(_updateState) Task=`5921cfab-f9fd-427c-b9da-103a4462f003`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:51:08,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:51:08,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:51:08,118::task::1168::TaskManager.Task::(prepare) Task=`5921cfab-f9fd-427c-b9da-103a4462f003`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:51:08,118::task::579::TaskManager.Task::(_updateState) Task=`5921cfab-f9fd-427c-b9da-103a4462f003`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:51:08,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:51:08,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:51:08,118::task::974::TaskManager.Task::(_decref) Task=`5921cfab-f9fd-427c-b9da-103a4462f003`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:51:08,119::task::579::TaskManager.Task::(_updateState) Task=`96e75071-181f-438d-8c01-f68c64e5b2cd`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:51:08,119::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:51:08,119::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:51:08,119::task::1168::TaskManager.Task::(prepare) Task=`96e75071-181f-438d-8c01-f68c64e5b2cd`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:51:08,119::task::579::TaskManager.Task::(_updateState) Task=`96e75071-181f-438d-8c01-f68c64e5b2cd`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:51:08,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:51:08,120::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:51:08,120::task::974::TaskManager.Task::(_decref) Task=`96e75071-181f-438d-8c01-f68c64e5b2cd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:09,078::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:51:09,079::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:51:09,079::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:51:09,080::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:09,080::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:51:09,081::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:51:09,225::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:51:09,833::task::579::TaskManager.Task::(_updateState) Task=`9c4494f8-d3b0-4725-bd78-73bf9a4795f2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:51:09,833::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:51:09,833::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:51:09,834::task::1168::TaskManager.Task::(prepare) Task=`9c4494f8-d3b0-4725-bd78-73bf9a4795f2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:51:09,834::task::579::TaskManager.Task::(_updateState) Task=`9c4494f8-d3b0-4725-bd78-73bf9a4795f2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:51:09,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:51:09,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:51:09,834::task::974::TaskManager.Task::(_decref) Task=`9c4494f8-d3b0-4725-bd78-73bf9a4795f2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:51:09,834::task::579::TaskManager.Task::(_updateState) Task=`10d79b2d-0e7e-4dcf-aa47-6aeff8954581`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:51:09,835::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:51:09,835::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:51:09,835::task::1168::TaskManager.Task::(prepare) Task=`10d79b2d-0e7e-4dcf-aa47-6aeff8954581`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:51:09,835::task::579::TaskManager.Task::(_updateState) Task=`10d79b2d-0e7e-4dcf-aa47-6aeff8954581`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:51:09,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:51:09,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:51:09,835::task::974::TaskManager.Task::(_decref) Task=`10d79b2d-0e7e-4dcf-aa47-6aeff8954581`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:51:09,836::task::579::TaskManager.Task::(_updateState) Task=`e5c6f5b9-c8ef-4771-94af-a9f4085d37aa`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:51:09,836::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:51:09,836::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:51:09,836::task::1168::TaskManager.Task::(prepare) Task=`e5c6f5b9-c8ef-4771-94af-a9f4085d37aa`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:51:09,836::task::579::TaskManager.Task::(_updateState) Task=`e5c6f5b9-c8ef-4771-94af-a9f4085d37aa`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:51:09,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:51:09,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:51:09,837::task::974::TaskManager.Task::(_decref) Task=`e5c6f5b9-c8ef-4771-94af-a9f4085d37aa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:10,082::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:10,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:11,083::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:51:11,084::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:51:11,084::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:51:11,155::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:51:11,159::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:51:11,160::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:51:11,165::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:51:11,166::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:51:11,167::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:51:11,167::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:51:11,173::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-17177::DEBUG::2014-01-16 16:51:11,190::task::579::TaskManager.Task::(_updateState) Task=`bbf7787e-1fff-463c-995c-05b33216c4e3`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:51:11,193::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:51:11,196::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:51:11,197::task::1168::TaskManager.Task::(prepare) Task=`bbf7787e-1fff-463c-995c-05b33216c4e3`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:51:11,199::task::579::TaskManager.Task::(_updateState) Task=`bbf7787e-1fff-463c-995c-05b33216c4e3`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:51:11,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:51:11,202::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:51:11,203::task::974::TaskManager.Task::(_decref) Task=`bbf7787e-1fff-463c-995c-05b33216c4e3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:51:11,205::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000262288 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:51:11,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:51:11,232::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:51:11,254::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000305603 s, 13.4 MB/s\n'; <rc> = 0 >Thread-26403::DEBUG::2014-01-16 16:51:11,308::task::579::TaskManager.Task::(_updateState) Task=`45342b96-259c-480d-8e5a-dce192caac45`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:51:11,309::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:51:11,309::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:51:11,309::task::1168::TaskManager.Task::(prepare) Task=`45342b96-259c-480d-8e5a-dce192caac45`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:51:11,309::task::579::TaskManager.Task::(_updateState) Task=`45342b96-259c-480d-8e5a-dce192caac45`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:51:11,310::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:51:11,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:51:11,310::task::974::TaskManager.Task::(_decref) Task=`45342b96-259c-480d-8e5a-dce192caac45`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:51:12,010::task::579::TaskManager.Task::(_updateState) Task=`8cacd4d6-2dea-40ca-80a8-fe542f9f62fe`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:51:12,010::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:51:12,011::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:51:12,011::task::1168::TaskManager.Task::(prepare) Task=`8cacd4d6-2dea-40ca-80a8-fe542f9f62fe`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:51:12,011::task::579::TaskManager.Task::(_updateState) Task=`8cacd4d6-2dea-40ca-80a8-fe542f9f62fe`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:51:12,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:51:12,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:51:12,011::task::974::TaskManager.Task::(_decref) Task=`8cacd4d6-2dea-40ca-80a8-fe542f9f62fe`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:51:12,012::task::579::TaskManager.Task::(_updateState) Task=`49edc266-46b0-4b3d-aee0-1e0e05909248`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:51:12,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:51:12,012::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:51:12,012::task::1168::TaskManager.Task::(prepare) Task=`49edc266-46b0-4b3d-aee0-1e0e05909248`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:51:12,013::task::579::TaskManager.Task::(_updateState) Task=`49edc266-46b0-4b3d-aee0-1e0e05909248`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:51:12,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:51:12,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:51:12,013::task::974::TaskManager.Task::(_decref) Task=`49edc266-46b0-4b3d-aee0-1e0e05909248`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:12,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:51:12,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:51:12,086::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:51:12,610::task::579::TaskManager.Task::(_updateState) Task=`0f9ba52b-277e-4104-a119-12ebbe9fb1d4`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:51:12,611::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:51:12,611::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:51:12,611::task::1168::TaskManager.Task::(prepare) Task=`0f9ba52b-277e-4104-a119-12ebbe9fb1d4`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:51:12,611::task::579::TaskManager.Task::(_updateState) Task=`0f9ba52b-277e-4104-a119-12ebbe9fb1d4`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:51:12,612::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:51:12,612::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:51:12,612::task::974::TaskManager.Task::(_decref) Task=`0f9ba52b-277e-4104-a119-12ebbe9fb1d4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:13,087::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:51:13,089::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:51:13,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:51:13,092::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:13,232::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:51:13,571::task::579::TaskManager.Task::(_updateState) Task=`2396faaa-68e9-4243-bd84-dcc746767d74`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:51:13,571::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:51:13,571::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:51:13,572::task::1168::TaskManager.Task::(prepare) Task=`2396faaa-68e9-4243-bd84-dcc746767d74`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:51:13,572::task::579::TaskManager.Task::(_updateState) Task=`2396faaa-68e9-4243-bd84-dcc746767d74`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:51:13,572::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:51:13,572::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:51:13,572::task::974::TaskManager.Task::(_decref) Task=`2396faaa-68e9-4243-bd84-dcc746767d74`::ref 0 aborting False >Thread-287181::DEBUG::2014-01-16 16:51:14,020::task::579::TaskManager.Task::(_updateState) Task=`8c64687f-ddf9-474d-9b51-dad7db8a39f5`::moving from state init -> state preparing >Thread-287181::INFO::2014-01-16 16:51:14,020::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287181::INFO::2014-01-16 16:51:14,020::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262288', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305603', 'lastCheck': '2.8', 'valid': True}} >Thread-287181::DEBUG::2014-01-16 16:51:14,020::task::1168::TaskManager.Task::(prepare) Task=`8c64687f-ddf9-474d-9b51-dad7db8a39f5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262288', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305603', 'lastCheck': '2.8', 'valid': True}} >Thread-287181::DEBUG::2014-01-16 16:51:14,020::task::579::TaskManager.Task::(_updateState) Task=`8c64687f-ddf9-474d-9b51-dad7db8a39f5`::moving from state preparing -> state finished >Thread-287181::DEBUG::2014-01-16 16:51:14,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287181::DEBUG::2014-01-16 16:51:14,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287181::DEBUG::2014-01-16 16:51:14,021::task::974::TaskManager.Task::(_decref) Task=`8c64687f-ddf9-474d-9b51-dad7db8a39f5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:14,094::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:15,096::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:51:15,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:15,234::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:15,234::task::579::TaskManager.Task::(_updateState) Task=`1911bd71-a95b-4a7f-903d-ee6e7460a8b3`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:51:15,234::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:51:15,235::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:51:15,235::task::1168::TaskManager.Task::(prepare) Task=`1911bd71-a95b-4a7f-903d-ee6e7460a8b3`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:51:15,235::task::579::TaskManager.Task::(_updateState) Task=`1911bd71-a95b-4a7f-903d-ee6e7460a8b3`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:51:15,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:51:15,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:51:15,236::task::974::TaskManager.Task::(_decref) Task=`1911bd71-a95b-4a7f-903d-ee6e7460a8b3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:51:15,237::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:51:15,237::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:51:15,240::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:15,241::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:15,242::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:16,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:51:16,856::task::579::TaskManager.Task::(_updateState) Task=`abc8fb22-2eba-4861-a29f-a0d97df68f7d`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:51:16,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:51:16,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:51:16,857::task::1168::TaskManager.Task::(prepare) Task=`abc8fb22-2eba-4861-a29f-a0d97df68f7d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:51:16,857::task::579::TaskManager.Task::(_updateState) Task=`abc8fb22-2eba-4861-a29f-a0d97df68f7d`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:51:16,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:51:16,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:51:16,858::task::974::TaskManager.Task::(_decref) Task=`abc8fb22-2eba-4861-a29f-a0d97df68f7d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:17,099::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:17,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:51:17,850::task::579::TaskManager.Task::(_updateState) Task=`cfcc0fa0-a944-465f-80e2-4a4dcaa633a2`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:51:17,851::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:51:17,851::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:51:17,851::task::1168::TaskManager.Task::(prepare) Task=`cfcc0fa0-a944-465f-80e2-4a4dcaa633a2`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:51:17,851::task::579::TaskManager.Task::(_updateState) Task=`cfcc0fa0-a944-465f-80e2-4a4dcaa633a2`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:51:17,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:51:17,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:51:17,852::task::974::TaskManager.Task::(_decref) Task=`cfcc0fa0-a944-465f-80e2-4a4dcaa633a2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:18,100::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:19,101::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:19,244::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:20,102::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:20,246::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:51:20,283::task::579::TaskManager.Task::(_updateState) Task=`2de45f24-bed9-4e66-9484-c7b41056e98f`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:51:20,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:51:20,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:51:20,284::task::1168::TaskManager.Task::(prepare) Task=`2de45f24-bed9-4e66-9484-c7b41056e98f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:51:20,284::task::579::TaskManager.Task::(_updateState) Task=`2de45f24-bed9-4e66-9484-c7b41056e98f`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:51:20,284::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:51:20,284::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:51:20,284::task::974::TaskManager.Task::(_decref) Task=`2de45f24-bed9-4e66-9484-c7b41056e98f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:21,104::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:51:21,104::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:51:21,213::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:51:21,230::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000325209 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:51:21,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:51:21,260::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:51:21,276::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024045 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:51:22,105::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:23,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:23,250::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:24,108::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:25,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:25,251::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:25,253::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:51:25,820::task::579::TaskManager.Task::(_updateState) Task=`9d339a2d-62ac-4a5c-82d9-33ab496ff7c3`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:51:25,820::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:51:25,820::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:51:25,820::task::1168::TaskManager.Task::(prepare) Task=`9d339a2d-62ac-4a5c-82d9-33ab496ff7c3`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:51:25,821::task::579::TaskManager.Task::(_updateState) Task=`9d339a2d-62ac-4a5c-82d9-33ab496ff7c3`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:51:25,821::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:51:25,821::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:51:25,821::task::974::TaskManager.Task::(_decref) Task=`9d339a2d-62ac-4a5c-82d9-33ab496ff7c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:26,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:51:26,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:51:26,110::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:27,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:51:27,112::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:27,254::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:28,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:51:28,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:51:28,113::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:51:28,177::task::579::TaskManager.Task::(_updateState) Task=`1ea82c42-521b-4ce4-a7bd-4021ded132fd`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:51:28,177::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:51:28,177::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:51:28,177::task::1168::TaskManager.Task::(prepare) Task=`1ea82c42-521b-4ce4-a7bd-4021ded132fd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:51:28,178::task::579::TaskManager.Task::(_updateState) Task=`1ea82c42-521b-4ce4-a7bd-4021ded132fd`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:51:28,178::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:51:28,178::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:51:28,178::task::974::TaskManager.Task::(_decref) Task=`1ea82c42-521b-4ce4-a7bd-4021ded132fd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:29,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:51:29,114::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:29,256::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287187::DEBUG::2014-01-16 16:51:29,731::task::579::TaskManager.Task::(_updateState) Task=`168cb915-c4fa-4a68-a6af-738136137046`::moving from state init -> state preparing >Thread-287187::INFO::2014-01-16 16:51:29,731::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287187::INFO::2014-01-16 16:51:29,731::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000325209', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024045', 'lastCheck': '8.5', 'valid': True}} >Thread-287187::DEBUG::2014-01-16 16:51:29,731::task::1168::TaskManager.Task::(prepare) Task=`168cb915-c4fa-4a68-a6af-738136137046`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000325209', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024045', 'lastCheck': '8.5', 'valid': True}} >Thread-287187::DEBUG::2014-01-16 16:51:29,731::task::579::TaskManager.Task::(_updateState) Task=`168cb915-c4fa-4a68-a6af-738136137046`::moving from state preparing -> state finished >Thread-287187::DEBUG::2014-01-16 16:51:29,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287187::DEBUG::2014-01-16 16:51:29,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287187::DEBUG::2014-01-16 16:51:29,732::task::974::TaskManager.Task::(_decref) Task=`168cb915-c4fa-4a68-a6af-738136137046`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:30,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:51:30,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:30,257::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:51:30,258::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:51:30,259::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:51:30,323::task::579::TaskManager.Task::(_updateState) Task=`43a676dc-d041-4e20-9479-b1a2a4a5fdd6`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:51:30,323::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:51:30,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:51:30,324::task::1168::TaskManager.Task::(prepare) Task=`43a676dc-d041-4e20-9479-b1a2a4a5fdd6`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:51:30,324::task::579::TaskManager.Task::(_updateState) Task=`43a676dc-d041-4e20-9479-b1a2a4a5fdd6`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:51:30,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:51:30,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:51:30,325::task::974::TaskManager.Task::(_decref) Task=`43a676dc-d041-4e20-9479-b1a2a4a5fdd6`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:51:30,325::task::579::TaskManager.Task::(_updateState) Task=`20de1bf0-1867-4878-8b32-fe1dd3e35da8`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:51:30,325::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:51:30,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:51:30,325::task::1168::TaskManager.Task::(prepare) Task=`20de1bf0-1867-4878-8b32-fe1dd3e35da8`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:51:30,326::task::579::TaskManager.Task::(_updateState) Task=`20de1bf0-1867-4878-8b32-fe1dd3e35da8`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:51:30,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:51:30,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:51:30,326::task::974::TaskManager.Task::(_decref) Task=`20de1bf0-1867-4878-8b32-fe1dd3e35da8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:31,116::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:51:31,238::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:51:31,254::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000261418 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:51:31,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 16:51:31,282::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:51:31,297::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319017 s, 12.8 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:51:31,854::task::579::TaskManager.Task::(_updateState) Task=`93668ad8-3468-48d4-9f98-ee0d9d3935c1`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:51:31,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:51:31,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:51:31,855::task::1168::TaskManager.Task::(prepare) Task=`93668ad8-3468-48d4-9f98-ee0d9d3935c1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:51:31,855::task::579::TaskManager.Task::(_updateState) Task=`93668ad8-3468-48d4-9f98-ee0d9d3935c1`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:51:31,855::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:51:31,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:51:31,856::task::974::TaskManager.Task::(_decref) Task=`93668ad8-3468-48d4-9f98-ee0d9d3935c1`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:51:31,872::task::579::TaskManager.Task::(_updateState) Task=`41017d02-b623-4f37-b69d-1d75edf084d4`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:51:31,872::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:51:31,872::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:51:31,872::task::1168::TaskManager.Task::(prepare) Task=`41017d02-b623-4f37-b69d-1d75edf084d4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:51:31,872::task::579::TaskManager.Task::(_updateState) Task=`41017d02-b623-4f37-b69d-1d75edf084d4`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:51:31,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:51:31,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:51:31,873::task::974::TaskManager.Task::(_decref) Task=`41017d02-b623-4f37-b69d-1d75edf084d4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:32,118::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:51:32,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:33,119::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:51:33,119::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:33,262::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:34,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:51:34,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:51:34,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:51:34,121::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:35,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:51:35,122::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:51:35,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:35,264::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:35,265::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:36,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:51:36,123::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:51:36,900::task::579::TaskManager.Task::(_updateState) Task=`39611174-dad4-4948-b9b0-af4c26e8d0ce`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:51:36,901::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:51:36,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:51:36,901::task::1168::TaskManager.Task::(prepare) Task=`39611174-dad4-4948-b9b0-af4c26e8d0ce`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:51:36,902::task::579::TaskManager.Task::(_updateState) Task=`39611174-dad4-4948-b9b0-af4c26e8d0ce`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:51:36,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:51:36,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:51:36,902::task::974::TaskManager.Task::(_decref) Task=`39611174-dad4-4948-b9b0-af4c26e8d0ce`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:37,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:51:37,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:51:37,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:51:37,125::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:37,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:38,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:39,127::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:51:39,128::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:51:39,128::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:51:39,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:39,128::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:51:39,129::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:51:39,267::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:51:39,281::task::579::TaskManager.Task::(_updateState) Task=`a60ade93-0c2a-4edd-bf72-08cd0283e311`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:51:39,281::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:51:39,281::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:51:39,282::task::1168::TaskManager.Task::(prepare) Task=`a60ade93-0c2a-4edd-bf72-08cd0283e311`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:51:39,282::task::579::TaskManager.Task::(_updateState) Task=`a60ade93-0c2a-4edd-bf72-08cd0283e311`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:51:39,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:51:39,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:51:39,282::task::974::TaskManager.Task::(_decref) Task=`a60ade93-0c2a-4edd-bf72-08cd0283e311`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:40,130::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:40,269::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 16:51:40,274::task::579::TaskManager.Task::(_updateState) Task=`755bb40d-65b8-41c9-b874-272a200c5edb`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:51:40,274::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:51:40,274::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:51:40,274::task::1168::TaskManager.Task::(prepare) Task=`755bb40d-65b8-41c9-b874-272a200c5edb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:51:40,275::task::579::TaskManager.Task::(_updateState) Task=`755bb40d-65b8-41c9-b874-272a200c5edb`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:51:40,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:51:40,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:51:40,275::task::974::TaskManager.Task::(_decref) Task=`755bb40d-65b8-41c9-b874-272a200c5edb`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 16:51:40,276::task::579::TaskManager.Task::(_updateState) Task=`76895397-4aac-465d-96c5-bf29e21b4819`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:51:40,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:51:40,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:51:40,277::task::1168::TaskManager.Task::(prepare) Task=`76895397-4aac-465d-96c5-bf29e21b4819`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:51:40,277::task::579::TaskManager.Task::(_updateState) Task=`76895397-4aac-465d-96c5-bf29e21b4819`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:51:40,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:51:40,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:51:40,278::task::974::TaskManager.Task::(_decref) Task=`76895397-4aac-465d-96c5-bf29e21b4819`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:51:40,331::task::579::TaskManager.Task::(_updateState) Task=`6a183a8e-e376-403d-a9af-63190ea50d18`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:51:40,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:51:40,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:51:40,332::task::1168::TaskManager.Task::(prepare) Task=`6a183a8e-e376-403d-a9af-63190ea50d18`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:51:40,332::task::579::TaskManager.Task::(_updateState) Task=`6a183a8e-e376-403d-a9af-63190ea50d18`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:51:40,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:51:40,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:51:40,332::task::974::TaskManager.Task::(_decref) Task=`6a183a8e-e376-403d-a9af-63190ea50d18`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 16:51:41,084::task::579::TaskManager.Task::(_updateState) Task=`9ffbc39a-d568-456b-bfc4-af7090ec8e40`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:51:41,085::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:51:41,085::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:51:41,085::task::1168::TaskManager.Task::(prepare) Task=`9ffbc39a-d568-456b-bfc4-af7090ec8e40`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:51:41,085::task::579::TaskManager.Task::(_updateState) Task=`9ffbc39a-d568-456b-bfc4-af7090ec8e40`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:51:41,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:51:41,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:51:41,086::task::974::TaskManager.Task::(_decref) Task=`9ffbc39a-d568-456b-bfc4-af7090ec8e40`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:41,131::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:51:41,132::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:51:41,132::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:51:41,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:51:41,279::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:51:41,282::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272948 s, 1.3 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:51:41,296::task::579::TaskManager.Task::(_updateState) Task=`22d9bdf9-41a2-4d6b-9237-f060d7189f67`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:51:41,296::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:51:41,296::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:51:41,296::task::1168::TaskManager.Task::(prepare) Task=`22d9bdf9-41a2-4d6b-9237-f060d7189f67`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:51:41,297::task::579::TaskManager.Task::(_updateState) Task=`22d9bdf9-41a2-4d6b-9237-f060d7189f67`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:51:41,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:51:41,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:51:41,297::task::974::TaskManager.Task::(_decref) Task=`22d9bdf9-41a2-4d6b-9237-f060d7189f67`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:51:41,303::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:51:41,320::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000275946 s, 14.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:51:42,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:51:42,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:51:42,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:43,136::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:51:43,137::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:51:43,139::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:51:43,140::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:43,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:44,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:45,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:51:45,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:45,283::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:45,285::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:51:45,285::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:51:45,286::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287193::DEBUG::2014-01-16 16:51:45,491::task::579::TaskManager.Task::(_updateState) Task=`cd52ec5c-3ee4-4da3-8a0f-b927e39ecf44`::moving from state init -> state preparing >Thread-287193::INFO::2014-01-16 16:51:45,491::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287193::INFO::2014-01-16 16:51:45,491::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272948', 'lastCheck': '4.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275946', 'lastCheck': '4.2', 'valid': True}} >Thread-287193::DEBUG::2014-01-16 16:51:45,491::task::1168::TaskManager.Task::(prepare) Task=`cd52ec5c-3ee4-4da3-8a0f-b927e39ecf44`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272948', 'lastCheck': '4.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275946', 'lastCheck': '4.2', 'valid': True}} >Thread-287193::DEBUG::2014-01-16 16:51:45,492::task::579::TaskManager.Task::(_updateState) Task=`cd52ec5c-3ee4-4da3-8a0f-b927e39ecf44`::moving from state preparing -> state finished >Thread-287193::DEBUG::2014-01-16 16:51:45,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287193::DEBUG::2014-01-16 16:51:45,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287193::DEBUG::2014-01-16 16:51:45,492::task::974::TaskManager.Task::(_decref) Task=`cd52ec5c-3ee4-4da3-8a0f-b927e39ecf44`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:51:45,822::task::579::TaskManager.Task::(_updateState) Task=`c9baf7e4-284b-44da-84a9-e466da7fd4c6`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:51:45,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:51:45,822::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:51:45,822::task::1168::TaskManager.Task::(prepare) Task=`c9baf7e4-284b-44da-84a9-e466da7fd4c6`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:51:45,823::task::579::TaskManager.Task::(_updateState) Task=`c9baf7e4-284b-44da-84a9-e466da7fd4c6`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:51:45,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:51:45,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:51:45,823::task::974::TaskManager.Task::(_decref) Task=`c9baf7e4-284b-44da-84a9-e466da7fd4c6`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:51:45,823::task::579::TaskManager.Task::(_updateState) Task=`26935edc-846c-4b5b-9cf5-7f58d2d2e231`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:51:45,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:51:45,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:51:45,824::task::1168::TaskManager.Task::(prepare) Task=`26935edc-846c-4b5b-9cf5-7f58d2d2e231`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:51:45,824::task::579::TaskManager.Task::(_updateState) Task=`26935edc-846c-4b5b-9cf5-7f58d2d2e231`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:51:45,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:51:45,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:51:45,824::task::974::TaskManager.Task::(_decref) Task=`26935edc-846c-4b5b-9cf5-7f58d2d2e231`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:51:45,825::task::579::TaskManager.Task::(_updateState) Task=`827493a1-7725-44e6-a8b8-c4cc10f8c6db`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:51:45,825::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:51:45,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:51:45,825::task::1168::TaskManager.Task::(prepare) Task=`827493a1-7725-44e6-a8b8-c4cc10f8c6db`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:51:45,825::task::579::TaskManager.Task::(_updateState) Task=`827493a1-7725-44e6-a8b8-c4cc10f8c6db`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:51:45,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:51:45,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:51:45,826::task::974::TaskManager.Task::(_decref) Task=`827493a1-7725-44e6-a8b8-c4cc10f8c6db`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:46,145::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:47,146::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:47,288::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:48,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:51:48,963::task::579::TaskManager.Task::(_updateState) Task=`d396936c-2789-43bc-8aa5-0496161c8283`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:51:48,963::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:51:48,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:51:48,963::task::1168::TaskManager.Task::(prepare) Task=`d396936c-2789-43bc-8aa5-0496161c8283`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:51:48,963::task::579::TaskManager.Task::(_updateState) Task=`d396936c-2789-43bc-8aa5-0496161c8283`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:51:48,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:51:48,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:51:48,964::task::974::TaskManager.Task::(_decref) Task=`d396936c-2789-43bc-8aa5-0496161c8283`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:49,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:49,289::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:50,148::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:50,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:51,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:51:51,149::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:51:51,288::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:51:51,306::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:51:51,308::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000263709 s, 1.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:51:51,326::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:51:51,342::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000320938 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:51:52,150::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:53,151::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:53,309::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:51:53,786::task::579::TaskManager.Task::(_updateState) Task=`6eed859a-4a75-44b7-b450-4db9b3d5c305`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:51:53,787::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:51:53,787::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:51:53,787::task::1168::TaskManager.Task::(prepare) Task=`6eed859a-4a75-44b7-b450-4db9b3d5c305`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:51:53,787::task::579::TaskManager.Task::(_updateState) Task=`6eed859a-4a75-44b7-b450-4db9b3d5c305`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:51:53,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:51:53,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:51:53,788::task::974::TaskManager.Task::(_decref) Task=`6eed859a-4a75-44b7-b450-4db9b3d5c305`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:51:54,152::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:55,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:55,310::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:51:55,311::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:56,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:51:56,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:51:56,155::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:57,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:51:57,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:57,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:51:58,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:51:58,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:51:58,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:51:59,159::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:51:59,160::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:51:59,314::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:00,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:52:00,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:00,316::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:52:00,316::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:52:00,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:52:00,338::task::579::TaskManager.Task::(_updateState) Task=`23b8082f-ddaf-4497-b3f3-009698a899c8`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:52:00,338::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:52:00,339::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:52:00,339::task::1168::TaskManager.Task::(prepare) Task=`23b8082f-ddaf-4497-b3f3-009698a899c8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:52:00,339::task::579::TaskManager.Task::(_updateState) Task=`23b8082f-ddaf-4497-b3f3-009698a899c8`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:52:00,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:52:00,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:52:00,339::task::974::TaskManager.Task::(_decref) Task=`23b8082f-ddaf-4497-b3f3-009698a899c8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:01,162::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287199::DEBUG::2014-01-16 16:52:01,212::task::579::TaskManager.Task::(_updateState) Task=`fca528bc-f356-4f9b-a24c-ede609068d53`::moving from state init -> state preparing >Thread-287199::INFO::2014-01-16 16:52:01,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287199::INFO::2014-01-16 16:52:01,212::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263709', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320938', 'lastCheck': '9.9', 'valid': True}} >Thread-287199::DEBUG::2014-01-16 16:52:01,212::task::1168::TaskManager.Task::(prepare) Task=`fca528bc-f356-4f9b-a24c-ede609068d53`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000263709', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320938', 'lastCheck': '9.9', 'valid': True}} >Thread-287199::DEBUG::2014-01-16 16:52:01,213::task::579::TaskManager.Task::(_updateState) Task=`fca528bc-f356-4f9b-a24c-ede609068d53`::moving from state preparing -> state finished >Thread-287199::DEBUG::2014-01-16 16:52:01,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287199::DEBUG::2014-01-16 16:52:01,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287199::DEBUG::2014-01-16 16:52:01,213::task::974::TaskManager.Task::(_decref) Task=`fca528bc-f356-4f9b-a24c-ede609068d53`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:52:01,316::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 16:52:01,332::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:52:01,335::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000313497 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:52:01,349::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:52:01,368::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000209169 s, 19.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:52:02,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:52:02,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:03,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:52:03,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:03,336::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:04,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:52:04,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:52:04,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:52:04,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:05,167::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:52:05,167::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:52:05,167::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:05,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:05,338::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:06,169::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:52:06,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:52:06,277::task::579::TaskManager.Task::(_updateState) Task=`45b04fdd-b7ce-40b9-afbd-c704e6c52c43`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:52:06,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:52:06,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:52:06,278::task::1168::TaskManager.Task::(prepare) Task=`45b04fdd-b7ce-40b9-afbd-c704e6c52c43`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:52:06,278::task::579::TaskManager.Task::(_updateState) Task=`45b04fdd-b7ce-40b9-afbd-c704e6c52c43`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:52:06,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:52:06,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:52:06,278::task::974::TaskManager.Task::(_decref) Task=`45b04fdd-b7ce-40b9-afbd-c704e6c52c43`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:52:06,279::task::579::TaskManager.Task::(_updateState) Task=`27039c1b-beff-4381-8254-8a30a479da52`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:52:06,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:52:06,279::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:52:06,279::task::1168::TaskManager.Task::(prepare) Task=`27039c1b-beff-4381-8254-8a30a479da52`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:52:06,279::task::579::TaskManager.Task::(_updateState) Task=`27039c1b-beff-4381-8254-8a30a479da52`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:52:06,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:52:06,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:52:06,280::task::974::TaskManager.Task::(_decref) Task=`27039c1b-beff-4381-8254-8a30a479da52`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:52:06,474::task::579::TaskManager.Task::(_updateState) Task=`9dde4e9d-c95b-4405-b382-78394396aa24`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:52:06,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:52:06,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:52:06,475::task::1168::TaskManager.Task::(prepare) Task=`9dde4e9d-c95b-4405-b382-78394396aa24`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:52:06,475::task::579::TaskManager.Task::(_updateState) Task=`9dde4e9d-c95b-4405-b382-78394396aa24`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:52:06,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:52:06,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:52:06,476::task::974::TaskManager.Task::(_decref) Task=`9dde4e9d-c95b-4405-b382-78394396aa24`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:52:06,485::task::579::TaskManager.Task::(_updateState) Task=`ad6e3fe1-cc6e-4b4e-9c8d-e2abbb289465`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:52:06,485::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:52:06,486::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:52:06,486::task::1168::TaskManager.Task::(prepare) Task=`ad6e3fe1-cc6e-4b4e-9c8d-e2abbb289465`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:52:06,486::task::579::TaskManager.Task::(_updateState) Task=`ad6e3fe1-cc6e-4b4e-9c8d-e2abbb289465`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:52:06,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:52:06,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:52:06,487::task::974::TaskManager.Task::(_decref) Task=`ad6e3fe1-cc6e-4b4e-9c8d-e2abbb289465`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:07,170::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:52:07,170::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:52:07,171::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:52:07,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:07,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:52:07,355::task::579::TaskManager.Task::(_updateState) Task=`7b6073d8-eb8b-49e1-a92d-479a354c1b50`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:52:07,356::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:52:07,356::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:52:07,356::task::1168::TaskManager.Task::(prepare) Task=`7b6073d8-eb8b-49e1-a92d-479a354c1b50`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:52:07,356::task::579::TaskManager.Task::(_updateState) Task=`7b6073d8-eb8b-49e1-a92d-479a354c1b50`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:52:07,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:52:07,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:52:07,357::task::974::TaskManager.Task::(_decref) Task=`7b6073d8-eb8b-49e1-a92d-479a354c1b50`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:08,172::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:52:08,211::task::579::TaskManager.Task::(_updateState) Task=`d98f9046-633c-4572-b96b-48581842ac77`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:52:08,211::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:52:08,211::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:52:08,212::task::1168::TaskManager.Task::(prepare) Task=`d98f9046-633c-4572-b96b-48581842ac77`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:52:08,212::task::579::TaskManager.Task::(_updateState) Task=`d98f9046-633c-4572-b96b-48581842ac77`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:52:08,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:52:08,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:52:08,212::task::974::TaskManager.Task::(_decref) Task=`d98f9046-633c-4572-b96b-48581842ac77`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:52:08,212::task::579::TaskManager.Task::(_updateState) Task=`208972f6-19d2-4ba7-ba8a-5e288c42c7f7`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:52:08,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:52:08,213::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:52:08,213::task::1168::TaskManager.Task::(prepare) Task=`208972f6-19d2-4ba7-ba8a-5e288c42c7f7`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:52:08,213::task::579::TaskManager.Task::(_updateState) Task=`208972f6-19d2-4ba7-ba8a-5e288c42c7f7`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:52:08,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:52:08,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:52:08,213::task::974::TaskManager.Task::(_decref) Task=`208972f6-19d2-4ba7-ba8a-5e288c42c7f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:09,173::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:52:09,173::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:52:09,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:52:09,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:09,175::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:52:09,175::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:52:09,341::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:10,176::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:10,342::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:52:10,403::task::579::TaskManager.Task::(_updateState) Task=`ec6114db-632a-4bd7-8f21-690922b95417`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:52:10,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:52:10,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:52:10,404::task::1168::TaskManager.Task::(prepare) Task=`ec6114db-632a-4bd7-8f21-690922b95417`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:52:10,404::task::579::TaskManager.Task::(_updateState) Task=`ec6114db-632a-4bd7-8f21-690922b95417`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:52:10,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:52:10,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:52:10,405::task::974::TaskManager.Task::(_decref) Task=`ec6114db-632a-4bd7-8f21-690922b95417`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:52:10,405::task::579::TaskManager.Task::(_updateState) Task=`82714977-2109-4e43-96a9-5692bb90af4c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:52:10,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:52:10,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:52:10,406::task::1168::TaskManager.Task::(prepare) Task=`82714977-2109-4e43-96a9-5692bb90af4c`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:52:10,407::task::579::TaskManager.Task::(_updateState) Task=`82714977-2109-4e43-96a9-5692bb90af4c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:52:10,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:52:10,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:52:10,407::task::974::TaskManager.Task::(_decref) Task=`82714977-2109-4e43-96a9-5692bb90af4c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:52:10,408::task::579::TaskManager.Task::(_updateState) Task=`0650f514-9049-41c2-ae73-fb9b07137e51`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:52:10,408::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:52:10,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:52:10,408::task::1168::TaskManager.Task::(prepare) Task=`0650f514-9049-41c2-ae73-fb9b07137e51`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:52:10,409::task::579::TaskManager.Task::(_updateState) Task=`0650f514-9049-41c2-ae73-fb9b07137e51`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:52:10,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:52:10,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:52:10,409::task::974::TaskManager.Task::(_decref) Task=`0650f514-9049-41c2-ae73-fb9b07137e51`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:11,177::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:52:11,177::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:52:11,178::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:11,344::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:52:11,345::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:52:11,362::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000324995 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:52:11,365::task::579::TaskManager.Task::(_updateState) Task=`72e7a688-2de9-4695-b3e5-f0b81f255596`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:52:11,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:52:11,369::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:52:11,369::task::1168::TaskManager.Task::(prepare) Task=`72e7a688-2de9-4695-b3e5-f0b81f255596`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:52:11,370::task::579::TaskManager.Task::(_updateState) Task=`72e7a688-2de9-4695-b3e5-f0b81f255596`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:52:11,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:52:11,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:52:11,370::task::974::TaskManager.Task::(_decref) Task=`72e7a688-2de9-4695-b3e5-f0b81f255596`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:52:11,374::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:52:11,389::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000309568 s, 13.2 MB/s\n'; <rc> = 0 >Thread-26403::DEBUG::2014-01-16 16:52:11,469::task::579::TaskManager.Task::(_updateState) Task=`e1c1e928-5182-46a0-9e45-b2678826100e`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:52:11,470::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:52:11,470::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:52:11,470::task::1168::TaskManager.Task::(prepare) Task=`e1c1e928-5182-46a0-9e45-b2678826100e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:52:11,471::task::579::TaskManager.Task::(_updateState) Task=`e1c1e928-5182-46a0-9e45-b2678826100e`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:52:11,471::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:52:11,471::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:52:11,471::task::974::TaskManager.Task::(_decref) Task=`e1c1e928-5182-46a0-9e45-b2678826100e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:12,179::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:52:12,179::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:52:12,179::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:52:12,230::task::579::TaskManager.Task::(_updateState) Task=`efdce00a-b5df-480c-a621-4eddae1cd994`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:52:12,231::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:52:12,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:52:12,231::task::1168::TaskManager.Task::(prepare) Task=`efdce00a-b5df-480c-a621-4eddae1cd994`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:52:12,231::task::579::TaskManager.Task::(_updateState) Task=`efdce00a-b5df-480c-a621-4eddae1cd994`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:52:12,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:52:12,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:52:12,232::task::974::TaskManager.Task::(_decref) Task=`efdce00a-b5df-480c-a621-4eddae1cd994`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:52:12,232::task::579::TaskManager.Task::(_updateState) Task=`6260b2d0-e81f-446a-9157-0ace14575bd3`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:52:12,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:52:12,233::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:52:12,233::task::1168::TaskManager.Task::(prepare) Task=`6260b2d0-e81f-446a-9157-0ace14575bd3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:52:12,233::task::579::TaskManager.Task::(_updateState) Task=`6260b2d0-e81f-446a-9157-0ace14575bd3`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:52:12,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:52:12,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:52:12,234::task::974::TaskManager.Task::(_decref) Task=`6260b2d0-e81f-446a-9157-0ace14575bd3`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:52:12,774::task::579::TaskManager.Task::(_updateState) Task=`b8e9ca91-66e6-4e34-8978-2a6a2704b59a`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:52:12,775::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:52:12,775::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:52:12,775::task::1168::TaskManager.Task::(prepare) Task=`b8e9ca91-66e6-4e34-8978-2a6a2704b59a`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:52:12,775::task::579::TaskManager.Task::(_updateState) Task=`b8e9ca91-66e6-4e34-8978-2a6a2704b59a`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:52:12,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:52:12,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:52:12,776::task::974::TaskManager.Task::(_decref) Task=`b8e9ca91-66e6-4e34-8978-2a6a2704b59a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:13,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:52:13,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:52:13,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:52:13,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:13,345::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:52:13,743::task::579::TaskManager.Task::(_updateState) Task=`93ad0e96-a6a7-4a51-9a5f-619f20d4c395`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:52:13,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:52:13,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:52:13,744::task::1168::TaskManager.Task::(prepare) Task=`93ad0e96-a6a7-4a51-9a5f-619f20d4c395`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:52:13,744::task::579::TaskManager.Task::(_updateState) Task=`93ad0e96-a6a7-4a51-9a5f-619f20d4c395`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:52:13,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:52:13,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:52:13,745::task::974::TaskManager.Task::(_decref) Task=`93ad0e96-a6a7-4a51-9a5f-619f20d4c395`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:14,183::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:15,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:52:15,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:15,347::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:15,347::task::579::TaskManager.Task::(_updateState) Task=`7894629c-be2a-42c1-b628-9f59cd5f7a20`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:52:15,347::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:52:15,348::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:52:15,348::task::1168::TaskManager.Task::(prepare) Task=`7894629c-be2a-42c1-b628-9f59cd5f7a20`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:52:15,348::task::579::TaskManager.Task::(_updateState) Task=`7894629c-be2a-42c1-b628-9f59cd5f7a20`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:52:15,348::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:52:15,348::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:52:15,348::task::974::TaskManager.Task::(_decref) Task=`7894629c-be2a-42c1-b628-9f59cd5f7a20`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:52:15,350::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:52:15,350::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:52:15,352::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:15,353::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:15,354::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:16,186::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287205::DEBUG::2014-01-16 16:52:16,961::task::579::TaskManager.Task::(_updateState) Task=`75241206-d2f0-4959-a3c6-fe89dddc0af9`::moving from state init -> state preparing >Thread-287205::INFO::2014-01-16 16:52:16,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287205::INFO::2014-01-16 16:52:16,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324995', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309568', 'lastCheck': '5.6', 'valid': True}} >Thread-287205::DEBUG::2014-01-16 16:52:16,962::task::1168::TaskManager.Task::(prepare) Task=`75241206-d2f0-4959-a3c6-fe89dddc0af9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000324995', 'lastCheck': '5.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309568', 'lastCheck': '5.6', 'valid': True}} >Thread-287205::DEBUG::2014-01-16 16:52:16,962::task::579::TaskManager.Task::(_updateState) Task=`75241206-d2f0-4959-a3c6-fe89dddc0af9`::moving from state preparing -> state finished >Thread-287205::DEBUG::2014-01-16 16:52:16,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287205::DEBUG::2014-01-16 16:52:16,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287205::DEBUG::2014-01-16 16:52:16,962::task::974::TaskManager.Task::(_decref) Task=`75241206-d2f0-4959-a3c6-fe89dddc0af9`::ref 0 aborting False >Thread-227488::DEBUG::2014-01-16 16:52:17,023::task::579::TaskManager.Task::(_updateState) Task=`0903f445-c0f7-43da-9a93-5e6c4786beca`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:52:17,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:52:17,024::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:52:17,024::task::1168::TaskManager.Task::(prepare) Task=`0903f445-c0f7-43da-9a93-5e6c4786beca`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:52:17,024::task::579::TaskManager.Task::(_updateState) Task=`0903f445-c0f7-43da-9a93-5e6c4786beca`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:52:17,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:52:17,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:52:17,025::task::974::TaskManager.Task::(_decref) Task=`0903f445-c0f7-43da-9a93-5e6c4786beca`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:17,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:17,355::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:52:17,936::task::579::TaskManager.Task::(_updateState) Task=`18e270f9-8c5f-4b8a-a0dc-86bd3261d188`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:52:17,936::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:52:17,936::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:52:17,937::task::1168::TaskManager.Task::(prepare) Task=`18e270f9-8c5f-4b8a-a0dc-86bd3261d188`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:52:17,937::task::579::TaskManager.Task::(_updateState) Task=`18e270f9-8c5f-4b8a-a0dc-86bd3261d188`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:52:17,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:52:17,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:52:17,937::task::974::TaskManager.Task::(_decref) Task=`18e270f9-8c5f-4b8a-a0dc-86bd3261d188`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:18,188::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:19,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:19,356::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:20,190::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:20,358::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:52:20,455::task::579::TaskManager.Task::(_updateState) Task=`e42613c0-6bed-41b5-821b-ca1792261e62`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:52:20,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:52:20,456::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:52:20,456::task::1168::TaskManager.Task::(prepare) Task=`e42613c0-6bed-41b5-821b-ca1792261e62`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:52:20,456::task::579::TaskManager.Task::(_updateState) Task=`e42613c0-6bed-41b5-821b-ca1792261e62`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:52:20,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:52:20,456::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:52:20,456::task::974::TaskManager.Task::(_decref) Task=`e42613c0-6bed-41b5-821b-ca1792261e62`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:21,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:52:21,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:21,359::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:52:21,381::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:52:21,409::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029401 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:52:21,415::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:52:21,433::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000245919 s, 16.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:52:22,193::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:23,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:23,360::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:24,196::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:25,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:25,361::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:25,362::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:52:25,881::task::579::TaskManager.Task::(_updateState) Task=`89a0d97f-822c-416c-8239-4c61e4c7882f`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:52:25,881::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:52:25,881::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:52:25,881::task::1168::TaskManager.Task::(prepare) Task=`89a0d97f-822c-416c-8239-4c61e4c7882f`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:52:25,882::task::579::TaskManager.Task::(_updateState) Task=`89a0d97f-822c-416c-8239-4c61e4c7882f`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:52:25,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:52:25,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:52:25,882::task::974::TaskManager.Task::(_decref) Task=`89a0d97f-822c-416c-8239-4c61e4c7882f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:26,199::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:52:26,199::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:52:26,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:27,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:52:27,200::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:27,363::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:28,201::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:52:28,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:52:28,202::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:52:28,336::task::579::TaskManager.Task::(_updateState) Task=`262d14ab-c211-4c1b-bd69-b2f5d19038a7`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:52:28,336::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:52:28,337::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:52:28,337::task::1168::TaskManager.Task::(prepare) Task=`262d14ab-c211-4c1b-bd69-b2f5d19038a7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:52:28,337::task::579::TaskManager.Task::(_updateState) Task=`262d14ab-c211-4c1b-bd69-b2f5d19038a7`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:52:28,337::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:52:28,337::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:52:28,337::task::974::TaskManager.Task::(_decref) Task=`262d14ab-c211-4c1b-bd69-b2f5d19038a7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:29,203::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:52:29,203::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:29,365::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:30,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:52:30,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:30,367::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:52:30,367::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:52:30,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:52:30,689::task::579::TaskManager.Task::(_updateState) Task=`7b7795ef-84e0-476b-9ece-861ec524c2ae`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:52:30,690::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:52:30,690::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:52:30,690::task::1168::TaskManager.Task::(prepare) Task=`7b7795ef-84e0-476b-9ece-861ec524c2ae`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:52:30,690::task::579::TaskManager.Task::(_updateState) Task=`7b7795ef-84e0-476b-9ece-861ec524c2ae`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:52:30,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:52:30,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:52:30,691::task::974::TaskManager.Task::(_decref) Task=`7b7795ef-84e0-476b-9ece-861ec524c2ae`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:52:30,691::task::579::TaskManager.Task::(_updateState) Task=`c71d4b2a-9b8a-4d03-aa63-63962e3890a6`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:52:30,691::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:52:30,692::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:52:30,692::task::1168::TaskManager.Task::(prepare) Task=`c71d4b2a-9b8a-4d03-aa63-63962e3890a6`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:52:30,692::task::579::TaskManager.Task::(_updateState) Task=`c71d4b2a-9b8a-4d03-aa63-63962e3890a6`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:52:30,692::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:52:30,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:52:30,692::task::974::TaskManager.Task::(_decref) Task=`c71d4b2a-9b8a-4d03-aa63-63962e3890a6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:31,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:31,376::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:52:31,423::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:52:31,450::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000333752 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:52:31,458::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:52:31,475::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00023261 s, 17.6 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:52:32,024::task::579::TaskManager.Task::(_updateState) Task=`6f947f2b-2458-4026-9708-94fe34ea88da`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:52:32,025::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:52:32,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:52:32,025::task::1168::TaskManager.Task::(prepare) Task=`6f947f2b-2458-4026-9708-94fe34ea88da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:52:32,026::task::579::TaskManager.Task::(_updateState) Task=`6f947f2b-2458-4026-9708-94fe34ea88da`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:52:32,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:52:32,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:52:32,026::task::974::TaskManager.Task::(_decref) Task=`6f947f2b-2458-4026-9708-94fe34ea88da`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:52:32,038::task::579::TaskManager.Task::(_updateState) Task=`1994800b-9bda-4799-b752-20b63e7aea22`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:52:32,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:52:32,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:52:32,039::task::1168::TaskManager.Task::(prepare) Task=`1994800b-9bda-4799-b752-20b63e7aea22`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:52:32,039::task::579::TaskManager.Task::(_updateState) Task=`1994800b-9bda-4799-b752-20b63e7aea22`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:52:32,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:52:32,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:52:32,039::task::974::TaskManager.Task::(_decref) Task=`1994800b-9bda-4799-b752-20b63e7aea22`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:32,206::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:52:32,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287211::DEBUG::2014-01-16 16:52:32,751::task::579::TaskManager.Task::(_updateState) Task=`2f0f63f6-a7b5-4795-9c80-ad02b141f1e9`::moving from state init -> state preparing >Thread-287211::INFO::2014-01-16 16:52:32,751::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287211::INFO::2014-01-16 16:52:32,752::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333752', 'lastCheck': '1.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023261', 'lastCheck': '1.3', 'valid': True}} >Thread-287211::DEBUG::2014-01-16 16:52:32,752::task::1168::TaskManager.Task::(prepare) Task=`2f0f63f6-a7b5-4795-9c80-ad02b141f1e9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333752', 'lastCheck': '1.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023261', 'lastCheck': '1.3', 'valid': True}} >Thread-287211::DEBUG::2014-01-16 16:52:32,752::task::579::TaskManager.Task::(_updateState) Task=`2f0f63f6-a7b5-4795-9c80-ad02b141f1e9`::moving from state preparing -> state finished >Thread-287211::DEBUG::2014-01-16 16:52:32,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287211::DEBUG::2014-01-16 16:52:32,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287211::DEBUG::2014-01-16 16:52:32,753::task::974::TaskManager.Task::(_decref) Task=`2f0f63f6-a7b5-4795-9c80-ad02b141f1e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:33,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:52:33,208::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:33,378::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:34,209::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:52:34,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:52:34,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:52:34,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:35,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:52:35,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:52:35,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:35,379::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:35,380::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:36,217::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:52:36,218::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:52:37,084::task::579::TaskManager.Task::(_updateState) Task=`813472a2-7ccb-4e92-b133-11947233ef21`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:52:37,084::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:52:37,085::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:52:37,085::task::1168::TaskManager.Task::(prepare) Task=`813472a2-7ccb-4e92-b133-11947233ef21`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:52:37,085::task::579::TaskManager.Task::(_updateState) Task=`813472a2-7ccb-4e92-b133-11947233ef21`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:52:37,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:52:37,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:52:37,085::task::974::TaskManager.Task::(_decref) Task=`813472a2-7ccb-4e92-b133-11947233ef21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:37,219::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:52:37,219::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:52:37,220::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:52:37,220::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:37,381::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:38,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:39,222::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:52:39,223::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:52:39,223::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:52:39,223::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:39,223::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:52:39,224::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:52:39,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:52:39,470::task::579::TaskManager.Task::(_updateState) Task=`5ce45716-37f3-48bd-8fbe-f02394a106cc`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:52:39,471::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:52:39,471::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:52:39,471::task::1168::TaskManager.Task::(prepare) Task=`5ce45716-37f3-48bd-8fbe-f02394a106cc`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:52:39,471::task::579::TaskManager.Task::(_updateState) Task=`5ce45716-37f3-48bd-8fbe-f02394a106cc`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:52:39,471::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:52:39,471::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:52:39,472::task::974::TaskManager.Task::(_decref) Task=`5ce45716-37f3-48bd-8fbe-f02394a106cc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:40,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:40,383::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:52:40,474::task::579::TaskManager.Task::(_updateState) Task=`16a7ee8f-f1dc-485c-962d-87aa22b5ce0a`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:52:40,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:52:40,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:52:40,474::task::1168::TaskManager.Task::(prepare) Task=`16a7ee8f-f1dc-485c-962d-87aa22b5ce0a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:52:40,474::task::579::TaskManager.Task::(_updateState) Task=`16a7ee8f-f1dc-485c-962d-87aa22b5ce0a`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:52:40,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:52:40,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:52:40,475::task::974::TaskManager.Task::(_decref) Task=`16a7ee8f-f1dc-485c-962d-87aa22b5ce0a`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:52:40,476::task::579::TaskManager.Task::(_updateState) Task=`70de3f5b-a2d5-446b-a35c-92573ab2c3c9`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:52:40,476::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:52:40,476::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:52:40,477::task::1168::TaskManager.Task::(prepare) Task=`70de3f5b-a2d5-446b-a35c-92573ab2c3c9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:52:40,477::task::579::TaskManager.Task::(_updateState) Task=`70de3f5b-a2d5-446b-a35c-92573ab2c3c9`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:52:40,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:52:40,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:52:40,477::task::974::TaskManager.Task::(_decref) Task=`70de3f5b-a2d5-446b-a35c-92573ab2c3c9`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:52:40,509::task::579::TaskManager.Task::(_updateState) Task=`c94312d1-523d-4150-b738-40e60241d651`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:52:40,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:52:40,509::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:52:40,509::task::1168::TaskManager.Task::(prepare) Task=`c94312d1-523d-4150-b738-40e60241d651`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:52:40,509::task::579::TaskManager.Task::(_updateState) Task=`c94312d1-523d-4150-b738-40e60241d651`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:52:40,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:52:40,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:52:40,510::task::974::TaskManager.Task::(_decref) Task=`c94312d1-523d-4150-b738-40e60241d651`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:41,226::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:52:41,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:52:41,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:52:41,247::task::579::TaskManager.Task::(_updateState) Task=`d23254a7-fe9d-455f-85c9-9737315bba04`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:52:41,247::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:52:41,248::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:52:41,248::task::1168::TaskManager.Task::(prepare) Task=`d23254a7-fe9d-455f-85c9-9737315bba04`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:52:41,248::task::579::TaskManager.Task::(_updateState) Task=`d23254a7-fe9d-455f-85c9-9737315bba04`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:52:41,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:52:41,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:52:41,248::task::974::TaskManager.Task::(_decref) Task=`d23254a7-fe9d-455f-85c9-9737315bba04`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:52:41,385::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:52:41,464::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:52:41,481::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292093 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:52:41,491::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:52:41,508::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000244356 s, 16.8 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:52:41,513::task::579::TaskManager.Task::(_updateState) Task=`275aff9d-85b5-4ff5-a792-d79fdf013d23`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:52:41,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:52:41,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:52:41,514::task::1168::TaskManager.Task::(prepare) Task=`275aff9d-85b5-4ff5-a792-d79fdf013d23`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:52:41,515::task::579::TaskManager.Task::(_updateState) Task=`275aff9d-85b5-4ff5-a792-d79fdf013d23`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:52:41,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:52:41,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:52:41,515::task::974::TaskManager.Task::(_decref) Task=`275aff9d-85b5-4ff5-a792-d79fdf013d23`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:42,228::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:52:42,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:52:42,229::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:43,231::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:52:43,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:52:43,233::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:52:43,234::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:43,386::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:44,236::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:45,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:52:45,238::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:45,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:45,389::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:52:45,389::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:52:45,391::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 16:52:46,111::task::579::TaskManager.Task::(_updateState) Task=`a4e913aa-f571-44ee-9d5d-8609feb1be8e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:52:46,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:52:46,111::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:52:46,111::task::1168::TaskManager.Task::(prepare) Task=`a4e913aa-f571-44ee-9d5d-8609feb1be8e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:52:46,111::task::579::TaskManager.Task::(_updateState) Task=`a4e913aa-f571-44ee-9d5d-8609feb1be8e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:52:46,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:52:46,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:52:46,112::task::974::TaskManager.Task::(_decref) Task=`a4e913aa-f571-44ee-9d5d-8609feb1be8e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:52:46,112::task::579::TaskManager.Task::(_updateState) Task=`975ead7e-b068-4508-b8e2-6113f2a9089d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:52:46,112::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:52:46,113::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:52:46,113::task::1168::TaskManager.Task::(prepare) Task=`975ead7e-b068-4508-b8e2-6113f2a9089d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:52:46,113::task::579::TaskManager.Task::(_updateState) Task=`975ead7e-b068-4508-b8e2-6113f2a9089d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:52:46,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:52:46,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:52:46,113::task::974::TaskManager.Task::(_decref) Task=`975ead7e-b068-4508-b8e2-6113f2a9089d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:52:46,114::task::579::TaskManager.Task::(_updateState) Task=`81b55811-86d6-4f11-ad33-46fe8a4fef38`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:52:46,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:52:46,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:52:46,114::task::1168::TaskManager.Task::(prepare) Task=`81b55811-86d6-4f11-ad33-46fe8a4fef38`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:52:46,114::task::579::TaskManager.Task::(_updateState) Task=`81b55811-86d6-4f11-ad33-46fe8a4fef38`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:52:46,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:52:46,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:52:46,115::task::974::TaskManager.Task::(_decref) Task=`81b55811-86d6-4f11-ad33-46fe8a4fef38`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:46,239::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:47,241::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:47,392::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:48,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287217::DEBUG::2014-01-16 16:52:48,665::task::579::TaskManager.Task::(_updateState) Task=`1ba4f80a-0ea7-4939-a172-26b0d32d1cad`::moving from state init -> state preparing >Thread-287217::INFO::2014-01-16 16:52:48,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287217::INFO::2014-01-16 16:52:48,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292093', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244356', 'lastCheck': '7.2', 'valid': True}} >Thread-287217::DEBUG::2014-01-16 16:52:48,665::task::1168::TaskManager.Task::(prepare) Task=`1ba4f80a-0ea7-4939-a172-26b0d32d1cad`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292093', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244356', 'lastCheck': '7.2', 'valid': True}} >Thread-287217::DEBUG::2014-01-16 16:52:48,666::task::579::TaskManager.Task::(_updateState) Task=`1ba4f80a-0ea7-4939-a172-26b0d32d1cad`::moving from state preparing -> state finished >Thread-287217::DEBUG::2014-01-16 16:52:48,666::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287217::DEBUG::2014-01-16 16:52:48,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287217::DEBUG::2014-01-16 16:52:48,666::task::974::TaskManager.Task::(_decref) Task=`1ba4f80a-0ea7-4939-a172-26b0d32d1cad`::ref 0 aborting False >Thread-16244::DEBUG::2014-01-16 16:52:49,128::task::579::TaskManager.Task::(_updateState) Task=`5fcf468e-2f02-4603-ad78-c5119483bb47`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:52:49,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:52:49,129::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:52:49,129::task::1168::TaskManager.Task::(prepare) Task=`5fcf468e-2f02-4603-ad78-c5119483bb47`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:52:49,129::task::579::TaskManager.Task::(_updateState) Task=`5fcf468e-2f02-4603-ad78-c5119483bb47`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:52:49,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:52:49,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:52:49,130::task::974::TaskManager.Task::(_decref) Task=`5fcf468e-2f02-4603-ad78-c5119483bb47`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:49,244::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:49,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:50,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:50,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:51,246::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:52:51,247::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:51,396::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:52:51,495::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:52:51,511::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251317 s, 1.5 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:52:51,518::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:52:51,531::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000248801 s, 16.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:52:52,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:53,250::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:53,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:52:53,969::task::579::TaskManager.Task::(_updateState) Task=`d3005fbb-e4ee-455e-825c-540f75f033b8`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:52:53,970::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:52:53,970::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:52:53,970::task::1168::TaskManager.Task::(prepare) Task=`d3005fbb-e4ee-455e-825c-540f75f033b8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:52:53,970::task::579::TaskManager.Task::(_updateState) Task=`d3005fbb-e4ee-455e-825c-540f75f033b8`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:52:53,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:52:53,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:52:53,971::task::974::TaskManager.Task::(_decref) Task=`d3005fbb-e4ee-455e-825c-540f75f033b8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:52:54,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:55,252::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:55,398::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:52:55,399::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:56,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:52:56,254::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:52:56,254::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:57,255::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:52:57,255::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:57,400::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:52:58,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:52:58,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:52:58,256::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:52:59,257::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:52:59,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:52:59,402::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:00,258::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:53:00,259::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:00,403::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:53:00,404::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:53:00,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:53:00,510::task::579::TaskManager.Task::(_updateState) Task=`1b49a3e9-6de3-4917-9200-14ce8f49dfde`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:53:00,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:53:00,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:53:00,511::task::1168::TaskManager.Task::(prepare) Task=`1b49a3e9-6de3-4917-9200-14ce8f49dfde`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:53:00,511::task::579::TaskManager.Task::(_updateState) Task=`1b49a3e9-6de3-4917-9200-14ce8f49dfde`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:53:00,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:53:00,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:53:00,512::task::974::TaskManager.Task::(_decref) Task=`1b49a3e9-6de3-4917-9200-14ce8f49dfde`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:01,260::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:01,406::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:53:01,520::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:53:01,540::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000402904 s, 906 kB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:53:01,548::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:53:01,570::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000232198 s, 17.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:53:02,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:53:02,261::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:03,262::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:53:03,262::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:03,408::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:04,263::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:53:04,263::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:53:04,264::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:53:04,264::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287223::DEBUG::2014-01-16 16:53:04,377::task::579::TaskManager.Task::(_updateState) Task=`9b0c8932-ec01-4bf4-b137-ae71e742c787`::moving from state init -> state preparing >Thread-287223::INFO::2014-01-16 16:53:04,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287223::INFO::2014-01-16 16:53:04,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000402904', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232198', 'lastCheck': '2.8', 'valid': True}} >Thread-287223::DEBUG::2014-01-16 16:53:04,377::task::1168::TaskManager.Task::(prepare) Task=`9b0c8932-ec01-4bf4-b137-ae71e742c787`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000402904', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232198', 'lastCheck': '2.8', 'valid': True}} >Thread-287223::DEBUG::2014-01-16 16:53:04,378::task::579::TaskManager.Task::(_updateState) Task=`9b0c8932-ec01-4bf4-b137-ae71e742c787`::moving from state preparing -> state finished >Thread-287223::DEBUG::2014-01-16 16:53:04,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287223::DEBUG::2014-01-16 16:53:04,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287223::DEBUG::2014-01-16 16:53:04,378::task::974::TaskManager.Task::(_decref) Task=`9b0c8932-ec01-4bf4-b137-ae71e742c787`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:05,265::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:53:05,265::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:53:05,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:05,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:05,410::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:06,266::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:53:06,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:53:06,558::task::579::TaskManager.Task::(_updateState) Task=`adcd077c-cb48-420c-8bec-67a4345262ab`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:53:06,558::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:53:06,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:53:06,559::task::1168::TaskManager.Task::(prepare) Task=`adcd077c-cb48-420c-8bec-67a4345262ab`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:53:06,559::task::579::TaskManager.Task::(_updateState) Task=`adcd077c-cb48-420c-8bec-67a4345262ab`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:53:06,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:53:06,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:53:06,559::task::974::TaskManager.Task::(_decref) Task=`adcd077c-cb48-420c-8bec-67a4345262ab`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:53:06,560::task::579::TaskManager.Task::(_updateState) Task=`ef428502-b267-49b5-97df-3c4e760d7c14`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:53:06,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:53:06,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:53:06,560::task::1168::TaskManager.Task::(prepare) Task=`ef428502-b267-49b5-97df-3c4e760d7c14`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:53:06,560::task::579::TaskManager.Task::(_updateState) Task=`ef428502-b267-49b5-97df-3c4e760d7c14`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:53:06,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:53:06,561::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:53:06,561::task::974::TaskManager.Task::(_decref) Task=`ef428502-b267-49b5-97df-3c4e760d7c14`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:53:06,568::task::579::TaskManager.Task::(_updateState) Task=`99869ec7-089f-42f7-94cd-9e0a0df7cb2b`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:53:06,568::task::579::TaskManager.Task::(_updateState) Task=`03afd45f-5594-4492-b0ef-67e91e8fc38e`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:53:06,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:53:06,569::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:53:06,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 16:53:06,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:53:06,570::task::1168::TaskManager.Task::(prepare) Task=`03afd45f-5594-4492-b0ef-67e91e8fc38e`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:53:06,571::task::1168::TaskManager.Task::(prepare) Task=`99869ec7-089f-42f7-94cd-9e0a0df7cb2b`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 16:53:06,571::task::579::TaskManager.Task::(_updateState) Task=`03afd45f-5594-4492-b0ef-67e91e8fc38e`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:53:06,571::task::579::TaskManager.Task::(_updateState) Task=`99869ec7-089f-42f7-94cd-9e0a0df7cb2b`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:53:06,571::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:53:06,571::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:53:06,572::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:53:06,572::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:53:06,572::task::974::TaskManager.Task::(_decref) Task=`03afd45f-5594-4492-b0ef-67e91e8fc38e`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 16:53:06,572::task::974::TaskManager.Task::(_decref) Task=`99869ec7-089f-42f7-94cd-9e0a0df7cb2b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:07,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:53:07,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:53:07,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:53:07,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:07,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:53:07,582::task::579::TaskManager.Task::(_updateState) Task=`eeaf8537-6478-48d6-bbd6-8bd548ae8a2e`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:53:07,582::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:53:07,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:53:07,582::task::1168::TaskManager.Task::(prepare) Task=`eeaf8537-6478-48d6-bbd6-8bd548ae8a2e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:53:07,582::task::579::TaskManager.Task::(_updateState) Task=`eeaf8537-6478-48d6-bbd6-8bd548ae8a2e`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:53:07,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:53:07,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:53:07,583::task::974::TaskManager.Task::(_decref) Task=`eeaf8537-6478-48d6-bbd6-8bd548ae8a2e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:08,270::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:53:08,298::task::579::TaskManager.Task::(_updateState) Task=`e29e7c1f-0735-4774-9d6c-072c1490a1ff`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:53:08,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:53:08,300::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:53:08,300::task::1168::TaskManager.Task::(prepare) Task=`e29e7c1f-0735-4774-9d6c-072c1490a1ff`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:53:08,300::task::579::TaskManager.Task::(_updateState) Task=`e29e7c1f-0735-4774-9d6c-072c1490a1ff`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:53:08,300::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:53:08,300::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:53:08,300::task::974::TaskManager.Task::(_decref) Task=`e29e7c1f-0735-4774-9d6c-072c1490a1ff`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:53:08,301::task::579::TaskManager.Task::(_updateState) Task=`0e95eccb-4385-4cd0-aa70-f2ae013421ab`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:53:08,301::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:53:08,301::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:53:08,301::task::1168::TaskManager.Task::(prepare) Task=`0e95eccb-4385-4cd0-aa70-f2ae013421ab`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:53:08,301::task::579::TaskManager.Task::(_updateState) Task=`0e95eccb-4385-4cd0-aa70-f2ae013421ab`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:53:08,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:53:08,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:53:08,302::task::974::TaskManager.Task::(_decref) Task=`0e95eccb-4385-4cd0-aa70-f2ae013421ab`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:09,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:53:09,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:53:09,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:53:09,273::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:09,273::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:53:09,275::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:53:09,412::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:10,276::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:10,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:53:10,983::task::579::TaskManager.Task::(_updateState) Task=`9e321681-d8fe-4058-b1f8-b88d9eb0cd50`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:53:10,983::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:53:10,983::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:53:10,984::task::1168::TaskManager.Task::(prepare) Task=`9e321681-d8fe-4058-b1f8-b88d9eb0cd50`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:53:10,984::task::579::TaskManager.Task::(_updateState) Task=`9e321681-d8fe-4058-b1f8-b88d9eb0cd50`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:53:10,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:53:10,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:53:10,984::task::974::TaskManager.Task::(_decref) Task=`9e321681-d8fe-4058-b1f8-b88d9eb0cd50`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:53:10,984::task::579::TaskManager.Task::(_updateState) Task=`e1d8dd39-40cd-43e3-b54b-c32317dc7ba9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:53:10,985::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:53:10,985::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:53:10,985::task::1168::TaskManager.Task::(prepare) Task=`e1d8dd39-40cd-43e3-b54b-c32317dc7ba9`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:53:10,985::task::579::TaskManager.Task::(_updateState) Task=`e1d8dd39-40cd-43e3-b54b-c32317dc7ba9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:53:10,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:53:10,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:53:10,986::task::974::TaskManager.Task::(_decref) Task=`e1d8dd39-40cd-43e3-b54b-c32317dc7ba9`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:53:10,986::task::579::TaskManager.Task::(_updateState) Task=`3cb6a847-06a9-4e32-93e0-fbe4efbc5cc8`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:53:10,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:53:10,986::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:53:10,986::task::1168::TaskManager.Task::(prepare) Task=`3cb6a847-06a9-4e32-93e0-fbe4efbc5cc8`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:53:10,986::task::579::TaskManager.Task::(_updateState) Task=`3cb6a847-06a9-4e32-93e0-fbe4efbc5cc8`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:53:10,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:53:10,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:53:10,987::task::974::TaskManager.Task::(_decref) Task=`3cb6a847-06a9-4e32-93e0-fbe4efbc5cc8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:11,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:53:11,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:53:11,278::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:11,415::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:53:11,553::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:53:11,572::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274775 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:53:11,577::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:53:11,604::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000226161 s, 18.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:53:11,606::task::579::TaskManager.Task::(_updateState) Task=`a0194445-b571-49a3-b003-dba53459d9f0`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:53:11,610::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:53:11,614::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:53:11,618::task::1168::TaskManager.Task::(prepare) Task=`a0194445-b571-49a3-b003-dba53459d9f0`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:53:11,620::task::579::TaskManager.Task::(_updateState) Task=`a0194445-b571-49a3-b003-dba53459d9f0`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:53:11,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:53:11,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:53:11,627::task::974::TaskManager.Task::(_decref) Task=`a0194445-b571-49a3-b003-dba53459d9f0`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:53:11,636::task::579::TaskManager.Task::(_updateState) Task=`9da5de09-7960-4a29-901b-6719be3e4944`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:53:11,636::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:53:11,637::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:53:11,637::task::1168::TaskManager.Task::(prepare) Task=`9da5de09-7960-4a29-901b-6719be3e4944`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:53:11,637::task::579::TaskManager.Task::(_updateState) Task=`9da5de09-7960-4a29-901b-6719be3e4944`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:53:11,637::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:53:11,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:53:11,638::task::974::TaskManager.Task::(_decref) Task=`9da5de09-7960-4a29-901b-6719be3e4944`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:12,279::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:53:12,279::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:53:12,280::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:53:12,454::task::579::TaskManager.Task::(_updateState) Task=`7259d7cc-7f49-4552-9a6a-e6fbdb11b5da`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:53:12,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:53:12,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:53:12,455::task::1168::TaskManager.Task::(prepare) Task=`7259d7cc-7f49-4552-9a6a-e6fbdb11b5da`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:53:12,455::task::579::TaskManager.Task::(_updateState) Task=`7259d7cc-7f49-4552-9a6a-e6fbdb11b5da`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:53:12,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:53:12,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:53:12,456::task::974::TaskManager.Task::(_decref) Task=`7259d7cc-7f49-4552-9a6a-e6fbdb11b5da`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:53:12,456::task::579::TaskManager.Task::(_updateState) Task=`149caf4a-54cd-4e3a-8294-1c2dd1b41b68`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:53:12,456::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:53:12,456::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:53:12,456::task::1168::TaskManager.Task::(prepare) Task=`149caf4a-54cd-4e3a-8294-1c2dd1b41b68`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:53:12,457::task::579::TaskManager.Task::(_updateState) Task=`149caf4a-54cd-4e3a-8294-1c2dd1b41b68`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:53:12,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:53:12,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:53:12,457::task::974::TaskManager.Task::(_decref) Task=`149caf4a-54cd-4e3a-8294-1c2dd1b41b68`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:53:12,946::task::579::TaskManager.Task::(_updateState) Task=`ec2ce9b6-db41-4db9-8a83-edc0c2244b03`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:53:12,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:53:12,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:53:12,947::task::1168::TaskManager.Task::(prepare) Task=`ec2ce9b6-db41-4db9-8a83-edc0c2244b03`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:53:12,947::task::579::TaskManager.Task::(_updateState) Task=`ec2ce9b6-db41-4db9-8a83-edc0c2244b03`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:53:12,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:53:12,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:53:12,947::task::974::TaskManager.Task::(_decref) Task=`ec2ce9b6-db41-4db9-8a83-edc0c2244b03`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:13,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:53:13,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:53:13,285::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:53:13,286::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:13,417::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:53:13,916::task::579::TaskManager.Task::(_updateState) Task=`f80b4f02-d793-44c9-bfa9-4ae0fa4bd718`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:53:13,916::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:53:13,917::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:53:13,917::task::1168::TaskManager.Task::(prepare) Task=`f80b4f02-d793-44c9-bfa9-4ae0fa4bd718`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:53:13,917::task::579::TaskManager.Task::(_updateState) Task=`f80b4f02-d793-44c9-bfa9-4ae0fa4bd718`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:53:13,917::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:53:13,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:53:13,917::task::974::TaskManager.Task::(_decref) Task=`f80b4f02-d793-44c9-bfa9-4ae0fa4bd718`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:14,286::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:15,287::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:53:15,288::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:15,418::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:15,419::task::579::TaskManager.Task::(_updateState) Task=`7361b0c9-f5be-4423-a2dc-52bc41196326`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:53:15,419::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:53:15,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:53:15,419::task::1168::TaskManager.Task::(prepare) Task=`7361b0c9-f5be-4423-a2dc-52bc41196326`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:53:15,419::task::579::TaskManager.Task::(_updateState) Task=`7361b0c9-f5be-4423-a2dc-52bc41196326`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:53:15,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:53:15,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:53:15,420::task::974::TaskManager.Task::(_decref) Task=`7361b0c9-f5be-4423-a2dc-52bc41196326`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:53:15,421::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:53:15,422::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:53:15,423::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:15,424::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:15,425::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:16,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:53:17,216::task::579::TaskManager.Task::(_updateState) Task=`7e28b9e3-457b-4f25-a9af-d3be3f256c01`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:53:17,217::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:53:17,217::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:53:17,217::task::1168::TaskManager.Task::(prepare) Task=`7e28b9e3-457b-4f25-a9af-d3be3f256c01`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:53:17,218::task::579::TaskManager.Task::(_updateState) Task=`7e28b9e3-457b-4f25-a9af-d3be3f256c01`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:53:17,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:53:17,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:53:17,218::task::974::TaskManager.Task::(_decref) Task=`7e28b9e3-457b-4f25-a9af-d3be3f256c01`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:17,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:17,426::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:53:18,015::task::579::TaskManager.Task::(_updateState) Task=`623f574e-3229-4ca5-9ba1-5f0681869437`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:53:18,016::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:53:18,017::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:53:18,017::task::1168::TaskManager.Task::(prepare) Task=`623f574e-3229-4ca5-9ba1-5f0681869437`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:53:18,017::task::579::TaskManager.Task::(_updateState) Task=`623f574e-3229-4ca5-9ba1-5f0681869437`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:53:18,017::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:53:18,017::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:53:18,017::task::974::TaskManager.Task::(_decref) Task=`623f574e-3229-4ca5-9ba1-5f0681869437`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:18,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:19,294::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:19,427::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287229::DEBUG::2014-01-16 16:53:20,126::task::579::TaskManager.Task::(_updateState) Task=`3f9b590c-772b-4259-8aec-7794917f9bfd`::moving from state init -> state preparing >Thread-287229::INFO::2014-01-16 16:53:20,126::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287229::INFO::2014-01-16 16:53:20,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274775', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226161', 'lastCheck': '8.5', 'valid': True}} >Thread-287229::DEBUG::2014-01-16 16:53:20,127::task::1168::TaskManager.Task::(prepare) Task=`3f9b590c-772b-4259-8aec-7794917f9bfd`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274775', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000226161', 'lastCheck': '8.5', 'valid': True}} >Thread-287229::DEBUG::2014-01-16 16:53:20,127::task::579::TaskManager.Task::(_updateState) Task=`3f9b590c-772b-4259-8aec-7794917f9bfd`::moving from state preparing -> state finished >Thread-287229::DEBUG::2014-01-16 16:53:20,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287229::DEBUG::2014-01-16 16:53:20,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287229::DEBUG::2014-01-16 16:53:20,127::task::974::TaskManager.Task::(_decref) Task=`3f9b590c-772b-4259-8aec-7794917f9bfd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:20,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:20,428::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:53:20,624::task::579::TaskManager.Task::(_updateState) Task=`dfe10c20-3d03-4419-a319-5465d2c512af`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:53:20,624::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:53:20,624::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:53:20,624::task::1168::TaskManager.Task::(prepare) Task=`dfe10c20-3d03-4419-a319-5465d2c512af`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:53:20,624::task::579::TaskManager.Task::(_updateState) Task=`dfe10c20-3d03-4419-a319-5465d2c512af`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:53:20,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:53:20,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:53:20,625::task::974::TaskManager.Task::(_decref) Task=`dfe10c20-3d03-4419-a319-5465d2c512af`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:21,297::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:53:21,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:21,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:53:21,580::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:53:21,596::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000269661 s, 1.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:53:21,634::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:53:21,651::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000300927 s, 13.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:53:22,299::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:23,301::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:23,431::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:24,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:25,303::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:25,433::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:25,434::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:53:25,949::task::579::TaskManager.Task::(_updateState) Task=`dfdbc702-fd80-4130-9443-e2b683804bcb`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:53:25,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:53:25,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:53:25,950::task::1168::TaskManager.Task::(prepare) Task=`dfdbc702-fd80-4130-9443-e2b683804bcb`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:53:25,950::task::579::TaskManager.Task::(_updateState) Task=`dfdbc702-fd80-4130-9443-e2b683804bcb`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:53:25,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:53:25,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:53:25,950::task::974::TaskManager.Task::(_decref) Task=`dfdbc702-fd80-4130-9443-e2b683804bcb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:26,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:53:26,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:53:26,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:27,307::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:53:27,307::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:27,435::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:28,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:53:28,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:53:28,308::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:53:28,504::task::579::TaskManager.Task::(_updateState) Task=`0d0a8fb2-009c-470b-aa9b-e83ec4904877`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:53:28,504::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:53:28,505::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:53:28,505::task::1168::TaskManager.Task::(prepare) Task=`0d0a8fb2-009c-470b-aa9b-e83ec4904877`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:53:28,505::task::579::TaskManager.Task::(_updateState) Task=`0d0a8fb2-009c-470b-aa9b-e83ec4904877`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:53:28,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:53:28,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:53:28,506::task::974::TaskManager.Task::(_decref) Task=`0d0a8fb2-009c-470b-aa9b-e83ec4904877`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:29,309::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:53:29,309::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:29,436::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:30,310::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:53:30,310::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:30,439::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:53:30,439::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:53:30,440::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:53:31,068::task::579::TaskManager.Task::(_updateState) Task=`a7b78bc4-6762-46cd-a5a2-c17ab7c67136`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:53:31,068::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:53:31,069::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:53:31,069::task::1168::TaskManager.Task::(prepare) Task=`a7b78bc4-6762-46cd-a5a2-c17ab7c67136`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:53:31,069::task::579::TaskManager.Task::(_updateState) Task=`a7b78bc4-6762-46cd-a5a2-c17ab7c67136`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:53:31,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:53:31,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:53:31,069::task::974::TaskManager.Task::(_decref) Task=`a7b78bc4-6762-46cd-a5a2-c17ab7c67136`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:53:31,070::task::579::TaskManager.Task::(_updateState) Task=`eebe3282-bad9-42f6-8c17-c028e7727d7d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:53:31,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:53:31,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:53:31,070::task::1168::TaskManager.Task::(prepare) Task=`eebe3282-bad9-42f6-8c17-c028e7727d7d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:53:31,070::task::579::TaskManager.Task::(_updateState) Task=`eebe3282-bad9-42f6-8c17-c028e7727d7d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:53:31,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:53:31,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:53:31,071::task::974::TaskManager.Task::(_decref) Task=`eebe3282-bad9-42f6-8c17-c028e7727d7d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:31,312::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:31,441::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:53:31,604::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:53:31,620::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000344265 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:53:31,658::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:53:31,674::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213672 s, 19.2 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:53:32,187::task::579::TaskManager.Task::(_updateState) Task=`d578a860-3957-4dcf-87bb-623b424848ad`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:53:32,187::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:53:32,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:53:32,188::task::1168::TaskManager.Task::(prepare) Task=`d578a860-3957-4dcf-87bb-623b424848ad`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:53:32,188::task::579::TaskManager.Task::(_updateState) Task=`d578a860-3957-4dcf-87bb-623b424848ad`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:53:32,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:53:32,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:53:32,188::task::974::TaskManager.Task::(_decref) Task=`d578a860-3957-4dcf-87bb-623b424848ad`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:53:32,206::task::579::TaskManager.Task::(_updateState) Task=`e64a77ee-d391-46d2-a66b-08e737fb1f4b`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:53:32,206::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:53:32,206::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:53:32,207::task::1168::TaskManager.Task::(prepare) Task=`e64a77ee-d391-46d2-a66b-08e737fb1f4b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:53:32,207::task::579::TaskManager.Task::(_updateState) Task=`e64a77ee-d391-46d2-a66b-08e737fb1f4b`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:53:32,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:53:32,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:53:32,207::task::974::TaskManager.Task::(_decref) Task=`e64a77ee-d391-46d2-a66b-08e737fb1f4b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:32,313::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:53:32,313::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:33,314::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:53:33,314::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:33,443::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:34,315::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:53:34,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:53:34,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:53:34,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:35,317::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:53:35,317::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:53:35,317::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:35,444::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:35,445::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287235::DEBUG::2014-01-16 16:53:35,844::task::579::TaskManager.Task::(_updateState) Task=`c35b9af6-fab1-430a-b575-aa64507274e9`::moving from state init -> state preparing >Thread-287235::INFO::2014-01-16 16:53:35,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287235::INFO::2014-01-16 16:53:35,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344265', 'lastCheck': '4.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213672', 'lastCheck': '4.2', 'valid': True}} >Thread-287235::DEBUG::2014-01-16 16:53:35,845::task::1168::TaskManager.Task::(prepare) Task=`c35b9af6-fab1-430a-b575-aa64507274e9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344265', 'lastCheck': '4.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213672', 'lastCheck': '4.2', 'valid': True}} >Thread-287235::DEBUG::2014-01-16 16:53:35,845::task::579::TaskManager.Task::(_updateState) Task=`c35b9af6-fab1-430a-b575-aa64507274e9`::moving from state preparing -> state finished >Thread-287235::DEBUG::2014-01-16 16:53:35,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287235::DEBUG::2014-01-16 16:53:35,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287235::DEBUG::2014-01-16 16:53:35,845::task::974::TaskManager.Task::(_decref) Task=`c35b9af6-fab1-430a-b575-aa64507274e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:36,318::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:53:36,319::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:53:37,250::task::579::TaskManager.Task::(_updateState) Task=`74bb9131-8981-4a34-9586-a55bed6e53ff`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:53:37,251::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:53:37,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:53:37,251::task::1168::TaskManager.Task::(prepare) Task=`74bb9131-8981-4a34-9586-a55bed6e53ff`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:53:37,251::task::579::TaskManager.Task::(_updateState) Task=`74bb9131-8981-4a34-9586-a55bed6e53ff`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:53:37,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:53:37,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:53:37,252::task::974::TaskManager.Task::(_decref) Task=`74bb9131-8981-4a34-9586-a55bed6e53ff`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:37,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:53:37,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:53:37,320::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:53:37,320::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:37,446::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:38,321::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:39,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:53:39,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:53:39,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:53:39,322::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:39,322::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:53:39,323::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:53:39,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:53:39,663::task::579::TaskManager.Task::(_updateState) Task=`2ce75795-e8e1-4be7-9eef-940216b55be6`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:53:39,663::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:53:39,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:53:39,663::task::1168::TaskManager.Task::(prepare) Task=`2ce75795-e8e1-4be7-9eef-940216b55be6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:53:39,664::task::579::TaskManager.Task::(_updateState) Task=`2ce75795-e8e1-4be7-9eef-940216b55be6`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:53:39,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:53:39,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:53:39,664::task::974::TaskManager.Task::(_decref) Task=`2ce75795-e8e1-4be7-9eef-940216b55be6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:40,324::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:40,449::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:53:40,656::task::579::TaskManager.Task::(_updateState) Task=`d4b4e3db-f19a-4844-bb1c-1f16a0881ed3`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:53:40,657::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:53:40,657::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:53:40,657::task::1168::TaskManager.Task::(prepare) Task=`d4b4e3db-f19a-4844-bb1c-1f16a0881ed3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:53:40,657::task::579::TaskManager.Task::(_updateState) Task=`d4b4e3db-f19a-4844-bb1c-1f16a0881ed3`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:53:40,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:53:40,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:53:40,658::task::974::TaskManager.Task::(_decref) Task=`d4b4e3db-f19a-4844-bb1c-1f16a0881ed3`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:53:40,659::task::579::TaskManager.Task::(_updateState) Task=`9023a831-c74d-4503-b925-793331c28e88`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:53:40,660::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:53:40,660::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:53:40,660::task::1168::TaskManager.Task::(prepare) Task=`9023a831-c74d-4503-b925-793331c28e88`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:53:40,660::task::579::TaskManager.Task::(_updateState) Task=`9023a831-c74d-4503-b925-793331c28e88`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:53:40,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:53:40,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:53:40,661::task::974::TaskManager.Task::(_decref) Task=`9023a831-c74d-4503-b925-793331c28e88`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:53:40,673::task::579::TaskManager.Task::(_updateState) Task=`d620d466-8033-4c22-8441-ec0e3d5c8fe8`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:53:40,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:53:40,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:53:40,674::task::1168::TaskManager.Task::(prepare) Task=`d620d466-8033-4c22-8441-ec0e3d5c8fe8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:53:40,674::task::579::TaskManager.Task::(_updateState) Task=`d620d466-8033-4c22-8441-ec0e3d5c8fe8`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:53:40,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:53:40,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:53:40,674::task::974::TaskManager.Task::(_decref) Task=`d620d466-8033-4c22-8441-ec0e3d5c8fe8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:41,325::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:53:41,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:53:41,326::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:53:41,403::task::579::TaskManager.Task::(_updateState) Task=`ce870e6c-3c85-4bd7-8d8a-fd20fa6c9930`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:53:41,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:53:41,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:53:41,404::task::1168::TaskManager.Task::(prepare) Task=`ce870e6c-3c85-4bd7-8d8a-fd20fa6c9930`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:53:41,404::task::579::TaskManager.Task::(_updateState) Task=`ce870e6c-3c85-4bd7-8d8a-fd20fa6c9930`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:53:41,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:53:41,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:53:41,404::task::974::TaskManager.Task::(_decref) Task=`ce870e6c-3c85-4bd7-8d8a-fd20fa6c9930`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:53:41,450::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:53:41,628::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:53:41,646::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000239154 s, 1.5 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:53:41,672::task::579::TaskManager.Task::(_updateState) Task=`dd8e8d39-78df-49b6-8d5f-247ef3ee1ac1`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:53:41,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:53:41,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:53:41,673::task::1168::TaskManager.Task::(prepare) Task=`dd8e8d39-78df-49b6-8d5f-247ef3ee1ac1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:53:41,673::task::579::TaskManager.Task::(_updateState) Task=`dd8e8d39-78df-49b6-8d5f-247ef3ee1ac1`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:53:41,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:53:41,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:53:41,674::task::974::TaskManager.Task::(_decref) Task=`dd8e8d39-78df-49b6-8d5f-247ef3ee1ac1`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:53:41,680::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:53:41,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000228368 s, 17.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:53:42,327::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:53:42,327::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:53:42,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:43,329::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:53:43,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:53:43,333::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:53:43,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:43,451::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:44,336::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:45,338::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:53:45,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:45,454::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:45,456::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:53:45,456::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:53:45,459::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:46,339::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:53:46,371::task::579::TaskManager.Task::(_updateState) Task=`aa0dfc40-3d3d-434e-b16f-e8ff64ed750d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:53:46,372::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:53:46,372::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:53:46,372::task::1168::TaskManager.Task::(prepare) Task=`aa0dfc40-3d3d-434e-b16f-e8ff64ed750d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:53:46,372::task::579::TaskManager.Task::(_updateState) Task=`aa0dfc40-3d3d-434e-b16f-e8ff64ed750d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:53:46,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:53:46,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:53:46,373::task::974::TaskManager.Task::(_decref) Task=`aa0dfc40-3d3d-434e-b16f-e8ff64ed750d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:53:46,373::task::579::TaskManager.Task::(_updateState) Task=`f1318846-9ef4-42bc-90d2-b2f222491501`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:53:46,373::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:53:46,374::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:53:46,374::task::1168::TaskManager.Task::(prepare) Task=`f1318846-9ef4-42bc-90d2-b2f222491501`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:53:46,374::task::579::TaskManager.Task::(_updateState) Task=`f1318846-9ef4-42bc-90d2-b2f222491501`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:53:46,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:53:46,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:53:46,374::task::974::TaskManager.Task::(_decref) Task=`f1318846-9ef4-42bc-90d2-b2f222491501`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:53:46,374::task::579::TaskManager.Task::(_updateState) Task=`e7295d5a-136d-4f27-80d7-9ebaa181f430`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:53:46,375::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:53:46,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:53:46,375::task::1168::TaskManager.Task::(prepare) Task=`e7295d5a-136d-4f27-80d7-9ebaa181f430`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:53:46,375::task::579::TaskManager.Task::(_updateState) Task=`e7295d5a-136d-4f27-80d7-9ebaa181f430`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:53:46,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:53:46,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:53:46,375::task::974::TaskManager.Task::(_decref) Task=`e7295d5a-136d-4f27-80d7-9ebaa181f430`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:47,340::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:47,460::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:48,341::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:53:49,288::task::579::TaskManager.Task::(_updateState) Task=`7d82fefa-1ce6-496e-a4a7-d2c9576e2212`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:53:49,289::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:53:49,289::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:53:49,289::task::1168::TaskManager.Task::(prepare) Task=`7d82fefa-1ce6-496e-a4a7-d2c9576e2212`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:53:49,289::task::579::TaskManager.Task::(_updateState) Task=`7d82fefa-1ce6-496e-a4a7-d2c9576e2212`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:53:49,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:53:49,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:53:49,290::task::974::TaskManager.Task::(_decref) Task=`7d82fefa-1ce6-496e-a4a7-d2c9576e2212`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:49,342::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:49,461::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:50,343::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:50,462::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:51,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:53:51,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:51,464::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:53:51,654::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:53:51,670::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271368 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:53:51,705::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:53:51,722::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000253067 s, 16.2 MB/s\n'; <rc> = 0 >Thread-287241::DEBUG::2014-01-16 16:53:51,766::task::579::TaskManager.Task::(_updateState) Task=`7809864b-8b24-4818-a7db-49bd12f91828`::moving from state init -> state preparing >Thread-287241::INFO::2014-01-16 16:53:51,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287241::INFO::2014-01-16 16:53:51,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271368', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253067', 'lastCheck': '0.0', 'valid': True}} >Thread-287241::DEBUG::2014-01-16 16:53:51,767::task::1168::TaskManager.Task::(prepare) Task=`7809864b-8b24-4818-a7db-49bd12f91828`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271368', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253067', 'lastCheck': '0.0', 'valid': True}} >Thread-287241::DEBUG::2014-01-16 16:53:51,767::task::579::TaskManager.Task::(_updateState) Task=`7809864b-8b24-4818-a7db-49bd12f91828`::moving from state preparing -> state finished >Thread-287241::DEBUG::2014-01-16 16:53:51,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287241::DEBUG::2014-01-16 16:53:51,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287241::DEBUG::2014-01-16 16:53:51,768::task::974::TaskManager.Task::(_decref) Task=`7809864b-8b24-4818-a7db-49bd12f91828`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:52,346::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:53,347::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:53,465::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:53:54,138::task::579::TaskManager.Task::(_updateState) Task=`03ac02c0-c60c-47fc-99d8-318910f3d47e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:53:54,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:53:54,139::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:53:54,139::task::1168::TaskManager.Task::(prepare) Task=`03ac02c0-c60c-47fc-99d8-318910f3d47e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:53:54,139::task::579::TaskManager.Task::(_updateState) Task=`03ac02c0-c60c-47fc-99d8-318910f3d47e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:53:54,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:53:54,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:53:54,139::task::974::TaskManager.Task::(_decref) Task=`03ac02c0-c60c-47fc-99d8-318910f3d47e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:53:54,348::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:55,349::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:55,466::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:53:55,467::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:56,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:53:56,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:53:56,351::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:57,352::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:53:57,352::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:57,468::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:53:58,353::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:53:58,353::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:53:58,353::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:53:59,354::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:53:59,354::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:53:59,470::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:00,355::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:54:00,356::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:00,472::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:54:00,472::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:54:00,473::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:54:00,666::task::579::TaskManager.Task::(_updateState) Task=`4f5b1292-898f-45b5-b885-78347b183097`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:54:00,667::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:54:00,667::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:54:00,667::task::1168::TaskManager.Task::(prepare) Task=`4f5b1292-898f-45b5-b885-78347b183097`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:54:00,667::task::579::TaskManager.Task::(_updateState) Task=`4f5b1292-898f-45b5-b885-78347b183097`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:54:00,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:54:00,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:54:00,668::task::974::TaskManager.Task::(_decref) Task=`4f5b1292-898f-45b5-b885-78347b183097`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:01,356::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:01,475::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:54:01,679::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:54:01,697::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271914 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:54:01,730::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:54:01,744::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000231981 s, 17.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:54:02,357::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:54:02,357::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:03,358::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:54:03,359::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:03,476::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:04,359::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:54:04,359::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:54:04,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:54:04,360::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:05,361::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:54:05,361::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:54:05,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:05,478::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:05,479::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:06,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:54:06,363::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:54:06,660::task::579::TaskManager.Task::(_updateState) Task=`1b4c7020-0cea-47c5-a23a-6547d477a66e`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 16:54:06,661::task::579::TaskManager.Task::(_updateState) Task=`f2314eba-3a14-484c-a0cf-ca9803b1472a`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:54:06,661::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 16:54:06,661::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 16:54:06,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:54:06,663::task::1168::TaskManager.Task::(prepare) Task=`1b4c7020-0cea-47c5-a23a-6547d477a66e`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 16:54:06,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:54:06,663::task::579::TaskManager.Task::(_updateState) Task=`1b4c7020-0cea-47c5-a23a-6547d477a66e`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:54:06,664::task::1168::TaskManager.Task::(prepare) Task=`f2314eba-3a14-484c-a0cf-ca9803b1472a`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 16:54:06,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:54:06,664::task::579::TaskManager.Task::(_updateState) Task=`f2314eba-3a14-484c-a0cf-ca9803b1472a`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:54:06,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:54:06,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:54:06,665::task::974::TaskManager.Task::(_decref) Task=`1b4c7020-0cea-47c5-a23a-6547d477a66e`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:54:06,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:54:06,666::task::974::TaskManager.Task::(_decref) Task=`f2314eba-3a14-484c-a0cf-ca9803b1472a`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:54:06,793::task::579::TaskManager.Task::(_updateState) Task=`3471624e-0de3-41ff-8f01-d503b9821a7a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:54:06,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:54:06,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:54:06,794::task::1168::TaskManager.Task::(prepare) Task=`3471624e-0de3-41ff-8f01-d503b9821a7a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:54:06,794::task::579::TaskManager.Task::(_updateState) Task=`3471624e-0de3-41ff-8f01-d503b9821a7a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:54:06,794::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:54:06,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:54:06,795::task::974::TaskManager.Task::(_decref) Task=`3471624e-0de3-41ff-8f01-d503b9821a7a`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:54:06,795::task::579::TaskManager.Task::(_updateState) Task=`852689ae-7cc0-4c03-8b64-14deed4fc7af`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:54:06,795::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:54:06,795::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:54:06,795::task::1168::TaskManager.Task::(prepare) Task=`852689ae-7cc0-4c03-8b64-14deed4fc7af`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:54:06,796::task::579::TaskManager.Task::(_updateState) Task=`852689ae-7cc0-4c03-8b64-14deed4fc7af`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:54:06,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:54:06,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:54:06,796::task::974::TaskManager.Task::(_decref) Task=`852689ae-7cc0-4c03-8b64-14deed4fc7af`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:07,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:54:07,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:54:07,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:54:07,364::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:07,480::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287247::DEBUG::2014-01-16 16:54:07,484::task::579::TaskManager.Task::(_updateState) Task=`14bf64ce-7046-4d71-b510-dc4c15cf7a4a`::moving from state init -> state preparing >Thread-287247::INFO::2014-01-16 16:54:07,484::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287247::INFO::2014-01-16 16:54:07,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271914', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231981', 'lastCheck': '5.7', 'valid': True}} >Thread-287247::DEBUG::2014-01-16 16:54:07,484::task::1168::TaskManager.Task::(prepare) Task=`14bf64ce-7046-4d71-b510-dc4c15cf7a4a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271914', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231981', 'lastCheck': '5.7', 'valid': True}} >Thread-287247::DEBUG::2014-01-16 16:54:07,485::task::579::TaskManager.Task::(_updateState) Task=`14bf64ce-7046-4d71-b510-dc4c15cf7a4a`::moving from state preparing -> state finished >Thread-287247::DEBUG::2014-01-16 16:54:07,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287247::DEBUG::2014-01-16 16:54:07,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287247::DEBUG::2014-01-16 16:54:07,485::task::974::TaskManager.Task::(_decref) Task=`14bf64ce-7046-4d71-b510-dc4c15cf7a4a`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:54:07,770::task::579::TaskManager.Task::(_updateState) Task=`fd5a2317-0c6f-4d43-ac79-334dd8b46350`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:54:07,770::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:54:07,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:54:07,771::task::1168::TaskManager.Task::(prepare) Task=`fd5a2317-0c6f-4d43-ac79-334dd8b46350`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:54:07,771::task::579::TaskManager.Task::(_updateState) Task=`fd5a2317-0c6f-4d43-ac79-334dd8b46350`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:54:07,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:54:07,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:54:07,771::task::974::TaskManager.Task::(_decref) Task=`fd5a2317-0c6f-4d43-ac79-334dd8b46350`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:08,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:54:08,391::task::579::TaskManager.Task::(_updateState) Task=`d102ee5a-70da-4666-a2fb-bb633f4005d9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:54:08,391::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:54:08,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:54:08,391::task::1168::TaskManager.Task::(prepare) Task=`d102ee5a-70da-4666-a2fb-bb633f4005d9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:54:08,392::task::579::TaskManager.Task::(_updateState) Task=`d102ee5a-70da-4666-a2fb-bb633f4005d9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:54:08,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:54:08,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:54:08,392::task::974::TaskManager.Task::(_decref) Task=`d102ee5a-70da-4666-a2fb-bb633f4005d9`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:54:08,392::task::579::TaskManager.Task::(_updateState) Task=`aeb8eaa3-fe5a-4a42-b948-fb7ae61642d9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:54:08,392::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:54:08,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:54:08,393::task::1168::TaskManager.Task::(prepare) Task=`aeb8eaa3-fe5a-4a42-b948-fb7ae61642d9`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:54:08,393::task::579::TaskManager.Task::(_updateState) Task=`aeb8eaa3-fe5a-4a42-b948-fb7ae61642d9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:54:08,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:54:08,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:54:08,393::task::974::TaskManager.Task::(_decref) Task=`aeb8eaa3-fe5a-4a42-b948-fb7ae61642d9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:09,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:54:09,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:54:09,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:54:09,367::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:09,367::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:54:09,368::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:54:09,481::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:10,369::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:10,483::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:11,370::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:54:11,370::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:54:11,370::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:11,484::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 16:54:11,544::task::579::TaskManager.Task::(_updateState) Task=`538754cd-246b-4c3d-92db-7bd17bf43141`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:54:11,544::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:54:11,545::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:54:11,545::task::1168::TaskManager.Task::(prepare) Task=`538754cd-246b-4c3d-92db-7bd17bf43141`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:54:11,545::task::579::TaskManager.Task::(_updateState) Task=`538754cd-246b-4c3d-92db-7bd17bf43141`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:54:11,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:54:11,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:54:11,545::task::974::TaskManager.Task::(_decref) Task=`538754cd-246b-4c3d-92db-7bd17bf43141`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:54:11,546::task::579::TaskManager.Task::(_updateState) Task=`d281d396-8d3e-4aee-9046-481f2ac875a5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:54:11,546::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:54:11,546::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:54:11,546::task::1168::TaskManager.Task::(prepare) Task=`d281d396-8d3e-4aee-9046-481f2ac875a5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:54:11,546::task::579::TaskManager.Task::(_updateState) Task=`d281d396-8d3e-4aee-9046-481f2ac875a5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:54:11,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:54:11,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:54:11,547::task::974::TaskManager.Task::(_decref) Task=`d281d396-8d3e-4aee-9046-481f2ac875a5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:54:11,547::task::579::TaskManager.Task::(_updateState) Task=`687a5047-e4a1-4b19-b064-e0e39a639717`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:54:11,547::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:54:11,547::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:54:11,547::task::1168::TaskManager.Task::(prepare) Task=`687a5047-e4a1-4b19-b064-e0e39a639717`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:54:11,547::task::579::TaskManager.Task::(_updateState) Task=`687a5047-e4a1-4b19-b064-e0e39a639717`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:54:11,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:54:11,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:54:11,548::task::974::TaskManager.Task::(_decref) Task=`687a5047-e4a1-4b19-b064-e0e39a639717`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:54:11,704::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:54:11,721::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289386 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:54:11,750::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:54:11,766::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218413 s, 18.8 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:54:11,776::task::579::TaskManager.Task::(_updateState) Task=`74b02332-4eaa-449e-98ee-94460c662cb5`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:54:11,777::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:54:11,777::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:54:11,777::task::1168::TaskManager.Task::(prepare) Task=`74b02332-4eaa-449e-98ee-94460c662cb5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:54:11,778::task::579::TaskManager.Task::(_updateState) Task=`74b02332-4eaa-449e-98ee-94460c662cb5`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:54:11,778::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:54:11,778::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:54:11,779::task::974::TaskManager.Task::(_decref) Task=`74b02332-4eaa-449e-98ee-94460c662cb5`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:54:11,803::task::579::TaskManager.Task::(_updateState) Task=`f4287c8e-ddb0-42dc-b6ab-ef1cb6abb3ca`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:54:11,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:54:11,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:54:11,804::task::1168::TaskManager.Task::(prepare) Task=`f4287c8e-ddb0-42dc-b6ab-ef1cb6abb3ca`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:54:11,804::task::579::TaskManager.Task::(_updateState) Task=`f4287c8e-ddb0-42dc-b6ab-ef1cb6abb3ca`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:54:11,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:54:11,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:54:11,805::task::974::TaskManager.Task::(_decref) Task=`f4287c8e-ddb0-42dc-b6ab-ef1cb6abb3ca`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:12,372::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:54:12,372::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:54:12,372::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:54:12,663::task::579::TaskManager.Task::(_updateState) Task=`a63f3578-d3fb-4d6a-9f57-0a1a1b0b9e03`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:54:12,663::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:54:12,664::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:54:12,664::task::1168::TaskManager.Task::(prepare) Task=`a63f3578-d3fb-4d6a-9f57-0a1a1b0b9e03`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:54:12,664::task::579::TaskManager.Task::(_updateState) Task=`a63f3578-d3fb-4d6a-9f57-0a1a1b0b9e03`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:54:12,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:54:12,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:54:12,665::task::974::TaskManager.Task::(_decref) Task=`a63f3578-d3fb-4d6a-9f57-0a1a1b0b9e03`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:54:12,665::task::579::TaskManager.Task::(_updateState) Task=`32b4e9fc-0b08-4e28-8735-285595a795dc`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:54:12,665::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:54:12,665::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:54:12,665::task::1168::TaskManager.Task::(prepare) Task=`32b4e9fc-0b08-4e28-8735-285595a795dc`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:54:12,666::task::579::TaskManager.Task::(_updateState) Task=`32b4e9fc-0b08-4e28-8735-285595a795dc`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:54:12,666::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:54:12,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:54:12,666::task::974::TaskManager.Task::(_decref) Task=`32b4e9fc-0b08-4e28-8735-285595a795dc`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:54:13,113::task::579::TaskManager.Task::(_updateState) Task=`8c29f4fb-4b4d-4a00-9a14-80b549c9f792`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:54:13,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:54:13,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:54:13,114::task::1168::TaskManager.Task::(prepare) Task=`8c29f4fb-4b4d-4a00-9a14-80b549c9f792`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:54:13,114::task::579::TaskManager.Task::(_updateState) Task=`8c29f4fb-4b4d-4a00-9a14-80b549c9f792`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:54:13,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:54:13,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:54:13,114::task::974::TaskManager.Task::(_decref) Task=`8c29f4fb-4b4d-4a00-9a14-80b549c9f792`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:13,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:54:13,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:54:13,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:54:13,374::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:13,486::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:54:14,094::task::579::TaskManager.Task::(_updateState) Task=`584d7aa1-02c5-49bd-81f3-2edd8d85d1b6`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:54:14,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:54:14,095::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:54:14,095::task::1168::TaskManager.Task::(prepare) Task=`584d7aa1-02c5-49bd-81f3-2edd8d85d1b6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:54:14,095::task::579::TaskManager.Task::(_updateState) Task=`584d7aa1-02c5-49bd-81f3-2edd8d85d1b6`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:54:14,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:54:14,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:54:14,095::task::974::TaskManager.Task::(_decref) Task=`584d7aa1-02c5-49bd-81f3-2edd8d85d1b6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:14,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:15,377::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:54:15,377::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:15,487::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:15,488::task::579::TaskManager.Task::(_updateState) Task=`75733b4c-2374-4336-add2-cad3cd117c0d`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:54:15,488::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:54:15,488::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:54:15,488::task::1168::TaskManager.Task::(prepare) Task=`75733b4c-2374-4336-add2-cad3cd117c0d`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:54:15,488::task::579::TaskManager.Task::(_updateState) Task=`75733b4c-2374-4336-add2-cad3cd117c0d`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:54:15,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:54:15,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:54:15,489::task::974::TaskManager.Task::(_decref) Task=`75733b4c-2374-4336-add2-cad3cd117c0d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:54:15,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:54:15,491::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:54:15,492::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:15,494::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:15,495::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:16,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:17,379::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:54:17,396::task::579::TaskManager.Task::(_updateState) Task=`1cda4b72-e3e2-4c3a-9bda-62cba72974a2`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:54:17,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:54:17,397::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:54:17,397::task::1168::TaskManager.Task::(prepare) Task=`1cda4b72-e3e2-4c3a-9bda-62cba72974a2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:54:17,397::task::579::TaskManager.Task::(_updateState) Task=`1cda4b72-e3e2-4c3a-9bda-62cba72974a2`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:54:17,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:54:17,397::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:54:17,398::task::974::TaskManager.Task::(_decref) Task=`1cda4b72-e3e2-4c3a-9bda-62cba72974a2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:54:17,496::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 16:54:18,102::task::579::TaskManager.Task::(_updateState) Task=`c15c705f-2220-404b-a979-e50ab8619e9b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:54:18,103::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:54:18,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:54:18,103::task::1168::TaskManager.Task::(prepare) Task=`c15c705f-2220-404b-a979-e50ab8619e9b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:54:18,103::task::579::TaskManager.Task::(_updateState) Task=`c15c705f-2220-404b-a979-e50ab8619e9b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:54:18,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:54:18,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:54:18,104::task::974::TaskManager.Task::(_decref) Task=`c15c705f-2220-404b-a979-e50ab8619e9b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:18,380::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:19,381::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:19,498::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:20,382::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:20,499::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:54:20,796::task::579::TaskManager.Task::(_updateState) Task=`dc727003-d564-4187-90a3-4f16b8807506`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:54:20,797::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:54:20,797::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:54:20,797::task::1168::TaskManager.Task::(prepare) Task=`dc727003-d564-4187-90a3-4f16b8807506`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:54:20,797::task::579::TaskManager.Task::(_updateState) Task=`dc727003-d564-4187-90a3-4f16b8807506`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:54:20,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:54:20,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:54:20,798::task::974::TaskManager.Task::(_decref) Task=`dc727003-d564-4187-90a3-4f16b8807506`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:21,382::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:54:21,383::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:21,501::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:54:21,730::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:54:21,746::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251068 s, 1.5 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:54:21,771::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:54:21,786::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000204665 s, 20.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:54:22,384::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287253::DEBUG::2014-01-16 16:54:23,254::task::579::TaskManager.Task::(_updateState) Task=`3f7fdd00-46bb-4027-a9a0-c6e6989405c7`::moving from state init -> state preparing >Thread-287253::INFO::2014-01-16 16:54:23,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287253::INFO::2014-01-16 16:54:23,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251068', 'lastCheck': '1.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000204665', 'lastCheck': '1.5', 'valid': True}} >Thread-287253::DEBUG::2014-01-16 16:54:23,255::task::1168::TaskManager.Task::(prepare) Task=`3f7fdd00-46bb-4027-a9a0-c6e6989405c7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251068', 'lastCheck': '1.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000204665', 'lastCheck': '1.5', 'valid': True}} >Thread-287253::DEBUG::2014-01-16 16:54:23,255::task::579::TaskManager.Task::(_updateState) Task=`3f7fdd00-46bb-4027-a9a0-c6e6989405c7`::moving from state preparing -> state finished >Thread-287253::DEBUG::2014-01-16 16:54:23,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287253::DEBUG::2014-01-16 16:54:23,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287253::DEBUG::2014-01-16 16:54:23,256::task::974::TaskManager.Task::(_decref) Task=`3f7fdd00-46bb-4027-a9a0-c6e6989405c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:23,384::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:23,502::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:24,385::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:25,386::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:25,503::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:25,504::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:54:26,012::task::579::TaskManager.Task::(_updateState) Task=`9b98503d-5538-4655-aed6-a36020aab0bf`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:54:26,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:54:26,012::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:54:26,013::task::1168::TaskManager.Task::(prepare) Task=`9b98503d-5538-4655-aed6-a36020aab0bf`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:54:26,013::task::579::TaskManager.Task::(_updateState) Task=`9b98503d-5538-4655-aed6-a36020aab0bf`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:54:26,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:54:26,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:54:26,013::task::974::TaskManager.Task::(_decref) Task=`9b98503d-5538-4655-aed6-a36020aab0bf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:26,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:54:26,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:54:26,388::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:27,390::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:54:27,390::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:27,506::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:28,391::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:54:28,391::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:54:28,392::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:54:28,673::task::579::TaskManager.Task::(_updateState) Task=`20074bf6-20e0-4517-a5b3-1443435d77f1`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:54:28,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:54:28,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:54:28,674::task::1168::TaskManager.Task::(prepare) Task=`20074bf6-20e0-4517-a5b3-1443435d77f1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:54:28,674::task::579::TaskManager.Task::(_updateState) Task=`20074bf6-20e0-4517-a5b3-1443435d77f1`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:54:28,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:54:28,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:54:28,675::task::974::TaskManager.Task::(_decref) Task=`20074bf6-20e0-4517-a5b3-1443435d77f1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:29,393::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:54:29,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:29,507::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:30,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:54:30,394::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:30,510::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:54:30,510::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:54:30,511::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:31,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 16:54:31,433::task::579::TaskManager.Task::(_updateState) Task=`7925d8b8-5fd4-4e8f-8074-bf095ac971a7`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:54:31,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:54:31,433::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:54:31,434::task::1168::TaskManager.Task::(prepare) Task=`7925d8b8-5fd4-4e8f-8074-bf095ac971a7`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:54:31,434::task::579::TaskManager.Task::(_updateState) Task=`7925d8b8-5fd4-4e8f-8074-bf095ac971a7`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:54:31,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:54:31,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:54:31,434::task::974::TaskManager.Task::(_decref) Task=`7925d8b8-5fd4-4e8f-8074-bf095ac971a7`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:54:31,435::task::579::TaskManager.Task::(_updateState) Task=`ed6c103d-327e-4c3d-96aa-6e3846b34e6d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:54:31,435::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:54:31,435::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:54:31,435::task::1168::TaskManager.Task::(prepare) Task=`ed6c103d-327e-4c3d-96aa-6e3846b34e6d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:54:31,435::task::579::TaskManager.Task::(_updateState) Task=`ed6c103d-327e-4c3d-96aa-6e3846b34e6d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:54:31,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:54:31,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:54:31,436::task::974::TaskManager.Task::(_decref) Task=`ed6c103d-327e-4c3d-96aa-6e3846b34e6d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:54:31,512::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:54:31,754::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:54:31,771::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000322303 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:54:31,792::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:54:31,807::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000271112 s, 15.1 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:54:32,364::task::579::TaskManager.Task::(_updateState) Task=`d6dac91b-6a42-4247-9970-6cf9574b479a`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:54:32,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:54:32,365::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:54:32,365::task::1168::TaskManager.Task::(prepare) Task=`d6dac91b-6a42-4247-9970-6cf9574b479a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:54:32,365::task::579::TaskManager.Task::(_updateState) Task=`d6dac91b-6a42-4247-9970-6cf9574b479a`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:54:32,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:54:32,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:54:32,366::task::974::TaskManager.Task::(_decref) Task=`d6dac91b-6a42-4247-9970-6cf9574b479a`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:54:32,380::task::579::TaskManager.Task::(_updateState) Task=`53c8c59a-662a-42b2-ba2d-8f627273e17b`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:54:32,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:54:32,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:54:32,381::task::1168::TaskManager.Task::(prepare) Task=`53c8c59a-662a-42b2-ba2d-8f627273e17b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:54:32,381::task::579::TaskManager.Task::(_updateState) Task=`53c8c59a-662a-42b2-ba2d-8f627273e17b`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:54:32,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:54:32,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:54:32,381::task::974::TaskManager.Task::(_decref) Task=`53c8c59a-662a-42b2-ba2d-8f627273e17b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:32,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:54:32,397::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:33,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:54:33,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:33,514::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:34,399::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:54:34,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:54:34,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:54:34,400::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:35,401::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:54:35,402::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:54:35,402::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:35,515::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:35,517::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:36,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:54:36,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:37,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:54:37,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:54:37,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:54:37,405::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:54:37,452::task::579::TaskManager.Task::(_updateState) Task=`67e257b6-f3ee-418e-9d0f-d4ba6ed4008d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:54:37,452::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:54:37,452::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:54:37,452::task::1168::TaskManager.Task::(prepare) Task=`67e257b6-f3ee-418e-9d0f-d4ba6ed4008d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:54:37,453::task::579::TaskManager.Task::(_updateState) Task=`67e257b6-f3ee-418e-9d0f-d4ba6ed4008d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:54:37,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:54:37,453::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:54:37,453::task::974::TaskManager.Task::(_decref) Task=`67e257b6-f3ee-418e-9d0f-d4ba6ed4008d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:54:37,518::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:38,407::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287259::DEBUG::2014-01-16 16:54:38,965::task::579::TaskManager.Task::(_updateState) Task=`0e14713c-6ee0-4bd1-92d8-1c06ed93f7a7`::moving from state init -> state preparing >Thread-287259::INFO::2014-01-16 16:54:38,966::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287259::INFO::2014-01-16 16:54:38,966::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322303', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271112', 'lastCheck': '7.2', 'valid': True}} >Thread-287259::DEBUG::2014-01-16 16:54:38,966::task::1168::TaskManager.Task::(prepare) Task=`0e14713c-6ee0-4bd1-92d8-1c06ed93f7a7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322303', 'lastCheck': '7.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271112', 'lastCheck': '7.2', 'valid': True}} >Thread-287259::DEBUG::2014-01-16 16:54:38,966::task::579::TaskManager.Task::(_updateState) Task=`0e14713c-6ee0-4bd1-92d8-1c06ed93f7a7`::moving from state preparing -> state finished >Thread-287259::DEBUG::2014-01-16 16:54:38,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287259::DEBUG::2014-01-16 16:54:38,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287259::DEBUG::2014-01-16 16:54:38,967::task::974::TaskManager.Task::(_decref) Task=`0e14713c-6ee0-4bd1-92d8-1c06ed93f7a7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:39,408::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:54:39,408::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:54:39,409::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:54:39,409::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:39,409::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:54:39,409::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:54:39,520::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:54:39,855::task::579::TaskManager.Task::(_updateState) Task=`005cc6e5-585c-4059-916b-d5cdec542b76`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:54:39,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:54:39,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:54:39,855::task::1168::TaskManager.Task::(prepare) Task=`005cc6e5-585c-4059-916b-d5cdec542b76`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:54:39,856::task::579::TaskManager.Task::(_updateState) Task=`005cc6e5-585c-4059-916b-d5cdec542b76`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:54:39,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:54:39,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:54:39,856::task::974::TaskManager.Task::(_decref) Task=`005cc6e5-585c-4059-916b-d5cdec542b76`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:40,410::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:40,521::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:54:40,833::task::579::TaskManager.Task::(_updateState) Task=`c9efc80c-a1cf-494a-bcba-8e3221f15627`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:54:40,834::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:54:40,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:54:40,834::task::1168::TaskManager.Task::(prepare) Task=`c9efc80c-a1cf-494a-bcba-8e3221f15627`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:54:40,834::task::579::TaskManager.Task::(_updateState) Task=`c9efc80c-a1cf-494a-bcba-8e3221f15627`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:54:40,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:54:40,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:54:40,835::task::974::TaskManager.Task::(_decref) Task=`c9efc80c-a1cf-494a-bcba-8e3221f15627`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:54:40,857::task::579::TaskManager.Task::(_updateState) Task=`966405d4-2101-4a9a-8abf-415e8a2f705c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:54:40,858::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:54:40,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:54:40,858::task::1168::TaskManager.Task::(prepare) Task=`966405d4-2101-4a9a-8abf-415e8a2f705c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:54:40,858::task::579::TaskManager.Task::(_updateState) Task=`966405d4-2101-4a9a-8abf-415e8a2f705c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:54:40,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:54:40,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:54:40,859::task::974::TaskManager.Task::(_decref) Task=`966405d4-2101-4a9a-8abf-415e8a2f705c`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:54:40,861::task::579::TaskManager.Task::(_updateState) Task=`8d21c7e5-edbf-49ae-9b37-a3d5bb01d44b`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:54:40,862::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:54:40,862::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:54:40,862::task::1168::TaskManager.Task::(prepare) Task=`8d21c7e5-edbf-49ae-9b37-a3d5bb01d44b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:54:40,862::task::579::TaskManager.Task::(_updateState) Task=`8d21c7e5-edbf-49ae-9b37-a3d5bb01d44b`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:54:40,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:54:40,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:54:40,863::task::974::TaskManager.Task::(_decref) Task=`8d21c7e5-edbf-49ae-9b37-a3d5bb01d44b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:41,412::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:54:41,413::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:54:41,413::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:41,523::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:54:41,559::task::579::TaskManager.Task::(_updateState) Task=`2fe1b556-5e2c-4a68-8472-f8906470a6b7`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:54:41,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:54:41,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:54:41,560::task::1168::TaskManager.Task::(prepare) Task=`2fe1b556-5e2c-4a68-8472-f8906470a6b7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:54:41,560::task::579::TaskManager.Task::(_updateState) Task=`2fe1b556-5e2c-4a68-8472-f8906470a6b7`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:54:41,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:54:41,561::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:54:41,561::task::974::TaskManager.Task::(_decref) Task=`2fe1b556-5e2c-4a68-8472-f8906470a6b7`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:54:41,778::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:54:41,795::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000305749 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:54:41,813::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:54:41,828::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000310532 s, 13.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:54:41,857::task::579::TaskManager.Task::(_updateState) Task=`a97e0548-eebb-4062-9277-f79dea5a9572`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:54:41,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:54:41,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:54:41,858::task::1168::TaskManager.Task::(prepare) Task=`a97e0548-eebb-4062-9277-f79dea5a9572`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:54:41,858::task::579::TaskManager.Task::(_updateState) Task=`a97e0548-eebb-4062-9277-f79dea5a9572`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:54:41,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:54:41,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:54:41,859::task::974::TaskManager.Task::(_decref) Task=`a97e0548-eebb-4062-9277-f79dea5a9572`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:42,414::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:54:42,415::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:54:42,415::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:43,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:54:43,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:54:43,420::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:54:43,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:43,524::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:44,422::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:45,423::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:54:45,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:45,526::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:45,528::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:54:45,528::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:54:45,529::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:46,425::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:54:46,651::task::579::TaskManager.Task::(_updateState) Task=`5e143335-baa3-4114-b6d8-07a4dfc9e6a7`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:54:46,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:54:46,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:54:46,651::task::1168::TaskManager.Task::(prepare) Task=`5e143335-baa3-4114-b6d8-07a4dfc9e6a7`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:54:46,652::task::579::TaskManager.Task::(_updateState) Task=`5e143335-baa3-4114-b6d8-07a4dfc9e6a7`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:54:46,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:54:46,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:54:46,652::task::974::TaskManager.Task::(_decref) Task=`5e143335-baa3-4114-b6d8-07a4dfc9e6a7`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:54:46,652::task::579::TaskManager.Task::(_updateState) Task=`2aa367cd-00e8-4b00-b064-979c45d8cdcc`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:54:46,652::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:54:46,653::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:54:46,653::task::1168::TaskManager.Task::(prepare) Task=`2aa367cd-00e8-4b00-b064-979c45d8cdcc`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:54:46,653::task::579::TaskManager.Task::(_updateState) Task=`2aa367cd-00e8-4b00-b064-979c45d8cdcc`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:54:46,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:54:46,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:54:46,653::task::974::TaskManager.Task::(_decref) Task=`2aa367cd-00e8-4b00-b064-979c45d8cdcc`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:54:46,654::task::579::TaskManager.Task::(_updateState) Task=`dd820083-3907-428b-9f8d-83192c453572`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:54:46,654::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:54:46,654::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:54:46,654::task::1168::TaskManager.Task::(prepare) Task=`dd820083-3907-428b-9f8d-83192c453572`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:54:46,654::task::579::TaskManager.Task::(_updateState) Task=`dd820083-3907-428b-9f8d-83192c453572`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:54:46,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:54:46,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:54:46,655::task::974::TaskManager.Task::(_decref) Task=`dd820083-3907-428b-9f8d-83192c453572`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:47,426::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:47,530::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:48,428::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:49,429::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:54:49,478::task::579::TaskManager.Task::(_updateState) Task=`d08ef9ef-88f1-4139-8727-c65f9f49f805`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:54:49,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:54:49,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:54:49,479::task::1168::TaskManager.Task::(prepare) Task=`d08ef9ef-88f1-4139-8727-c65f9f49f805`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:54:49,479::task::579::TaskManager.Task::(_updateState) Task=`d08ef9ef-88f1-4139-8727-c65f9f49f805`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:54:49,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:54:49,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:54:49,479::task::974::TaskManager.Task::(_decref) Task=`d08ef9ef-88f1-4139-8727-c65f9f49f805`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:54:49,532::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:50,430::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:50,533::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:51,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:54:51,432::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:51,535::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:54:51,802::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:54:51,819::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000298721 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:54:51,834::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:54:51,848::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000249099 s, 16.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:54:52,434::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:53,435::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:53,536::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:54:54,325::task::579::TaskManager.Task::(_updateState) Task=`02eeaa0f-911a-427f-8247-df056cc65288`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:54:54,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:54:54,326::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:54:54,326::task::1168::TaskManager.Task::(prepare) Task=`02eeaa0f-911a-427f-8247-df056cc65288`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:54:54,326::task::579::TaskManager.Task::(_updateState) Task=`02eeaa0f-911a-427f-8247-df056cc65288`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:54:54,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:54:54,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:54:54,327::task::974::TaskManager.Task::(_decref) Task=`02eeaa0f-911a-427f-8247-df056cc65288`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:54,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287265::DEBUG::2014-01-16 16:54:54,714::task::579::TaskManager.Task::(_updateState) Task=`5f5908e8-0fac-4338-b0db-a638c442d924`::moving from state init -> state preparing >Thread-287265::INFO::2014-01-16 16:54:54,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287265::INFO::2014-01-16 16:54:54,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298721', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249099', 'lastCheck': '2.9', 'valid': True}} >Thread-287265::DEBUG::2014-01-16 16:54:54,715::task::1168::TaskManager.Task::(prepare) Task=`5f5908e8-0fac-4338-b0db-a638c442d924`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298721', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249099', 'lastCheck': '2.9', 'valid': True}} >Thread-287265::DEBUG::2014-01-16 16:54:54,715::task::579::TaskManager.Task::(_updateState) Task=`5f5908e8-0fac-4338-b0db-a638c442d924`::moving from state preparing -> state finished >Thread-287265::DEBUG::2014-01-16 16:54:54,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287265::DEBUG::2014-01-16 16:54:54,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287265::DEBUG::2014-01-16 16:54:54,715::task::974::TaskManager.Task::(_decref) Task=`5f5908e8-0fac-4338-b0db-a638c442d924`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:54:55,437::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:55,537::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:54:55,539::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:56,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:54:56,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:54:56,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:57,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:54:57,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:57,540::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:54:58,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:54:58,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:54:58,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:54:59,443::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:54:59,443::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:54:59,541::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:00,445::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:55:00,445::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:00,543::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:55:00,544::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:55:00,545::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:55:00,840::task::579::TaskManager.Task::(_updateState) Task=`50be3825-df26-436a-a22c-d1123dcae425`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:55:00,841::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:55:00,841::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:55:00,841::task::1168::TaskManager.Task::(prepare) Task=`50be3825-df26-436a-a22c-d1123dcae425`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:55:00,841::task::579::TaskManager.Task::(_updateState) Task=`50be3825-df26-436a-a22c-d1123dcae425`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:55:00,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:55:00,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:55:00,842::task::974::TaskManager.Task::(_decref) Task=`50be3825-df26-436a-a22c-d1123dcae425`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:01,446::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:01,546::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:55:01,828::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:55:01,849::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000343151 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:01,854::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:01,869::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000239575 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:55:02,448::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:55:02,448::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:03,449::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:55:03,450::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:03,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:04,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:55:04,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:55:04,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:55:04,452::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:05,453::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:55:05,453::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:55:05,454::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:05,549::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:05,551::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:06,455::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:55:06,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:55:06,751::task::579::TaskManager.Task::(_updateState) Task=`ae28140b-9e91-4ede-86f6-1792c6cdf793`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:55:06,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:55:06,752::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:55:06,752::task::1168::TaskManager.Task::(prepare) Task=`ae28140b-9e91-4ede-86f6-1792c6cdf793`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:55:06,752::task::579::TaskManager.Task::(_updateState) Task=`ae28140b-9e91-4ede-86f6-1792c6cdf793`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:55:06,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:55:06,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:55:06,753::task::974::TaskManager.Task::(_decref) Task=`ae28140b-9e91-4ede-86f6-1792c6cdf793`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:55:06,766::task::579::TaskManager.Task::(_updateState) Task=`87aa4f81-8d39-4515-aee4-3365a4805e51`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:55:06,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:55:06,767::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:55:06,767::task::1168::TaskManager.Task::(prepare) Task=`87aa4f81-8d39-4515-aee4-3365a4805e51`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:55:06,767::task::579::TaskManager.Task::(_updateState) Task=`87aa4f81-8d39-4515-aee4-3365a4805e51`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:55:06,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:55:06,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:55:06,768::task::974::TaskManager.Task::(_decref) Task=`87aa4f81-8d39-4515-aee4-3365a4805e51`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:55:07,026::task::579::TaskManager.Task::(_updateState) Task=`3f81cb09-0401-494d-884d-80a48ece89d2`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:55:07,027::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:55:07,027::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:55:07,027::task::1168::TaskManager.Task::(prepare) Task=`3f81cb09-0401-494d-884d-80a48ece89d2`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:55:07,027::task::579::TaskManager.Task::(_updateState) Task=`3f81cb09-0401-494d-884d-80a48ece89d2`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:55:07,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:55:07,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:55:07,028::task::974::TaskManager.Task::(_decref) Task=`3f81cb09-0401-494d-884d-80a48ece89d2`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:55:07,028::task::579::TaskManager.Task::(_updateState) Task=`b5a4304f-5a9a-4f5a-bab1-38e382a7c275`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:55:07,028::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:55:07,028::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:55:07,029::task::1168::TaskManager.Task::(prepare) Task=`b5a4304f-5a9a-4f5a-bab1-38e382a7c275`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:55:07,029::task::579::TaskManager.Task::(_updateState) Task=`b5a4304f-5a9a-4f5a-bab1-38e382a7c275`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:55:07,029::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:55:07,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:55:07,029::task::974::TaskManager.Task::(_decref) Task=`b5a4304f-5a9a-4f5a-bab1-38e382a7c275`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:07,455::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:55:07,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:55:07,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:55:07,456::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:07,552::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:55:07,945::task::579::TaskManager.Task::(_updateState) Task=`cc46c008-a0b6-4809-b388-7cabc15dde1c`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:55:07,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:55:07,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:55:07,946::task::1168::TaskManager.Task::(prepare) Task=`cc46c008-a0b6-4809-b388-7cabc15dde1c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:55:07,946::task::579::TaskManager.Task::(_updateState) Task=`cc46c008-a0b6-4809-b388-7cabc15dde1c`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:55:07,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:55:07,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:55:07,947::task::974::TaskManager.Task::(_decref) Task=`cc46c008-a0b6-4809-b388-7cabc15dde1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:08,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:55:08,481::task::579::TaskManager.Task::(_updateState) Task=`f6a1cc47-2af8-452f-851f-fcf88df58c24`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:55:08,481::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:55:08,482::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:55:08,482::task::1168::TaskManager.Task::(prepare) Task=`f6a1cc47-2af8-452f-851f-fcf88df58c24`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:55:08,483::task::579::TaskManager.Task::(_updateState) Task=`f6a1cc47-2af8-452f-851f-fcf88df58c24`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:55:08,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:55:08,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:55:08,483::task::974::TaskManager.Task::(_decref) Task=`f6a1cc47-2af8-452f-851f-fcf88df58c24`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:55:08,484::task::579::TaskManager.Task::(_updateState) Task=`8a55bc63-62f9-4376-8fda-0cdcf66da36b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:55:08,484::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:55:08,484::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:55:08,485::task::1168::TaskManager.Task::(prepare) Task=`8a55bc63-62f9-4376-8fda-0cdcf66da36b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:55:08,485::task::579::TaskManager.Task::(_updateState) Task=`8a55bc63-62f9-4376-8fda-0cdcf66da36b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:55:08,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:55:08,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:55:08,486::task::974::TaskManager.Task::(_decref) Task=`8a55bc63-62f9-4376-8fda-0cdcf66da36b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:09,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:55:09,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:55:09,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:55:09,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:09,459::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:55:09,461::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:55:09,554::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287271::DEBUG::2014-01-16 16:55:10,442::task::579::TaskManager.Task::(_updateState) Task=`e814821d-b859-42aa-95a5-782fea94ad86`::moving from state init -> state preparing >Thread-287271::INFO::2014-01-16 16:55:10,443::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287271::INFO::2014-01-16 16:55:10,443::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000343151', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239575', 'lastCheck': '8.6', 'valid': True}} >Thread-287271::DEBUG::2014-01-16 16:55:10,443::task::1168::TaskManager.Task::(prepare) Task=`e814821d-b859-42aa-95a5-782fea94ad86`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000343151', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239575', 'lastCheck': '8.6', 'valid': True}} >Thread-287271::DEBUG::2014-01-16 16:55:10,443::task::579::TaskManager.Task::(_updateState) Task=`e814821d-b859-42aa-95a5-782fea94ad86`::moving from state preparing -> state finished >Thread-287271::DEBUG::2014-01-16 16:55:10,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287271::DEBUG::2014-01-16 16:55:10,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287271::DEBUG::2014-01-16 16:55:10,444::task::974::TaskManager.Task::(_decref) Task=`e814821d-b859-42aa-95a5-782fea94ad86`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:10,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:10,555::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:11,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:55:11,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:55:11,464::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:11,556::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:55:11,859::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:11,874::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:55:11,876::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 16:55:11,877::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 16:55:11,879::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:55:11,883::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00033683 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:11,891::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:11,904::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000218681 s, 9.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:11,905::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000218681 s, 9.4 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 16:55:11,905::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 16:55:11,905::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 16:55:11,905::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 16:55:11,906::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:55:11,906::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:55:11,906::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:55:11,907::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:55:11,907::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 16:55:11,907::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-17177::DEBUG::2014-01-16 16:55:11,925::task::579::TaskManager.Task::(_updateState) Task=`a3349a4d-3bb4-407d-b8f9-2253c9e12b36`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:55:11,925::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-26403::DEBUG::2014-01-16 16:55:11,980::task::579::TaskManager.Task::(_updateState) Task=`6c5ac956-b5d9-4f3e-95b0-ce6a34df4a57`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:55:11,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-22::DEBUG::2014-01-16 16:55:12,132::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:12,133::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 16:55:12,134::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 16:55:12,135::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 16:55:12,135::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 16:55:12,135::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-17177::INFO::2014-01-16 16:55:12,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-26403::INFO::2014-01-16 16:55:12,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-17177::DEBUG::2014-01-16 16:55:12,140::task::1168::TaskManager.Task::(prepare) Task=`a3349a4d-3bb4-407d-b8f9-2253c9e12b36`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-26403::DEBUG::2014-01-16 16:55:12,141::task::1168::TaskManager.Task::(prepare) Task=`6c5ac956-b5d9-4f3e-95b0-ce6a34df4a57`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-17177::DEBUG::2014-01-16 16:55:12,143::task::579::TaskManager.Task::(_updateState) Task=`a3349a4d-3bb4-407d-b8f9-2253c9e12b36`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:55:12,145::task::579::TaskManager.Task::(_updateState) Task=`6c5ac956-b5d9-4f3e-95b0-ce6a34df4a57`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:55:12,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:55:12,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-01-16 16:55:12,148::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-17177::DEBUG::2014-01-16 16:55:12,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:55:12,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:55:12,168::task::974::TaskManager.Task::(_decref) Task=`a3349a4d-3bb4-407d-b8f9-2253c9e12b36`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:55:12,169::task::974::TaskManager.Task::(_decref) Task=`6c5ac956-b5d9-4f3e-95b0-ce6a34df4a57`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:55:12,185::task::579::TaskManager.Task::(_updateState) Task=`7926015b-60b1-4c74-9f61-a44c6b0111fb`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:55:12,185::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:55:12,186::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:55:12,186::task::1168::TaskManager.Task::(prepare) Task=`7926015b-60b1-4c74-9f61-a44c6b0111fb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:55:12,186::task::579::TaskManager.Task::(_updateState) Task=`7926015b-60b1-4c74-9f61-a44c6b0111fb`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:55:12,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:55:12,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:55:12,187::task::974::TaskManager.Task::(_decref) Task=`7926015b-60b1-4c74-9f61-a44c6b0111fb`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:55:12,187::task::579::TaskManager.Task::(_updateState) Task=`f067a856-62c2-4582-bac7-724858550d83`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:55:12,187::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:55:12,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:55:12,188::task::1168::TaskManager.Task::(prepare) Task=`f067a856-62c2-4582-bac7-724858550d83`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:55:12,188::task::579::TaskManager.Task::(_updateState) Task=`f067a856-62c2-4582-bac7-724858550d83`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:55:12,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:55:12,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:55:12,188::task::974::TaskManager.Task::(_decref) Task=`f067a856-62c2-4582-bac7-724858550d83`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:55:12,189::task::579::TaskManager.Task::(_updateState) Task=`420a1673-8a73-4aba-806b-64c9eba16430`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:55:12,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:55:12,189::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:55:12,189::task::1168::TaskManager.Task::(prepare) Task=`420a1673-8a73-4aba-806b-64c9eba16430`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:55:12,190::task::579::TaskManager.Task::(_updateState) Task=`420a1673-8a73-4aba-806b-64c9eba16430`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:55:12,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:55:12,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:55:12,190::task::974::TaskManager.Task::(_decref) Task=`420a1673-8a73-4aba-806b-64c9eba16430`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:55:12,312::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:12,315::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:12,331::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000203651 s, 20.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:55:12,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:55:12,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:55:12,466::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 16:55:12,898::task::579::TaskManager.Task::(_updateState) Task=`d8d64532-5783-4b4e-9faf-b4c7f837db9c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:55:12,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:55:12,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:55:12,899::task::1168::TaskManager.Task::(prepare) Task=`d8d64532-5783-4b4e-9faf-b4c7f837db9c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:55:12,899::task::579::TaskManager.Task::(_updateState) Task=`d8d64532-5783-4b4e-9faf-b4c7f837db9c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:55:12,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:55:12,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:55:12,900::task::974::TaskManager.Task::(_decref) Task=`d8d64532-5783-4b4e-9faf-b4c7f837db9c`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:55:12,900::task::579::TaskManager.Task::(_updateState) Task=`94f24e9f-ae91-4b7b-b513-9c188c3c08c4`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:55:12,900::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:55:12,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:55:12,901::task::1168::TaskManager.Task::(prepare) Task=`94f24e9f-ae91-4b7b-b513-9c188c3c08c4`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:55:12,901::task::579::TaskManager.Task::(_updateState) Task=`94f24e9f-ae91-4b7b-b513-9c188c3c08c4`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:55:12,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:55:12,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:55:12,901::task::974::TaskManager.Task::(_decref) Task=`94f24e9f-ae91-4b7b-b513-9c188c3c08c4`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:55:13,288::task::579::TaskManager.Task::(_updateState) Task=`f82d8975-e6a8-4182-92da-6b1e4de80542`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:55:13,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:55:13,289::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:55:13,289::task::1168::TaskManager.Task::(prepare) Task=`f82d8975-e6a8-4182-92da-6b1e4de80542`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:55:13,289::task::579::TaskManager.Task::(_updateState) Task=`f82d8975-e6a8-4182-92da-6b1e4de80542`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:55:13,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:55:13,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:55:13,290::task::974::TaskManager.Task::(_decref) Task=`f82d8975-e6a8-4182-92da-6b1e4de80542`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:13,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:55:13,475::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:55:13,476::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:55:13,478::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:13,557::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:55:14,272::task::579::TaskManager.Task::(_updateState) Task=`315e0198-775f-42e7-a0df-557e5fa636b7`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:55:14,272::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:55:14,272::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:55:14,273::task::1168::TaskManager.Task::(prepare) Task=`315e0198-775f-42e7-a0df-557e5fa636b7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:55:14,273::task::579::TaskManager.Task::(_updateState) Task=`315e0198-775f-42e7-a0df-557e5fa636b7`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:55:14,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:55:14,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:55:14,273::task::974::TaskManager.Task::(_decref) Task=`315e0198-775f-42e7-a0df-557e5fa636b7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:14,479::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:15,480::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:55:15,481::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:15,559::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:15,559::task::579::TaskManager.Task::(_updateState) Task=`f8081cd2-6631-48f0-a387-eb08e6a644e8`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:55:15,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:55:15,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:55:15,560::task::1168::TaskManager.Task::(prepare) Task=`f8081cd2-6631-48f0-a387-eb08e6a644e8`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:55:15,560::task::579::TaskManager.Task::(_updateState) Task=`f8081cd2-6631-48f0-a387-eb08e6a644e8`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:55:15,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:55:15,561::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:55:15,561::task::974::TaskManager.Task::(_decref) Task=`f8081cd2-6631-48f0-a387-eb08e6a644e8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:55:15,562::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:55:15,563::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:55:15,564::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:15,566::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:15,567::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:16,483::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:17,484::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:17,568::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:55:17,587::task::579::TaskManager.Task::(_updateState) Task=`9471169c-b68b-4fbc-988a-601bc037a304`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:55:17,588::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:55:17,588::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:55:17,588::task::1168::TaskManager.Task::(prepare) Task=`9471169c-b68b-4fbc-988a-601bc037a304`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:55:17,588::task::579::TaskManager.Task::(_updateState) Task=`9471169c-b68b-4fbc-988a-601bc037a304`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:55:17,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:55:17,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:55:17,589::task::974::TaskManager.Task::(_decref) Task=`9471169c-b68b-4fbc-988a-601bc037a304`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:55:18,184::task::579::TaskManager.Task::(_updateState) Task=`a4c024a8-6fb7-40eb-9138-805a1bc2ac94`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:55:18,184::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:55:18,185::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:55:18,185::task::1168::TaskManager.Task::(prepare) Task=`a4c024a8-6fb7-40eb-9138-805a1bc2ac94`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:55:18,186::task::579::TaskManager.Task::(_updateState) Task=`a4c024a8-6fb7-40eb-9138-805a1bc2ac94`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:55:18,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:55:18,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:55:18,186::task::974::TaskManager.Task::(_decref) Task=`a4c024a8-6fb7-40eb-9138-805a1bc2ac94`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:18,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:19,486::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:19,569::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:20,488::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:20,571::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:55:20,971::task::579::TaskManager.Task::(_updateState) Task=`f4160233-0233-4f6d-a44f-f260efce2155`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:55:20,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:55:20,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:55:20,972::task::1168::TaskManager.Task::(prepare) Task=`f4160233-0233-4f6d-a44f-f260efce2155`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:55:20,972::task::579::TaskManager.Task::(_updateState) Task=`f4160233-0233-4f6d-a44f-f260efce2155`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:55:20,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:55:20,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:55:20,972::task::974::TaskManager.Task::(_decref) Task=`f4160233-0233-4f6d-a44f-f260efce2155`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:21,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:55:21,489::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:21,572::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:55:21,896::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:55:21,913::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300017 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:22,339::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:22,361::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000320021 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:55:22,491::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:23,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:23,574::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:24,493::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:25,494::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:25,575::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:25,576::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:55:26,076::task::579::TaskManager.Task::(_updateState) Task=`3122c828-c151-4e97-99aa-d662697944a0`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:55:26,076::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:55:26,077::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:55:26,077::task::1168::TaskManager.Task::(prepare) Task=`3122c828-c151-4e97-99aa-d662697944a0`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:55:26,078::task::579::TaskManager.Task::(_updateState) Task=`3122c828-c151-4e97-99aa-d662697944a0`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:55:26,078::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:55:26,078::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:55:26,078::task::974::TaskManager.Task::(_decref) Task=`3122c828-c151-4e97-99aa-d662697944a0`::ref 0 aborting False >Thread-287277::DEBUG::2014-01-16 16:55:26,201::task::579::TaskManager.Task::(_updateState) Task=`d9eae7f3-fedd-4e07-8ba8-86ec86406320`::moving from state init -> state preparing >Thread-287277::INFO::2014-01-16 16:55:26,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287277::INFO::2014-01-16 16:55:26,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300017', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320021', 'lastCheck': '3.8', 'valid': True}} >Thread-287277::DEBUG::2014-01-16 16:55:26,201::task::1168::TaskManager.Task::(prepare) Task=`d9eae7f3-fedd-4e07-8ba8-86ec86406320`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300017', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320021', 'lastCheck': '3.8', 'valid': True}} >Thread-287277::DEBUG::2014-01-16 16:55:26,202::task::579::TaskManager.Task::(_updateState) Task=`d9eae7f3-fedd-4e07-8ba8-86ec86406320`::moving from state preparing -> state finished >Thread-287277::DEBUG::2014-01-16 16:55:26,202::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287277::DEBUG::2014-01-16 16:55:26,202::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287277::DEBUG::2014-01-16 16:55:26,202::task::974::TaskManager.Task::(_decref) Task=`d9eae7f3-fedd-4e07-8ba8-86ec86406320`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:26,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:55:26,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:55:26,501::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:27,502::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:55:27,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:27,577::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:28,503::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:55:28,503::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:55:28,503::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:55:28,865::task::579::TaskManager.Task::(_updateState) Task=`58a205cb-4b9b-43b1-82ce-8ebb446282e8`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:55:28,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:55:28,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:55:28,866::task::1168::TaskManager.Task::(prepare) Task=`58a205cb-4b9b-43b1-82ce-8ebb446282e8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:55:28,866::task::579::TaskManager.Task::(_updateState) Task=`58a205cb-4b9b-43b1-82ce-8ebb446282e8`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:55:28,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:55:28,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:55:28,866::task::974::TaskManager.Task::(_decref) Task=`58a205cb-4b9b-43b1-82ce-8ebb446282e8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:29,504::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:55:29,505::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:29,579::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:30,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:55:30,506::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:30,581::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:55:30,582::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:55:30,589::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:31,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:31,590::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 16:55:31,821::task::579::TaskManager.Task::(_updateState) Task=`734e31c6-454e-4572-97de-44bb78efe6f4`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:55:31,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:55:31,822::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:55:31,822::task::1168::TaskManager.Task::(prepare) Task=`734e31c6-454e-4572-97de-44bb78efe6f4`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:55:31,822::task::579::TaskManager.Task::(_updateState) Task=`734e31c6-454e-4572-97de-44bb78efe6f4`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:55:31,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:55:31,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:55:31,823::task::974::TaskManager.Task::(_decref) Task=`734e31c6-454e-4572-97de-44bb78efe6f4`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:55:31,823::task::579::TaskManager.Task::(_updateState) Task=`342eb55d-fc6b-4738-a47d-b403a7b6e40c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:55:31,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:55:31,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:55:31,823::task::1168::TaskManager.Task::(prepare) Task=`342eb55d-fc6b-4738-a47d-b403a7b6e40c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:55:31,824::task::579::TaskManager.Task::(_updateState) Task=`342eb55d-fc6b-4738-a47d-b403a7b6e40c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:55:31,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:55:31,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:55:31,824::task::974::TaskManager.Task::(_decref) Task=`342eb55d-fc6b-4738-a47d-b403a7b6e40c`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:55:31,922::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:55:31,940::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297879 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:32,367::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:32,384::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000331354 s, 12.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:55:32,508::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:55:32,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:55:32,546::task::579::TaskManager.Task::(_updateState) Task=`80bf7256-40e3-464c-980c-d67807b347c2`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:55:32,547::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:55:32,547::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:55:32,547::task::1168::TaskManager.Task::(prepare) Task=`80bf7256-40e3-464c-980c-d67807b347c2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:55:32,548::task::579::TaskManager.Task::(_updateState) Task=`80bf7256-40e3-464c-980c-d67807b347c2`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:55:32,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:55:32,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:55:32,548::task::974::TaskManager.Task::(_decref) Task=`80bf7256-40e3-464c-980c-d67807b347c2`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:55:32,575::task::579::TaskManager.Task::(_updateState) Task=`8f4191f9-7e6b-40ae-a2d6-627f9eaa4540`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:55:32,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:55:32,576::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:55:32,576::task::1168::TaskManager.Task::(prepare) Task=`8f4191f9-7e6b-40ae-a2d6-627f9eaa4540`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:55:32,576::task::579::TaskManager.Task::(_updateState) Task=`8f4191f9-7e6b-40ae-a2d6-627f9eaa4540`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:55:32,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:55:32,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:55:32,577::task::974::TaskManager.Task::(_decref) Task=`8f4191f9-7e6b-40ae-a2d6-627f9eaa4540`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:33,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:55:33,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:33,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:34,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:55:34,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:55:34,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:55:34,514::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:35,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:55:35,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:55:35,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:35,593::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:35,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:36,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:55:36,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:37,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:55:37,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:55:37,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:55:37,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:37,595::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:55:37,637::task::579::TaskManager.Task::(_updateState) Task=`7f102346-d097-484c-95b9-261131a1a2c9`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:55:37,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:55:37,637::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:55:37,637::task::1168::TaskManager.Task::(prepare) Task=`7f102346-d097-484c-95b9-261131a1a2c9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:55:37,637::task::579::TaskManager.Task::(_updateState) Task=`7f102346-d097-484c-95b9-261131a1a2c9`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:55:37,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:55:37,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:55:37,638::task::974::TaskManager.Task::(_decref) Task=`7f102346-d097-484c-95b9-261131a1a2c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:38,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:39,522::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:55:39,522::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:55:39,522::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:55:39,522::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:39,523::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:55:39,525::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:55:39,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:55:40,023::task::579::TaskManager.Task::(_updateState) Task=`c0a15cf4-bb66-43f9-a29e-15e407207e87`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:55:40,023::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:55:40,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:55:40,024::task::1168::TaskManager.Task::(prepare) Task=`c0a15cf4-bb66-43f9-a29e-15e407207e87`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:55:40,024::task::579::TaskManager.Task::(_updateState) Task=`c0a15cf4-bb66-43f9-a29e-15e407207e87`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:55:40,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:55:40,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:55:40,024::task::974::TaskManager.Task::(_decref) Task=`c0a15cf4-bb66-43f9-a29e-15e407207e87`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:40,525::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:40,597::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:55:41,015::task::579::TaskManager.Task::(_updateState) Task=`331f1ad5-c1d5-4a2d-81cc-cb9841552139`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:55:41,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:55:41,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:55:41,016::task::1168::TaskManager.Task::(prepare) Task=`331f1ad5-c1d5-4a2d-81cc-cb9841552139`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:55:41,016::task::579::TaskManager.Task::(_updateState) Task=`331f1ad5-c1d5-4a2d-81cc-cb9841552139`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:55:41,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:55:41,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:55:41,016::task::974::TaskManager.Task::(_decref) Task=`331f1ad5-c1d5-4a2d-81cc-cb9841552139`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:55:41,038::task::579::TaskManager.Task::(_updateState) Task=`28743099-9989-4445-b42b-43cb7c02f2fc`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:55:41,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:55:41,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:55:41,038::task::1168::TaskManager.Task::(prepare) Task=`28743099-9989-4445-b42b-43cb7c02f2fc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:55:41,038::task::579::TaskManager.Task::(_updateState) Task=`28743099-9989-4445-b42b-43cb7c02f2fc`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:55:41,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:55:41,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:55:41,039::task::974::TaskManager.Task::(_decref) Task=`28743099-9989-4445-b42b-43cb7c02f2fc`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:55:41,048::task::579::TaskManager.Task::(_updateState) Task=`0a730dfb-3c50-4a8c-ae39-f1f58c48954f`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:55:41,048::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:55:41,048::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:55:41,048::task::1168::TaskManager.Task::(prepare) Task=`0a730dfb-3c50-4a8c-ae39-f1f58c48954f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:55:41,049::task::579::TaskManager.Task::(_updateState) Task=`0a730dfb-3c50-4a8c-ae39-f1f58c48954f`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:55:41,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:55:41,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:55:41,049::task::974::TaskManager.Task::(_decref) Task=`0a730dfb-3c50-4a8c-ae39-f1f58c48954f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:41,526::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:55:41,527::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:55:41,527::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:41,599::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:55:41,746::task::579::TaskManager.Task::(_updateState) Task=`5fa6ebeb-b8bf-499e-88f1-8e85f3b36238`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:55:41,746::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:55:41,746::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:55:41,747::task::1168::TaskManager.Task::(prepare) Task=`5fa6ebeb-b8bf-499e-88f1-8e85f3b36238`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:55:41,747::task::579::TaskManager.Task::(_updateState) Task=`5fa6ebeb-b8bf-499e-88f1-8e85f3b36238`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:55:41,747::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:55:41,747::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:55:41,747::task::974::TaskManager.Task::(_decref) Task=`5fa6ebeb-b8bf-499e-88f1-8e85f3b36238`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:55:41,948::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:55:41,966::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000267822 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:55:42,054::task::579::TaskManager.Task::(_updateState) Task=`45b7b94a-9d56-466b-8d5c-8f1dce62ccca`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:55:42,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:55:42,056::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:55:42,056::task::1168::TaskManager.Task::(prepare) Task=`45b7b94a-9d56-466b-8d5c-8f1dce62ccca`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:55:42,056::task::579::TaskManager.Task::(_updateState) Task=`45b7b94a-9d56-466b-8d5c-8f1dce62ccca`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:55:42,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:55:42,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:55:42,057::task::974::TaskManager.Task::(_decref) Task=`45b7b94a-9d56-466b-8d5c-8f1dce62ccca`::ref 0 aborting False >Thread-287283::DEBUG::2014-01-16 16:55:42,094::task::579::TaskManager.Task::(_updateState) Task=`16a9fb7c-5d5e-40be-ade8-a8c741c3e9ef`::moving from state init -> state preparing >Thread-287283::INFO::2014-01-16 16:55:42,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287283::INFO::2014-01-16 16:55:42,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267822', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331354', 'lastCheck': '9.7', 'valid': True}} >Thread-287283::DEBUG::2014-01-16 16:55:42,095::task::1168::TaskManager.Task::(prepare) Task=`16a9fb7c-5d5e-40be-ade8-a8c741c3e9ef`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000267822', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331354', 'lastCheck': '9.7', 'valid': True}} >Thread-287283::DEBUG::2014-01-16 16:55:42,095::task::579::TaskManager.Task::(_updateState) Task=`16a9fb7c-5d5e-40be-ade8-a8c741c3e9ef`::moving from state preparing -> state finished >Thread-287283::DEBUG::2014-01-16 16:55:42,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287283::DEBUG::2014-01-16 16:55:42,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287283::DEBUG::2014-01-16 16:55:42,095::task::974::TaskManager.Task::(_decref) Task=`16a9fb7c-5d5e-40be-ade8-a8c741c3e9ef`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:55:42,390::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:42,412::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000350027 s, 11.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:55:42,528::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:55:42,529::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:55:42,529::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:43,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:55:43,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:55:43,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:55:43,531::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:43,600::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:44,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:45,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:55:45,534::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:45,601::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:45,603::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:55:45,603::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:55:45,605::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:46,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:55:46,942::task::579::TaskManager.Task::(_updateState) Task=`9e0605bb-75bb-4840-bb8a-ddcbae7bdd74`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:55:46,943::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:55:46,943::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:55:46,943::task::1168::TaskManager.Task::(prepare) Task=`9e0605bb-75bb-4840-bb8a-ddcbae7bdd74`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:55:46,943::task::579::TaskManager.Task::(_updateState) Task=`9e0605bb-75bb-4840-bb8a-ddcbae7bdd74`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:55:46,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:55:46,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:55:46,944::task::974::TaskManager.Task::(_decref) Task=`9e0605bb-75bb-4840-bb8a-ddcbae7bdd74`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:55:46,944::task::579::TaskManager.Task::(_updateState) Task=`b4deee7d-4b28-4bec-bbda-7a8a78e77589`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:55:46,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:55:46,944::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:55:46,945::task::1168::TaskManager.Task::(prepare) Task=`b4deee7d-4b28-4bec-bbda-7a8a78e77589`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:55:46,945::task::579::TaskManager.Task::(_updateState) Task=`b4deee7d-4b28-4bec-bbda-7a8a78e77589`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:55:46,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:55:46,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:55:46,945::task::974::TaskManager.Task::(_decref) Task=`b4deee7d-4b28-4bec-bbda-7a8a78e77589`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:55:46,945::task::579::TaskManager.Task::(_updateState) Task=`2839e38b-de53-4d6f-b130-234e7b240572`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:55:46,945::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:55:46,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:55:46,946::task::1168::TaskManager.Task::(prepare) Task=`2839e38b-de53-4d6f-b130-234e7b240572`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:55:46,946::task::579::TaskManager.Task::(_updateState) Task=`2839e38b-de53-4d6f-b130-234e7b240572`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:55:46,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:55:46,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:55:46,946::task::974::TaskManager.Task::(_decref) Task=`2839e38b-de53-4d6f-b130-234e7b240572`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:47,537::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:47,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:48,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:49,539::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:49,607::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:55:49,657::task::579::TaskManager.Task::(_updateState) Task=`b2475501-b5bd-4254-bcaa-fc767872cda9`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:55:49,657::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:55:49,657::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:55:49,657::task::1168::TaskManager.Task::(prepare) Task=`b2475501-b5bd-4254-bcaa-fc767872cda9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:55:49,657::task::579::TaskManager.Task::(_updateState) Task=`b2475501-b5bd-4254-bcaa-fc767872cda9`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:55:49,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:55:49,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:55:49,658::task::974::TaskManager.Task::(_decref) Task=`b2475501-b5bd-4254-bcaa-fc767872cda9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:50,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:50,608::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:51,542::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:55:51,542::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:51,610::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:55:51,973::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:55:51,990::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000253357 s, 1.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:55:52,420::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:55:52,436::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00032761 s, 12.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:55:52,543::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:53,544::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:53,611::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 16:55:54,520::task::579::TaskManager.Task::(_updateState) Task=`e2d4d543-a109-4267-af8a-af609d9897e6`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:55:54,521::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:55:54,521::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:55:54,521::task::1168::TaskManager.Task::(prepare) Task=`e2d4d543-a109-4267-af8a-af609d9897e6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:55:54,521::task::579::TaskManager.Task::(_updateState) Task=`e2d4d543-a109-4267-af8a-af609d9897e6`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:55:54,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:55:54,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:55:54,522::task::974::TaskManager.Task::(_decref) Task=`e2d4d543-a109-4267-af8a-af609d9897e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:54,545::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:55,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:55,612::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:55:55,614::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:55:56,547::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:55:56,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:55:56,548::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:57,549::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:55:57,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:57,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287289::DEBUG::2014-01-16 16:55:57,894::task::579::TaskManager.Task::(_updateState) Task=`31b8396d-feec-4b87-99ee-e75b11dc3c64`::moving from state init -> state preparing >Thread-287289::INFO::2014-01-16 16:55:57,894::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287289::INFO::2014-01-16 16:55:57,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253357', 'lastCheck': '5.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032761', 'lastCheck': '5.5', 'valid': True}} >Thread-287289::DEBUG::2014-01-16 16:55:57,894::task::1168::TaskManager.Task::(prepare) Task=`31b8396d-feec-4b87-99ee-e75b11dc3c64`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253357', 'lastCheck': '5.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032761', 'lastCheck': '5.5', 'valid': True}} >Thread-287289::DEBUG::2014-01-16 16:55:57,894::task::579::TaskManager.Task::(_updateState) Task=`31b8396d-feec-4b87-99ee-e75b11dc3c64`::moving from state preparing -> state finished >Thread-287289::DEBUG::2014-01-16 16:55:57,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287289::DEBUG::2014-01-16 16:55:57,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287289::DEBUG::2014-01-16 16:55:57,895::task::974::TaskManager.Task::(_decref) Task=`31b8396d-feec-4b87-99ee-e75b11dc3c64`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:55:58,549::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:55:58,550::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:55:58,551::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:55:59,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:55:59,552::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:55:59,616::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:00,553::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:56:00,553::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:00,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:56:00,618::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:56:00,620::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:56:01,034::task::579::TaskManager.Task::(_updateState) Task=`889ca105-6208-42d7-92e8-acd4f6b3a393`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:56:01,035::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:56:01,035::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:56:01,035::task::1168::TaskManager.Task::(prepare) Task=`889ca105-6208-42d7-92e8-acd4f6b3a393`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:56:01,035::task::579::TaskManager.Task::(_updateState) Task=`889ca105-6208-42d7-92e8-acd4f6b3a393`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:56:01,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:56:01,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:56:01,036::task::974::TaskManager.Task::(_decref) Task=`889ca105-6208-42d7-92e8-acd4f6b3a393`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:01,554::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:01,621::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:56:01,997::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:56:02,013::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000361893 s, 1.0 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:56:02,441::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:56:02,458::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000320481 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:56:02,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:56:02,556::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:03,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:56:03,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:03,622::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:04,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:56:04,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:56:04,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:56:04,558::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:05,559::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:56:05,560::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:56:05,560::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:05,624::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:05,625::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:06,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:56:06,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:56:06,824::task::579::TaskManager.Task::(_updateState) Task=`957af0d9-3a91-4fe2-9425-a2cf7ef5b2a8`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:56:06,824::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:56:06,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:56:06,826::task::1168::TaskManager.Task::(prepare) Task=`957af0d9-3a91-4fe2-9425-a2cf7ef5b2a8`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:56:06,826::task::579::TaskManager.Task::(_updateState) Task=`957af0d9-3a91-4fe2-9425-a2cf7ef5b2a8`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:56:06,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:56:06,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:56:06,827::task::974::TaskManager.Task::(_decref) Task=`957af0d9-3a91-4fe2-9425-a2cf7ef5b2a8`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:56:06,838::task::579::TaskManager.Task::(_updateState) Task=`051a9a00-4459-4de0-adc4-5af705b0dd00`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:56:06,838::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:56:06,839::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:56:06,839::task::1168::TaskManager.Task::(prepare) Task=`051a9a00-4459-4de0-adc4-5af705b0dd00`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:56:06,840::task::579::TaskManager.Task::(_updateState) Task=`051a9a00-4459-4de0-adc4-5af705b0dd00`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:56:06,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:56:06,840::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:56:06,840::task::974::TaskManager.Task::(_decref) Task=`051a9a00-4459-4de0-adc4-5af705b0dd00`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:56:07,256::task::579::TaskManager.Task::(_updateState) Task=`945d2d8c-aa09-4fff-bbd8-202bce9f457c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:56:07,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:56:07,257::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:56:07,257::task::1168::TaskManager.Task::(prepare) Task=`945d2d8c-aa09-4fff-bbd8-202bce9f457c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:56:07,257::task::579::TaskManager.Task::(_updateState) Task=`945d2d8c-aa09-4fff-bbd8-202bce9f457c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:56:07,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:56:07,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:56:07,258::task::974::TaskManager.Task::(_decref) Task=`945d2d8c-aa09-4fff-bbd8-202bce9f457c`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:56:07,258::task::579::TaskManager.Task::(_updateState) Task=`0d091e81-c044-4945-ab1f-15764ce30131`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:56:07,258::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:56:07,258::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:56:07,258::task::1168::TaskManager.Task::(prepare) Task=`0d091e81-c044-4945-ab1f-15764ce30131`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:56:07,259::task::579::TaskManager.Task::(_updateState) Task=`0d091e81-c044-4945-ab1f-15764ce30131`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:56:07,259::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:56:07,259::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:56:07,259::task::974::TaskManager.Task::(_decref) Task=`0d091e81-c044-4945-ab1f-15764ce30131`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:07,562::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:56:07,562::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:56:07,562::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:56:07,563::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:07,626::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:56:08,125::task::579::TaskManager.Task::(_updateState) Task=`ed8d3286-0658-4ef0-98df-e112181c2b97`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:56:08,125::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:56:08,126::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:56:08,126::task::1168::TaskManager.Task::(prepare) Task=`ed8d3286-0658-4ef0-98df-e112181c2b97`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:56:08,126::task::579::TaskManager.Task::(_updateState) Task=`ed8d3286-0658-4ef0-98df-e112181c2b97`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:56:08,126::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:56:08,126::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:56:08,126::task::974::TaskManager.Task::(_decref) Task=`ed8d3286-0658-4ef0-98df-e112181c2b97`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:08,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:56:08,581::task::579::TaskManager.Task::(_updateState) Task=`5f0fdcfa-cb43-48cd-8206-5ee2daf5583d`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:56:08,581::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:56:08,583::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:56:08,583::task::1168::TaskManager.Task::(prepare) Task=`5f0fdcfa-cb43-48cd-8206-5ee2daf5583d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:56:08,583::task::579::TaskManager.Task::(_updateState) Task=`5f0fdcfa-cb43-48cd-8206-5ee2daf5583d`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:56:08,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:56:08,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:56:08,584::task::974::TaskManager.Task::(_decref) Task=`5f0fdcfa-cb43-48cd-8206-5ee2daf5583d`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:56:08,584::task::579::TaskManager.Task::(_updateState) Task=`51177ebd-1e65-4ea9-9d58-763f737f60de`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:56:08,584::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:56:08,584::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:56:08,584::task::1168::TaskManager.Task::(prepare) Task=`51177ebd-1e65-4ea9-9d58-763f737f60de`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:56:08,585::task::579::TaskManager.Task::(_updateState) Task=`51177ebd-1e65-4ea9-9d58-763f737f60de`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:56:08,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:56:08,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:56:08,585::task::974::TaskManager.Task::(_decref) Task=`51177ebd-1e65-4ea9-9d58-763f737f60de`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:09,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:56:09,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:56:09,566::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:56:09,566::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:09,566::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:56:09,568::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:56:09,627::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:10,569::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:10,629::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:11,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:56:11,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:56:11,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:11,630::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:56:12,014::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:56:12,019::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 16:56:12,020::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 16:56:12,025::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 16:56:12,026::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 16:56:12,026::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 16:56:12,026::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 16:56:12,031::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:56:12,047::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000262319 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:56:12,316::task::579::TaskManager.Task::(_updateState) Task=`3c358287-efb5-4605-9b39-6225e95242d3`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:56:12,317::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:56:12,317::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:56:12,317::task::1168::TaskManager.Task::(prepare) Task=`3c358287-efb5-4605-9b39-6225e95242d3`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:56:12,318::task::579::TaskManager.Task::(_updateState) Task=`3c358287-efb5-4605-9b39-6225e95242d3`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:56:12,318::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:56:12,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:56:12,318::task::974::TaskManager.Task::(_decref) Task=`3c358287-efb5-4605-9b39-6225e95242d3`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:56:12,355::task::579::TaskManager.Task::(_updateState) Task=`d861f76f-e9ed-4034-b011-593d547646c8`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:56:12,355::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:56:12,356::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:56:12,356::task::1168::TaskManager.Task::(prepare) Task=`d861f76f-e9ed-4034-b011-593d547646c8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:56:12,356::task::579::TaskManager.Task::(_updateState) Task=`d861f76f-e9ed-4034-b011-593d547646c8`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:56:12,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:56:12,356::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:56:12,356::task::974::TaskManager.Task::(_decref) Task=`d861f76f-e9ed-4034-b011-593d547646c8`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:56:12,464::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:56:12,480::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000366816 s, 11.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:56:12,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:56:12,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:56:12,572::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:56:12,786::task::579::TaskManager.Task::(_updateState) Task=`908602be-9d60-4c04-9d33-25307bfcfcc6`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:56:12,786::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:56:12,787::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:56:12,787::task::1168::TaskManager.Task::(prepare) Task=`908602be-9d60-4c04-9d33-25307bfcfcc6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:56:12,787::task::579::TaskManager.Task::(_updateState) Task=`908602be-9d60-4c04-9d33-25307bfcfcc6`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:56:12,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:56:12,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:56:12,788::task::974::TaskManager.Task::(_decref) Task=`908602be-9d60-4c04-9d33-25307bfcfcc6`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:56:12,788::task::579::TaskManager.Task::(_updateState) Task=`65399b2e-da6e-4d02-b90e-ec89ba427b71`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:56:12,788::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:56:12,788::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:56:12,789::task::1168::TaskManager.Task::(prepare) Task=`65399b2e-da6e-4d02-b90e-ec89ba427b71`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:56:12,789::task::579::TaskManager.Task::(_updateState) Task=`65399b2e-da6e-4d02-b90e-ec89ba427b71`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:56:12,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:56:12,789::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:56:12,789::task::974::TaskManager.Task::(_decref) Task=`65399b2e-da6e-4d02-b90e-ec89ba427b71`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:56:12,790::task::579::TaskManager.Task::(_updateState) Task=`68776552-b1f9-4a9a-a6a2-a134b596a842`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:56:12,790::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:56:12,790::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:56:12,790::task::1168::TaskManager.Task::(prepare) Task=`68776552-b1f9-4a9a-a6a2-a134b596a842`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:56:12,790::task::579::TaskManager.Task::(_updateState) Task=`68776552-b1f9-4a9a-a6a2-a134b596a842`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:56:12,791::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:56:12,791::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:56:12,791::task::974::TaskManager.Task::(_decref) Task=`68776552-b1f9-4a9a-a6a2-a134b596a842`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:56:13,154::task::579::TaskManager.Task::(_updateState) Task=`f9bdddf3-30d7-4c51-a4be-98416b3e0c2b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:56:13,155::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:56:13,155::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:56:13,156::task::1168::TaskManager.Task::(prepare) Task=`f9bdddf3-30d7-4c51-a4be-98416b3e0c2b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:56:13,156::task::579::TaskManager.Task::(_updateState) Task=`f9bdddf3-30d7-4c51-a4be-98416b3e0c2b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:56:13,156::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:56:13,156::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:56:13,156::task::974::TaskManager.Task::(_decref) Task=`f9bdddf3-30d7-4c51-a4be-98416b3e0c2b`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:56:13,157::task::579::TaskManager.Task::(_updateState) Task=`8c53103a-39c1-4e46-9280-a28997b34d3a`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:56:13,157::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:56:13,157::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:56:13,157::task::1168::TaskManager.Task::(prepare) Task=`8c53103a-39c1-4e46-9280-a28997b34d3a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:56:13,157::task::579::TaskManager.Task::(_updateState) Task=`8c53103a-39c1-4e46-9280-a28997b34d3a`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:56:13,158::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:56:13,158::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:56:13,158::task::974::TaskManager.Task::(_decref) Task=`8c53103a-39c1-4e46-9280-a28997b34d3a`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:56:13,465::task::579::TaskManager.Task::(_updateState) Task=`406fb761-017c-4c8f-b591-9639c2536bf1`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:56:13,465::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:56:13,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:56:13,466::task::1168::TaskManager.Task::(prepare) Task=`406fb761-017c-4c8f-b591-9639c2536bf1`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:56:13,466::task::579::TaskManager.Task::(_updateState) Task=`406fb761-017c-4c8f-b591-9639c2536bf1`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:56:13,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:56:13,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:56:13,467::task::974::TaskManager.Task::(_decref) Task=`406fb761-017c-4c8f-b591-9639c2536bf1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:13,573::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:56:13,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:56:13,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:56:13,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:13,631::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287296::DEBUG::2014-01-16 16:56:13,795::task::579::TaskManager.Task::(_updateState) Task=`3f240f79-c268-47e2-ad73-e3b47565d367`::moving from state init -> state preparing >Thread-287296::INFO::2014-01-16 16:56:13,795::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287296::INFO::2014-01-16 16:56:13,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262319', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366816', 'lastCheck': '1.3', 'valid': True}} >Thread-287296::DEBUG::2014-01-16 16:56:13,796::task::1168::TaskManager.Task::(prepare) Task=`3f240f79-c268-47e2-ad73-e3b47565d367`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262319', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366816', 'lastCheck': '1.3', 'valid': True}} >Thread-287296::DEBUG::2014-01-16 16:56:13,796::task::579::TaskManager.Task::(_updateState) Task=`3f240f79-c268-47e2-ad73-e3b47565d367`::moving from state preparing -> state finished >Thread-287296::DEBUG::2014-01-16 16:56:13,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287296::DEBUG::2014-01-16 16:56:13,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287296::DEBUG::2014-01-16 16:56:13,796::task::974::TaskManager.Task::(_decref) Task=`3f240f79-c268-47e2-ad73-e3b47565d367`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 16:56:14,452::task::579::TaskManager.Task::(_updateState) Task=`efbab68e-8ff3-40d1-9fe7-26da528b0e1c`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:56:14,452::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:56:14,452::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:56:14,453::task::1168::TaskManager.Task::(prepare) Task=`efbab68e-8ff3-40d1-9fe7-26da528b0e1c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:56:14,453::task::579::TaskManager.Task::(_updateState) Task=`efbab68e-8ff3-40d1-9fe7-26da528b0e1c`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:56:14,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:56:14,453::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:56:14,453::task::974::TaskManager.Task::(_decref) Task=`efbab68e-8ff3-40d1-9fe7-26da528b0e1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:14,575::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:15,577::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:56:15,577::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:15,633::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:15,634::task::579::TaskManager.Task::(_updateState) Task=`1b4a3b0c-949f-4f24-ae46-882085f839c8`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:56:15,634::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:56:15,634::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:56:15,634::task::1168::TaskManager.Task::(prepare) Task=`1b4a3b0c-949f-4f24-ae46-882085f839c8`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:56:15,634::task::579::TaskManager.Task::(_updateState) Task=`1b4a3b0c-949f-4f24-ae46-882085f839c8`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:56:15,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:56:15,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:56:15,635::task::974::TaskManager.Task::(_decref) Task=`1b4a3b0c-949f-4f24-ae46-882085f839c8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:56:15,637::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:56:15,637::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:56:15,638::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:15,639::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:15,640::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:16,578::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:17,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:17,641::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:56:17,765::task::579::TaskManager.Task::(_updateState) Task=`f0998fdf-db90-430a-b34d-ca115b931c80`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:56:17,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:56:17,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:56:17,766::task::1168::TaskManager.Task::(prepare) Task=`f0998fdf-db90-430a-b34d-ca115b931c80`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:56:17,766::task::579::TaskManager.Task::(_updateState) Task=`f0998fdf-db90-430a-b34d-ca115b931c80`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:56:17,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:56:17,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:56:17,767::task::974::TaskManager.Task::(_decref) Task=`f0998fdf-db90-430a-b34d-ca115b931c80`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:56:18,273::task::579::TaskManager.Task::(_updateState) Task=`8b9019b0-37fa-49bf-8eb8-65754ef12df9`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:56:18,273::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:56:18,274::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:56:18,275::task::1168::TaskManager.Task::(prepare) Task=`8b9019b0-37fa-49bf-8eb8-65754ef12df9`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:56:18,275::task::579::TaskManager.Task::(_updateState) Task=`8b9019b0-37fa-49bf-8eb8-65754ef12df9`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:56:18,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:56:18,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:56:18,275::task::974::TaskManager.Task::(_decref) Task=`8b9019b0-37fa-49bf-8eb8-65754ef12df9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:18,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:19,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:19,643::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:20,583::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:20,644::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:56:21,156::task::579::TaskManager.Task::(_updateState) Task=`26401b72-aa73-458d-a7c4-bc7576c25002`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:56:21,157::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:56:21,157::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:56:21,157::task::1168::TaskManager.Task::(prepare) Task=`26401b72-aa73-458d-a7c4-bc7576c25002`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:56:21,157::task::579::TaskManager.Task::(_updateState) Task=`26401b72-aa73-458d-a7c4-bc7576c25002`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:56:21,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:56:21,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:56:21,158::task::974::TaskManager.Task::(_decref) Task=`26401b72-aa73-458d-a7c4-bc7576c25002`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:21,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:56:21,584::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:21,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:56:22,055::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:56:22,071::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274764 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:56:22,486::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:56:22,504::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000262021 s, 15.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:56:22,586::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:23,586::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:23,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:24,588::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:25,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:25,648::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:25,649::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:56:26,145::task::579::TaskManager.Task::(_updateState) Task=`f2c52eda-5170-4cde-96c5-ef701c960eac`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:56:26,146::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:56:26,146::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:56:26,146::task::1168::TaskManager.Task::(prepare) Task=`f2c52eda-5170-4cde-96c5-ef701c960eac`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:56:26,147::task::579::TaskManager.Task::(_updateState) Task=`f2c52eda-5170-4cde-96c5-ef701c960eac`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:56:26,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:56:26,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:56:26,147::task::974::TaskManager.Task::(_decref) Task=`f2c52eda-5170-4cde-96c5-ef701c960eac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:26,590::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:56:26,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:56:26,591::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:27,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:56:27,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:27,650::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:28,593::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:56:28,593::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:56:28,594::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:56:29,036::task::579::TaskManager.Task::(_updateState) Task=`e5bcfa3a-5173-46c2-8a06-dcd90c19d422`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:56:29,037::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:56:29,037::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:56:29,037::task::1168::TaskManager.Task::(prepare) Task=`e5bcfa3a-5173-46c2-8a06-dcd90c19d422`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:56:29,037::task::579::TaskManager.Task::(_updateState) Task=`e5bcfa3a-5173-46c2-8a06-dcd90c19d422`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:56:29,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:56:29,038::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:56:29,038::task::974::TaskManager.Task::(_decref) Task=`e5bcfa3a-5173-46c2-8a06-dcd90c19d422`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:29,595::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:56:29,595::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287302::DEBUG::2014-01-16 16:56:29,630::task::579::TaskManager.Task::(_updateState) Task=`02b5595d-ebc3-43b0-95e1-bd567513046b`::moving from state init -> state preparing >Thread-287302::INFO::2014-01-16 16:56:29,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287302::INFO::2014-01-16 16:56:29,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274764', 'lastCheck': '7.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262021', 'lastCheck': '7.1', 'valid': True}} >Thread-287302::DEBUG::2014-01-16 16:56:29,630::task::1168::TaskManager.Task::(prepare) Task=`02b5595d-ebc3-43b0-95e1-bd567513046b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274764', 'lastCheck': '7.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262021', 'lastCheck': '7.1', 'valid': True}} >Thread-287302::DEBUG::2014-01-16 16:56:29,631::task::579::TaskManager.Task::(_updateState) Task=`02b5595d-ebc3-43b0-95e1-bd567513046b`::moving from state preparing -> state finished >Thread-287302::DEBUG::2014-01-16 16:56:29,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287302::DEBUG::2014-01-16 16:56:29,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287302::DEBUG::2014-01-16 16:56:29,631::task::974::TaskManager.Task::(_decref) Task=`02b5595d-ebc3-43b0-95e1-bd567513046b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:56:29,652::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:30,596::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:56:30,596::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:30,654::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:56:30,654::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:56:30,657::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:31,597::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:31,658::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:56:32,079::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:56:32,096::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273769 s, 1.3 MB/s\n'; <rc> = 0 >Thread-48925::DEBUG::2014-01-16 16:56:32,221::task::579::TaskManager.Task::(_updateState) Task=`106dd3c4-416d-426e-9838-9988ae12d97b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:56:32,222::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:56:32,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:56:32,222::task::1168::TaskManager.Task::(prepare) Task=`106dd3c4-416d-426e-9838-9988ae12d97b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:56:32,223::task::579::TaskManager.Task::(_updateState) Task=`106dd3c4-416d-426e-9838-9988ae12d97b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:56:32,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:56:32,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:56:32,223::task::974::TaskManager.Task::(_decref) Task=`106dd3c4-416d-426e-9838-9988ae12d97b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:56:32,224::task::579::TaskManager.Task::(_updateState) Task=`327147f5-9d1b-4193-b393-7c2ddc63cef5`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:56:32,224::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:56:32,224::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:56:32,224::task::1168::TaskManager.Task::(prepare) Task=`327147f5-9d1b-4193-b393-7c2ddc63cef5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:56:32,224::task::579::TaskManager.Task::(_updateState) Task=`327147f5-9d1b-4193-b393-7c2ddc63cef5`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:56:32,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:56:32,225::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:56:32,225::task::974::TaskManager.Task::(_decref) Task=`327147f5-9d1b-4193-b393-7c2ddc63cef5`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:56:32,510::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:56:32,527::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287272 s, 14.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:56:32,599::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:56:32,599::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 16:56:32,715::task::579::TaskManager.Task::(_updateState) Task=`8496d30e-b8a1-4137-840a-4cd4e8264c39`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:56:32,715::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:56:32,716::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:56:32,716::task::1168::TaskManager.Task::(prepare) Task=`8496d30e-b8a1-4137-840a-4cd4e8264c39`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:56:32,716::task::579::TaskManager.Task::(_updateState) Task=`8496d30e-b8a1-4137-840a-4cd4e8264c39`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:56:32,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:56:32,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:56:32,716::task::974::TaskManager.Task::(_decref) Task=`8496d30e-b8a1-4137-840a-4cd4e8264c39`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:56:32,741::task::579::TaskManager.Task::(_updateState) Task=`9f2e7295-e4c4-4768-a112-867b0329ba59`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:56:32,742::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:56:32,742::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:56:32,742::task::1168::TaskManager.Task::(prepare) Task=`9f2e7295-e4c4-4768-a112-867b0329ba59`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:56:32,742::task::579::TaskManager.Task::(_updateState) Task=`9f2e7295-e4c4-4768-a112-867b0329ba59`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:56:32,742::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:56:32,743::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:56:32,743::task::974::TaskManager.Task::(_decref) Task=`9f2e7295-e4c4-4768-a112-867b0329ba59`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:33,600::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:56:33,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:33,659::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:34,602::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:56:34,602::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:56:34,602::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:56:34,603::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:35,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:56:35,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:56:35,605::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:35,661::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:35,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:36,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:56:36,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:37,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:56:37,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:56:37,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:56:37,608::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:37,663::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:56:37,814::task::579::TaskManager.Task::(_updateState) Task=`6883393c-20b4-4ef2-aba1-3fe41d9cc224`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:56:37,814::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:56:37,815::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:56:37,815::task::1168::TaskManager.Task::(prepare) Task=`6883393c-20b4-4ef2-aba1-3fe41d9cc224`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:56:37,815::task::579::TaskManager.Task::(_updateState) Task=`6883393c-20b4-4ef2-aba1-3fe41d9cc224`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:56:37,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:56:37,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:56:37,816::task::974::TaskManager.Task::(_decref) Task=`6883393c-20b4-4ef2-aba1-3fe41d9cc224`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:38,608::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:39,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:56:39,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:56:39,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:56:39,610::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:39,611::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:56:39,611::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:56:39,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:56:40,199::task::579::TaskManager.Task::(_updateState) Task=`1250649d-04f2-4e91-a2dc-61b29a7434c3`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:56:40,200::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:56:40,200::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:56:40,200::task::1168::TaskManager.Task::(prepare) Task=`1250649d-04f2-4e91-a2dc-61b29a7434c3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:56:40,200::task::579::TaskManager.Task::(_updateState) Task=`1250649d-04f2-4e91-a2dc-61b29a7434c3`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:56:40,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:56:40,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:56:40,201::task::974::TaskManager.Task::(_decref) Task=`1250649d-04f2-4e91-a2dc-61b29a7434c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:40,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:40,666::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:56:41,177::task::579::TaskManager.Task::(_updateState) Task=`d9b6f710-f808-4598-b05d-1dc5f348c1a4`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:56:41,177::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:56:41,177::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:56:41,178::task::1168::TaskManager.Task::(prepare) Task=`d9b6f710-f808-4598-b05d-1dc5f348c1a4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:56:41,178::task::579::TaskManager.Task::(_updateState) Task=`d9b6f710-f808-4598-b05d-1dc5f348c1a4`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:56:41,178::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:56:41,178::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:56:41,178::task::974::TaskManager.Task::(_decref) Task=`d9b6f710-f808-4598-b05d-1dc5f348c1a4`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:56:41,209::task::579::TaskManager.Task::(_updateState) Task=`17bc6b73-23bb-4db4-b7af-896da3d4f178`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:56:41,210::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:56:41,210::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:56:41,210::task::1168::TaskManager.Task::(prepare) Task=`17bc6b73-23bb-4db4-b7af-896da3d4f178`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:56:41,210::task::579::TaskManager.Task::(_updateState) Task=`17bc6b73-23bb-4db4-b7af-896da3d4f178`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:56:41,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:56:41,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:56:41,211::task::974::TaskManager.Task::(_decref) Task=`17bc6b73-23bb-4db4-b7af-896da3d4f178`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:56:41,221::task::579::TaskManager.Task::(_updateState) Task=`43f5bec7-f383-4fa7-8a05-e0ac388ab1e0`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:56:41,222::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:56:41,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:56:41,222::task::1168::TaskManager.Task::(prepare) Task=`43f5bec7-f383-4fa7-8a05-e0ac388ab1e0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:56:41,222::task::579::TaskManager.Task::(_updateState) Task=`43f5bec7-f383-4fa7-8a05-e0ac388ab1e0`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:56:41,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:56:41,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:56:41,223::task::974::TaskManager.Task::(_decref) Task=`43f5bec7-f383-4fa7-8a05-e0ac388ab1e0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:41,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:56:41,613::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:56:41,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:41,668::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:56:41,908::task::579::TaskManager.Task::(_updateState) Task=`a350dd3d-8e65-4452-9cd2-9552e2f5d3ed`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:56:41,908::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:56:41,908::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:56:41,908::task::1168::TaskManager.Task::(prepare) Task=`a350dd3d-8e65-4452-9cd2-9552e2f5d3ed`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:56:41,908::task::579::TaskManager.Task::(_updateState) Task=`a350dd3d-8e65-4452-9cd2-9552e2f5d3ed`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:56:41,909::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:56:41,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:56:41,909::task::974::TaskManager.Task::(_decref) Task=`a350dd3d-8e65-4452-9cd2-9552e2f5d3ed`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:56:42,103::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:56:42,120::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000261472 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:56:42,219::task::579::TaskManager.Task::(_updateState) Task=`40f6ea18-70c0-4ca0-89cd-809677fb4244`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:56:42,219::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:56:42,220::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:56:42,220::task::1168::TaskManager.Task::(prepare) Task=`40f6ea18-70c0-4ca0-89cd-809677fb4244`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:56:42,220::task::579::TaskManager.Task::(_updateState) Task=`40f6ea18-70c0-4ca0-89cd-809677fb4244`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:56:42,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:56:42,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:56:42,221::task::974::TaskManager.Task::(_decref) Task=`40f6ea18-70c0-4ca0-89cd-809677fb4244`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:56:42,533::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:56:42,551::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000194259 s, 21.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:56:42,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:56:42,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:56:42,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:43,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:56:43,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:56:43,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:56:43,616::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:43,669::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:44,617::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287308::DEBUG::2014-01-16 16:56:45,512::task::579::TaskManager.Task::(_updateState) Task=`6be51050-c576-4c67-bd82-a8b182bc963e`::moving from state init -> state preparing >Thread-287308::INFO::2014-01-16 16:56:45,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287308::INFO::2014-01-16 16:56:45,513::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000261472', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000194259', 'lastCheck': '3.0', 'valid': True}} >Thread-287308::DEBUG::2014-01-16 16:56:45,513::task::1168::TaskManager.Task::(prepare) Task=`6be51050-c576-4c67-bd82-a8b182bc963e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000261472', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000194259', 'lastCheck': '3.0', 'valid': True}} >Thread-287308::DEBUG::2014-01-16 16:56:45,513::task::579::TaskManager.Task::(_updateState) Task=`6be51050-c576-4c67-bd82-a8b182bc963e`::moving from state preparing -> state finished >Thread-287308::DEBUG::2014-01-16 16:56:45,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287308::DEBUG::2014-01-16 16:56:45,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287308::DEBUG::2014-01-16 16:56:45,513::task::974::TaskManager.Task::(_decref) Task=`6be51050-c576-4c67-bd82-a8b182bc963e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:45,618::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:56:45,618::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:45,670::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:45,672::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:56:45,672::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:56:45,674::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:46,619::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:56:47,229::task::579::TaskManager.Task::(_updateState) Task=`093a9d9e-1738-497d-bfaf-1855ec190151`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:56:47,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:56:47,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:56:47,230::task::1168::TaskManager.Task::(prepare) Task=`093a9d9e-1738-497d-bfaf-1855ec190151`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:56:47,230::task::579::TaskManager.Task::(_updateState) Task=`093a9d9e-1738-497d-bfaf-1855ec190151`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:56:47,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:56:47,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:56:47,231::task::974::TaskManager.Task::(_decref) Task=`093a9d9e-1738-497d-bfaf-1855ec190151`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:56:47,231::task::579::TaskManager.Task::(_updateState) Task=`5241ecfe-27e9-49c8-8ccd-90ab064d5427`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:56:47,231::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:56:47,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:56:47,231::task::1168::TaskManager.Task::(prepare) Task=`5241ecfe-27e9-49c8-8ccd-90ab064d5427`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:56:47,232::task::579::TaskManager.Task::(_updateState) Task=`5241ecfe-27e9-49c8-8ccd-90ab064d5427`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:56:47,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:56:47,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:56:47,232::task::974::TaskManager.Task::(_decref) Task=`5241ecfe-27e9-49c8-8ccd-90ab064d5427`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:56:47,232::task::579::TaskManager.Task::(_updateState) Task=`671a1b03-c06e-41f8-af0f-3a9c3d9d80db`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:56:47,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:56:47,233::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:56:47,233::task::1168::TaskManager.Task::(prepare) Task=`671a1b03-c06e-41f8-af0f-3a9c3d9d80db`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:56:47,233::task::579::TaskManager.Task::(_updateState) Task=`671a1b03-c06e-41f8-af0f-3a9c3d9d80db`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:56:47,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:56:47,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:56:47,233::task::974::TaskManager.Task::(_decref) Task=`671a1b03-c06e-41f8-af0f-3a9c3d9d80db`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:47,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:47,675::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:48,622::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:49,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:49,676::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:56:49,817::task::579::TaskManager.Task::(_updateState) Task=`388a98c9-36d7-43e9-97a9-bf15e54bca89`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:56:49,818::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:56:49,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:56:49,818::task::1168::TaskManager.Task::(prepare) Task=`388a98c9-36d7-43e9-97a9-bf15e54bca89`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:56:49,818::task::579::TaskManager.Task::(_updateState) Task=`388a98c9-36d7-43e9-97a9-bf15e54bca89`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:56:49,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:56:49,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:56:49,819::task::974::TaskManager.Task::(_decref) Task=`388a98c9-36d7-43e9-97a9-bf15e54bca89`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:50,624::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:50,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:51,625::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:56:51,625::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:51,679::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:56:52,127::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:56:52,143::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000268306 s, 1.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:56:52,558::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:56:52,576::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000263043 s, 15.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:56:52,626::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:53,627::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:53,680::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:54,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:56:54,702::task::579::TaskManager.Task::(_updateState) Task=`76c39df8-727b-4bc8-be35-669ed64827e8`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:56:54,703::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:56:54,703::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:56:54,703::task::1168::TaskManager.Task::(prepare) Task=`76c39df8-727b-4bc8-be35-669ed64827e8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:56:54,703::task::579::TaskManager.Task::(_updateState) Task=`76c39df8-727b-4bc8-be35-669ed64827e8`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:56:54,703::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:56:54,703::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:56:54,704::task::974::TaskManager.Task::(_decref) Task=`76c39df8-727b-4bc8-be35-669ed64827e8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:56:55,629::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:55,682::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:56:55,683::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:56,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:56:56,630::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:56:56,630::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:57,631::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:56:57,631::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:57,684::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:56:58,632::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:56:58,633::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:56:58,633::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:56:59,633::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:56:59,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:56:59,686::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:00,635::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:57:00,635::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:00,688::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:57:00,688::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:57:00,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:57:01,201::task::579::TaskManager.Task::(_updateState) Task=`264265e8-557b-401b-833c-676550279ab9`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:57:01,201::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:57:01,202::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:57:01,202::task::1168::TaskManager.Task::(prepare) Task=`264265e8-557b-401b-833c-676550279ab9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:57:01,202::task::579::TaskManager.Task::(_updateState) Task=`264265e8-557b-401b-833c-676550279ab9`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:57:01,202::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:57:01,202::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:57:01,202::task::974::TaskManager.Task::(_decref) Task=`264265e8-557b-401b-833c-676550279ab9`::ref 0 aborting False >Thread-287314::DEBUG::2014-01-16 16:57:01,272::task::579::TaskManager.Task::(_updateState) Task=`b059b9d8-9022-4754-94fc-10ec33c05c28`::moving from state init -> state preparing >Thread-287314::INFO::2014-01-16 16:57:01,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287314::INFO::2014-01-16 16:57:01,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268306', 'lastCheck': '9.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263043', 'lastCheck': '8.7', 'valid': True}} >Thread-287314::DEBUG::2014-01-16 16:57:01,272::task::1168::TaskManager.Task::(prepare) Task=`b059b9d8-9022-4754-94fc-10ec33c05c28`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268306', 'lastCheck': '9.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263043', 'lastCheck': '8.7', 'valid': True}} >Thread-287314::DEBUG::2014-01-16 16:57:01,272::task::579::TaskManager.Task::(_updateState) Task=`b059b9d8-9022-4754-94fc-10ec33c05c28`::moving from state preparing -> state finished >Thread-287314::DEBUG::2014-01-16 16:57:01,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287314::DEBUG::2014-01-16 16:57:01,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287314::DEBUG::2014-01-16 16:57:01,273::task::974::TaskManager.Task::(_decref) Task=`b059b9d8-9022-4754-94fc-10ec33c05c28`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:01,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:01,690::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:57:02,151::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:57:02,168::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00025823 s, 1.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:57:02,582::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:57:02,601::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000289148 s, 14.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:57:02,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:57:02,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:03,638::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:57:03,639::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:03,692::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:04,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:57:04,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:57:04,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:57:04,640::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:05,641::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:57:05,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:57:05,642::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:05,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:05,695::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:06,643::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:57:06,643::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:57:06,903::task::579::TaskManager.Task::(_updateState) Task=`bbfe8381-fc17-45f0-953d-7aba74911543`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:57:06,903::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:57:06,904::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:57:06,904::task::1168::TaskManager.Task::(prepare) Task=`bbfe8381-fc17-45f0-953d-7aba74911543`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:57:06,904::task::579::TaskManager.Task::(_updateState) Task=`bbfe8381-fc17-45f0-953d-7aba74911543`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:57:06,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:57:06,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:57:06,905::task::974::TaskManager.Task::(_decref) Task=`bbfe8381-fc17-45f0-953d-7aba74911543`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:57:06,910::task::579::TaskManager.Task::(_updateState) Task=`bc364695-f329-4914-ab0f-c8cd04dc12c6`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:57:06,910::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:57:06,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:57:06,911::task::1168::TaskManager.Task::(prepare) Task=`bc364695-f329-4914-ab0f-c8cd04dc12c6`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:57:06,911::task::579::TaskManager.Task::(_updateState) Task=`bc364695-f329-4914-ab0f-c8cd04dc12c6`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:57:06,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:57:06,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:57:06,911::task::974::TaskManager.Task::(_decref) Task=`bc364695-f329-4914-ab0f-c8cd04dc12c6`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:57:07,486::task::579::TaskManager.Task::(_updateState) Task=`09b910ed-7cfa-48aa-93ee-2ec7c3fe59e7`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:57:07,486::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:57:07,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:57:07,487::task::1168::TaskManager.Task::(prepare) Task=`09b910ed-7cfa-48aa-93ee-2ec7c3fe59e7`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:57:07,487::task::579::TaskManager.Task::(_updateState) Task=`09b910ed-7cfa-48aa-93ee-2ec7c3fe59e7`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:57:07,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:57:07,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:57:07,487::task::974::TaskManager.Task::(_decref) Task=`09b910ed-7cfa-48aa-93ee-2ec7c3fe59e7`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:57:07,488::task::579::TaskManager.Task::(_updateState) Task=`8813c299-3c21-432f-9392-a69044e585b5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:57:07,488::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:57:07,488::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:57:07,488::task::1168::TaskManager.Task::(prepare) Task=`8813c299-3c21-432f-9392-a69044e585b5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:57:07,488::task::579::TaskManager.Task::(_updateState) Task=`8813c299-3c21-432f-9392-a69044e585b5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:57:07,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:57:07,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:57:07,489::task::974::TaskManager.Task::(_decref) Task=`8813c299-3c21-432f-9392-a69044e585b5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:07,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:57:07,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:57:07,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:57:07,645::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:07,696::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:57:08,300::task::579::TaskManager.Task::(_updateState) Task=`a40dd409-231b-454a-b60f-b1db2e2cef1c`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:57:08,300::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:57:08,301::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:57:08,301::task::1168::TaskManager.Task::(prepare) Task=`a40dd409-231b-454a-b60f-b1db2e2cef1c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:57:08,301::task::579::TaskManager.Task::(_updateState) Task=`a40dd409-231b-454a-b60f-b1db2e2cef1c`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:57:08,301::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:57:08,301::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:57:08,301::task::974::TaskManager.Task::(_decref) Task=`a40dd409-231b-454a-b60f-b1db2e2cef1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:08,646::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:57:08,682::task::579::TaskManager.Task::(_updateState) Task=`d3c3e8a4-5bdf-4870-9044-03e702d7a03f`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:57:08,682::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:57:08,683::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:57:08,683::task::1168::TaskManager.Task::(prepare) Task=`d3c3e8a4-5bdf-4870-9044-03e702d7a03f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:57:08,683::task::579::TaskManager.Task::(_updateState) Task=`d3c3e8a4-5bdf-4870-9044-03e702d7a03f`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:57:08,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:57:08,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:57:08,684::task::974::TaskManager.Task::(_decref) Task=`d3c3e8a4-5bdf-4870-9044-03e702d7a03f`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:57:08,684::task::579::TaskManager.Task::(_updateState) Task=`831626c4-8336-49b1-97cc-cbc4c99a799e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:57:08,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:57:08,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:57:08,684::task::1168::TaskManager.Task::(prepare) Task=`831626c4-8336-49b1-97cc-cbc4c99a799e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:57:08,684::task::579::TaskManager.Task::(_updateState) Task=`831626c4-8336-49b1-97cc-cbc4c99a799e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:57:08,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:57:08,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:57:08,685::task::974::TaskManager.Task::(_decref) Task=`831626c4-8336-49b1-97cc-cbc4c99a799e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:09,647::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:57:09,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:57:09,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:57:09,648::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:09,648::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:57:09,648::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:57:09,697::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:10,649::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:10,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:11,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:57:11,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:57:11,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:11,700::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:57:12,177::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:57:12,193::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000313311 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:57:12,449::task::579::TaskManager.Task::(_updateState) Task=`63003d8d-f2ec-4adc-94dc-d95567f777a8`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:57:12,449::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:57:12,449::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:57:12,450::task::1168::TaskManager.Task::(prepare) Task=`63003d8d-f2ec-4adc-94dc-d95567f777a8`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:57:12,450::task::579::TaskManager.Task::(_updateState) Task=`63003d8d-f2ec-4adc-94dc-d95567f777a8`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:57:12,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:57:12,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:57:12,450::task::974::TaskManager.Task::(_decref) Task=`63003d8d-f2ec-4adc-94dc-d95567f777a8`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:57:12,518::task::579::TaskManager.Task::(_updateState) Task=`c37cdade-4e82-4277-a952-d62b16eb1280`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:57:12,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:57:12,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:57:12,519::task::1168::TaskManager.Task::(prepare) Task=`c37cdade-4e82-4277-a952-d62b16eb1280`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:57:12,519::task::579::TaskManager.Task::(_updateState) Task=`c37cdade-4e82-4277-a952-d62b16eb1280`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:57:12,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:57:12,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:57:12,520::task::974::TaskManager.Task::(_decref) Task=`c37cdade-4e82-4277-a952-d62b16eb1280`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:57:12,607::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:57:12,624::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000307412 s, 13.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:57:12,652::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:57:12,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:57:12,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 16:57:13,359::task::579::TaskManager.Task::(_updateState) Task=`e68d7d95-df97-4569-ad74-43c56e887fa1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:57:13,359::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:57:13,360::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:57:13,360::task::1168::TaskManager.Task::(prepare) Task=`e68d7d95-df97-4569-ad74-43c56e887fa1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:57:13,360::task::579::TaskManager.Task::(_updateState) Task=`e68d7d95-df97-4569-ad74-43c56e887fa1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:57:13,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:57:13,360::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:57:13,361::task::974::TaskManager.Task::(_decref) Task=`e68d7d95-df97-4569-ad74-43c56e887fa1`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:57:13,361::task::579::TaskManager.Task::(_updateState) Task=`87ece281-93bc-40e1-be93-aa8089a7079b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:57:13,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:57:13,361::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:57:13,362::task::1168::TaskManager.Task::(prepare) Task=`87ece281-93bc-40e1-be93-aa8089a7079b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:57:13,362::task::579::TaskManager.Task::(_updateState) Task=`87ece281-93bc-40e1-be93-aa8089a7079b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:57:13,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:57:13,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:57:13,362::task::974::TaskManager.Task::(_decref) Task=`87ece281-93bc-40e1-be93-aa8089a7079b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:57:13,362::task::579::TaskManager.Task::(_updateState) Task=`ea19bae4-e2eb-43a8-b5a2-179a4721c1ed`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:57:13,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:57:13,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:57:13,363::task::1168::TaskManager.Task::(prepare) Task=`ea19bae4-e2eb-43a8-b5a2-179a4721c1ed`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:57:13,363::task::579::TaskManager.Task::(_updateState) Task=`ea19bae4-e2eb-43a8-b5a2-179a4721c1ed`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:57:13,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:57:13,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:57:13,364::task::974::TaskManager.Task::(_decref) Task=`ea19bae4-e2eb-43a8-b5a2-179a4721c1ed`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:57:13,388::task::579::TaskManager.Task::(_updateState) Task=`76aa4348-bd57-4550-9ae9-6cce68d00cd4`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:57:13,388::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:57:13,388::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:57:13,389::task::1168::TaskManager.Task::(prepare) Task=`76aa4348-bd57-4550-9ae9-6cce68d00cd4`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:57:13,389::task::579::TaskManager.Task::(_updateState) Task=`76aa4348-bd57-4550-9ae9-6cce68d00cd4`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:57:13,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:57:13,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:57:13,389::task::974::TaskManager.Task::(_decref) Task=`76aa4348-bd57-4550-9ae9-6cce68d00cd4`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:57:13,390::task::579::TaskManager.Task::(_updateState) Task=`388c4dee-572c-419e-bc34-0f816198a2ba`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:57:13,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:57:13,390::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:57:13,390::task::1168::TaskManager.Task::(prepare) Task=`388c4dee-572c-419e-bc34-0f816198a2ba`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:57:13,390::task::579::TaskManager.Task::(_updateState) Task=`388c4dee-572c-419e-bc34-0f816198a2ba`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:57:13,390::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:57:13,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:57:13,391::task::974::TaskManager.Task::(_decref) Task=`388c4dee-572c-419e-bc34-0f816198a2ba`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 16:57:13,634::task::579::TaskManager.Task::(_updateState) Task=`9d2a88a8-025d-4831-8764-f642167b9b67`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:57:13,634::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:57:13,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:57:13,635::task::1168::TaskManager.Task::(prepare) Task=`9d2a88a8-025d-4831-8764-f642167b9b67`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:57:13,635::task::579::TaskManager.Task::(_updateState) Task=`9d2a88a8-025d-4831-8764-f642167b9b67`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:57:13,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:57:13,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:57:13,635::task::974::TaskManager.Task::(_decref) Task=`9d2a88a8-025d-4831-8764-f642167b9b67`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:13,654::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:57:13,654::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:57:13,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:57:13,655::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:13,701::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 16:57:14,642::task::579::TaskManager.Task::(_updateState) Task=`7ada57fa-b7c0-4fbf-a501-92c103153ca5`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:57:14,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:57:14,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:57:14,643::task::1168::TaskManager.Task::(prepare) Task=`7ada57fa-b7c0-4fbf-a501-92c103153ca5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:57:14,643::task::579::TaskManager.Task::(_updateState) Task=`7ada57fa-b7c0-4fbf-a501-92c103153ca5`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:57:14,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:57:14,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:57:14,644::task::974::TaskManager.Task::(_decref) Task=`7ada57fa-b7c0-4fbf-a501-92c103153ca5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:14,656::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:15,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:57:15,657::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:15,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:15,703::task::579::TaskManager.Task::(_updateState) Task=`1b63c2da-9b06-4bd2-9b2d-7dad8df1876b`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:57:15,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:57:15,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:57:15,704::task::1168::TaskManager.Task::(prepare) Task=`1b63c2da-9b06-4bd2-9b2d-7dad8df1876b`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:57:15,704::task::579::TaskManager.Task::(_updateState) Task=`1b63c2da-9b06-4bd2-9b2d-7dad8df1876b`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:57:15,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:57:15,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:57:15,705::task::974::TaskManager.Task::(_decref) Task=`1b63c2da-9b06-4bd2-9b2d-7dad8df1876b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:57:15,706::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:57:15,706::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:57:15,707::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:15,709::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:15,710::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:16,658::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287320::DEBUG::2014-01-16 16:57:16,964::task::579::TaskManager.Task::(_updateState) Task=`2ae26b26-2aac-48cf-9f8e-714277237c74`::moving from state init -> state preparing >Thread-287320::INFO::2014-01-16 16:57:16,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287320::INFO::2014-01-16 16:57:16,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313311', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307412', 'lastCheck': '4.3', 'valid': True}} >Thread-287320::DEBUG::2014-01-16 16:57:16,965::task::1168::TaskManager.Task::(prepare) Task=`2ae26b26-2aac-48cf-9f8e-714277237c74`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313311', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307412', 'lastCheck': '4.3', 'valid': True}} >Thread-287320::DEBUG::2014-01-16 16:57:16,965::task::579::TaskManager.Task::(_updateState) Task=`2ae26b26-2aac-48cf-9f8e-714277237c74`::moving from state preparing -> state finished >Thread-287320::DEBUG::2014-01-16 16:57:16,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287320::DEBUG::2014-01-16 16:57:16,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287320::DEBUG::2014-01-16 16:57:16,966::task::974::TaskManager.Task::(_decref) Task=`2ae26b26-2aac-48cf-9f8e-714277237c74`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:17,659::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:17,711::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:57:17,930::task::579::TaskManager.Task::(_updateState) Task=`2e3691a6-6eea-4951-be30-5279aab80251`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:57:17,931::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:57:17,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:57:17,931::task::1168::TaskManager.Task::(prepare) Task=`2e3691a6-6eea-4951-be30-5279aab80251`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:57:17,931::task::579::TaskManager.Task::(_updateState) Task=`2e3691a6-6eea-4951-be30-5279aab80251`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:57:17,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:57:17,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:57:17,932::task::974::TaskManager.Task::(_decref) Task=`2e3691a6-6eea-4951-be30-5279aab80251`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:57:18,360::task::579::TaskManager.Task::(_updateState) Task=`0e6606e6-a955-4cef-9f82-6cc479f5c652`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:57:18,360::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:57:18,362::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:57:18,362::task::1168::TaskManager.Task::(prepare) Task=`0e6606e6-a955-4cef-9f82-6cc479f5c652`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:57:18,362::task::579::TaskManager.Task::(_updateState) Task=`0e6606e6-a955-4cef-9f82-6cc479f5c652`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:57:18,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:57:18,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:57:18,362::task::974::TaskManager.Task::(_decref) Task=`0e6606e6-a955-4cef-9f82-6cc479f5c652`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:18,660::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:19,661::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:19,712::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:20,663::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:20,713::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:57:21,331::task::579::TaskManager.Task::(_updateState) Task=`6407512a-9a55-43c3-86b2-3c04f947154c`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:57:21,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:57:21,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:57:21,332::task::1168::TaskManager.Task::(prepare) Task=`6407512a-9a55-43c3-86b2-3c04f947154c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:57:21,332::task::579::TaskManager.Task::(_updateState) Task=`6407512a-9a55-43c3-86b2-3c04f947154c`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:57:21,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:57:21,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:57:21,332::task::974::TaskManager.Task::(_decref) Task=`6407512a-9a55-43c3-86b2-3c04f947154c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:21,664::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:57:21,664::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:21,715::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:57:22,201::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:57:22,219::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000347481 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:57:22,630::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:57:22,646::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000310256 s, 13.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:57:22,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:23,667::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:23,716::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:24,668::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:25,669::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:25,717::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:25,718::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 16:57:26,218::task::579::TaskManager.Task::(_updateState) Task=`d44f3944-7380-4a69-8a98-7f464e773d68`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:57:26,219::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:57:26,219::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:57:26,219::task::1168::TaskManager.Task::(prepare) Task=`d44f3944-7380-4a69-8a98-7f464e773d68`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:57:26,220::task::579::TaskManager.Task::(_updateState) Task=`d44f3944-7380-4a69-8a98-7f464e773d68`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:57:26,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:57:26,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:57:26,220::task::974::TaskManager.Task::(_decref) Task=`d44f3944-7380-4a69-8a98-7f464e773d68`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:26,671::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:57:26,671::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:57:26,671::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:27,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:57:27,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:27,719::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:28,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:57:28,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:57:28,674::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:57:29,215::task::579::TaskManager.Task::(_updateState) Task=`6463130c-55e1-466d-8158-0a98cce71b53`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:57:29,215::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:57:29,216::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:57:29,216::task::1168::TaskManager.Task::(prepare) Task=`6463130c-55e1-466d-8158-0a98cce71b53`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:57:29,216::task::579::TaskManager.Task::(_updateState) Task=`6463130c-55e1-466d-8158-0a98cce71b53`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:57:29,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:57:29,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:57:29,217::task::974::TaskManager.Task::(_decref) Task=`6463130c-55e1-466d-8158-0a98cce71b53`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:29,675::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:57:29,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:29,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:30,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:57:30,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:30,723::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:57:30,723::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:57:30,724::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:31,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:31,725::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:57:32,226::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:57:32,243::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000303398 s, 1.2 MB/s\n'; <rc> = 0 >Thread-48925::DEBUG::2014-01-16 16:57:32,580::task::579::TaskManager.Task::(_updateState) Task=`f080a280-e317-45f0-a8aa-04f174f3def3`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:57:32,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:57:32,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:57:32,581::task::1168::TaskManager.Task::(prepare) Task=`f080a280-e317-45f0-a8aa-04f174f3def3`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:57:32,581::task::579::TaskManager.Task::(_updateState) Task=`f080a280-e317-45f0-a8aa-04f174f3def3`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:57:32,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:57:32,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:57:32,582::task::974::TaskManager.Task::(_decref) Task=`f080a280-e317-45f0-a8aa-04f174f3def3`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:57:32,582::task::579::TaskManager.Task::(_updateState) Task=`2f3e3bb7-7c00-4a40-8cf9-dd3e0039dbe4`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:57:32,582::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:57:32,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:57:32,583::task::1168::TaskManager.Task::(prepare) Task=`2f3e3bb7-7c00-4a40-8cf9-dd3e0039dbe4`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:57:32,583::task::579::TaskManager.Task::(_updateState) Task=`2f3e3bb7-7c00-4a40-8cf9-dd3e0039dbe4`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:57:32,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:57:32,583::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:57:32,583::task::974::TaskManager.Task::(_decref) Task=`2f3e3bb7-7c00-4a40-8cf9-dd3e0039dbe4`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:57:32,652::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 16:57:32,669::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000319792 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:57:32,677::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:57:32,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287326::DEBUG::2014-01-16 16:57:32,744::task::579::TaskManager.Task::(_updateState) Task=`7d5e2b63-68ad-4807-a9ba-65cbaf984442`::moving from state init -> state preparing >Thread-287326::INFO::2014-01-16 16:57:32,744::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287326::INFO::2014-01-16 16:57:32,745::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303398', 'lastCheck': '0.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319792', 'lastCheck': '0.1', 'valid': True}} >Thread-287326::DEBUG::2014-01-16 16:57:32,745::task::1168::TaskManager.Task::(prepare) Task=`7d5e2b63-68ad-4807-a9ba-65cbaf984442`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303398', 'lastCheck': '0.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319792', 'lastCheck': '0.1', 'valid': True}} >Thread-287326::DEBUG::2014-01-16 16:57:32,745::task::579::TaskManager.Task::(_updateState) Task=`7d5e2b63-68ad-4807-a9ba-65cbaf984442`::moving from state preparing -> state finished >Thread-287326::DEBUG::2014-01-16 16:57:32,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287326::DEBUG::2014-01-16 16:57:32,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287326::DEBUG::2014-01-16 16:57:32,745::task::974::TaskManager.Task::(_decref) Task=`7d5e2b63-68ad-4807-a9ba-65cbaf984442`::ref 0 aborting False >Thread-3175::DEBUG::2014-01-16 16:57:32,886::task::579::TaskManager.Task::(_updateState) Task=`8d153ea1-cecb-4b85-9468-bb70855c704c`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:57:32,886::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:57:32,886::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:57:32,886::task::1168::TaskManager.Task::(prepare) Task=`8d153ea1-cecb-4b85-9468-bb70855c704c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:57:32,887::task::579::TaskManager.Task::(_updateState) Task=`8d153ea1-cecb-4b85-9468-bb70855c704c`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:57:32,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:57:32,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:57:32,887::task::974::TaskManager.Task::(_decref) Task=`8d153ea1-cecb-4b85-9468-bb70855c704c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:57:32,907::task::579::TaskManager.Task::(_updateState) Task=`ad460dea-582c-47da-8ee4-c4a39f7b21db`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:57:32,907::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:57:32,907::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:57:32,907::task::1168::TaskManager.Task::(prepare) Task=`ad460dea-582c-47da-8ee4-c4a39f7b21db`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:57:32,908::task::579::TaskManager.Task::(_updateState) Task=`ad460dea-582c-47da-8ee4-c4a39f7b21db`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:57:32,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:57:32,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:57:32,908::task::974::TaskManager.Task::(_decref) Task=`ad460dea-582c-47da-8ee4-c4a39f7b21db`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:33,678::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:57:33,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:33,727::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:34,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:57:34,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:57:34,680::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:57:34,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:35,681::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:57:35,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:57:35,682::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:35,728::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:35,729::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:36,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:57:36,682::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:37,683::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:57:37,684::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:57:37,684::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:57:37,684::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:37,730::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 16:57:37,987::task::579::TaskManager.Task::(_updateState) Task=`4801b43c-72b8-44c3-98d4-34374373f832`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:57:37,987::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:57:37,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:57:37,988::task::1168::TaskManager.Task::(prepare) Task=`4801b43c-72b8-44c3-98d4-34374373f832`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:57:37,988::task::579::TaskManager.Task::(_updateState) Task=`4801b43c-72b8-44c3-98d4-34374373f832`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:57:37,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:57:37,988::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:57:37,988::task::974::TaskManager.Task::(_decref) Task=`4801b43c-72b8-44c3-98d4-34374373f832`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:38,685::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:39,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:57:39,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:57:39,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:57:39,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:39,687::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:57:39,688::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:57:39,732::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 16:57:40,369::task::579::TaskManager.Task::(_updateState) Task=`c7dfc927-d2b2-43fd-94a6-3d3d24aa6b97`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:57:40,369::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:57:40,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:57:40,370::task::1168::TaskManager.Task::(prepare) Task=`c7dfc927-d2b2-43fd-94a6-3d3d24aa6b97`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:57:40,370::task::579::TaskManager.Task::(_updateState) Task=`c7dfc927-d2b2-43fd-94a6-3d3d24aa6b97`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:57:40,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:57:40,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:57:40,370::task::974::TaskManager.Task::(_decref) Task=`c7dfc927-d2b2-43fd-94a6-3d3d24aa6b97`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:40,689::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:40,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 16:57:41,338::task::579::TaskManager.Task::(_updateState) Task=`c591fab7-5338-4df6-b9d9-5f5f2c2c1624`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:57:41,339::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:57:41,339::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:57:41,339::task::1168::TaskManager.Task::(prepare) Task=`c591fab7-5338-4df6-b9d9-5f5f2c2c1624`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:57:41,339::task::579::TaskManager.Task::(_updateState) Task=`c591fab7-5338-4df6-b9d9-5f5f2c2c1624`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:57:41,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:57:41,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:57:41,340::task::974::TaskManager.Task::(_decref) Task=`c591fab7-5338-4df6-b9d9-5f5f2c2c1624`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:57:41,378::task::579::TaskManager.Task::(_updateState) Task=`321c6ae4-d27b-4f41-894f-085c68e91567`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:57:41,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:57:41,379::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:57:41,379::task::1168::TaskManager.Task::(prepare) Task=`321c6ae4-d27b-4f41-894f-085c68e91567`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:57:41,379::task::579::TaskManager.Task::(_updateState) Task=`321c6ae4-d27b-4f41-894f-085c68e91567`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:57:41,379::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:57:41,379::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:57:41,379::task::974::TaskManager.Task::(_decref) Task=`321c6ae4-d27b-4f41-894f-085c68e91567`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:57:41,390::task::579::TaskManager.Task::(_updateState) Task=`032a7cb5-066f-45f8-af63-42b55bd16cb6`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:57:41,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:57:41,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:57:41,391::task::1168::TaskManager.Task::(prepare) Task=`032a7cb5-066f-45f8-af63-42b55bd16cb6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:57:41,391::task::579::TaskManager.Task::(_updateState) Task=`032a7cb5-066f-45f8-af63-42b55bd16cb6`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:57:41,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:57:41,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:57:41,391::task::974::TaskManager.Task::(_decref) Task=`032a7cb5-066f-45f8-af63-42b55bd16cb6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:41,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:57:41,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:57:41,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:41,734::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20952::DEBUG::2014-01-16 16:57:42,064::task::579::TaskManager.Task::(_updateState) Task=`603b9746-6b1e-45c3-bbc1-cd28d39c77cc`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:57:42,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:57:42,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:57:42,064::task::1168::TaskManager.Task::(prepare) Task=`603b9746-6b1e-45c3-bbc1-cd28d39c77cc`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:57:42,065::task::579::TaskManager.Task::(_updateState) Task=`603b9746-6b1e-45c3-bbc1-cd28d39c77cc`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:57:42,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:57:42,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:57:42,065::task::974::TaskManager.Task::(_decref) Task=`603b9746-6b1e-45c3-bbc1-cd28d39c77cc`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:57:42,251::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:57:42,268::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000402261 s, 907 kB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:57:42,386::task::579::TaskManager.Task::(_updateState) Task=`d23493ab-2c5d-4a6b-8a7c-417abaea5df6`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:57:42,387::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:57:42,387::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:57:42,387::task::1168::TaskManager.Task::(prepare) Task=`d23493ab-2c5d-4a6b-8a7c-417abaea5df6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:57:42,388::task::579::TaskManager.Task::(_updateState) Task=`d23493ab-2c5d-4a6b-8a7c-417abaea5df6`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:57:42,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:57:42,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:57:42,388::task::974::TaskManager.Task::(_decref) Task=`d23493ab-2c5d-4a6b-8a7c-417abaea5df6`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:57:42,675::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:57:42,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:57:42,695::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:57:42,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:57:42,698::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000286433 s, 14.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:57:43,698::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:57:43,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:57:43,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:57:43,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:43,736::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:44,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:45,701::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:57:45,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:45,738::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:45,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:57:45,740::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:57:45,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:46,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:57:47,516::task::579::TaskManager.Task::(_updateState) Task=`29b6f5ad-89f5-4d60-9267-e89633615ced`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:57:47,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:57:47,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:57:47,517::task::1168::TaskManager.Task::(prepare) Task=`29b6f5ad-89f5-4d60-9267-e89633615ced`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:57:47,517::task::579::TaskManager.Task::(_updateState) Task=`29b6f5ad-89f5-4d60-9267-e89633615ced`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:57:47,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:57:47,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:57:47,517::task::974::TaskManager.Task::(_decref) Task=`29b6f5ad-89f5-4d60-9267-e89633615ced`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:57:47,518::task::579::TaskManager.Task::(_updateState) Task=`58e6069c-1b48-43f2-aec2-5888341c209a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:57:47,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:57:47,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:57:47,518::task::1168::TaskManager.Task::(prepare) Task=`58e6069c-1b48-43f2-aec2-5888341c209a`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:57:47,518::task::579::TaskManager.Task::(_updateState) Task=`58e6069c-1b48-43f2-aec2-5888341c209a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:57:47,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:57:47,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:57:47,519::task::974::TaskManager.Task::(_decref) Task=`58e6069c-1b48-43f2-aec2-5888341c209a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:57:47,519::task::579::TaskManager.Task::(_updateState) Task=`9036db46-8768-4742-ab6a-70c48840de56`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:57:47,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:57:47,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:57:47,519::task::1168::TaskManager.Task::(prepare) Task=`9036db46-8768-4742-ab6a-70c48840de56`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:57:47,519::task::579::TaskManager.Task::(_updateState) Task=`9036db46-8768-4742-ab6a-70c48840de56`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:57:47,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:57:47,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:57:47,520::task::974::TaskManager.Task::(_decref) Task=`9036db46-8768-4742-ab6a-70c48840de56`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:47,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:47,743::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287332::DEBUG::2014-01-16 16:57:48,477::task::579::TaskManager.Task::(_updateState) Task=`641ffcc5-6950-45e8-b3a0-1564bb65cba8`::moving from state init -> state preparing >Thread-287332::INFO::2014-01-16 16:57:48,477::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287332::INFO::2014-01-16 16:57:48,477::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000402261', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286433', 'lastCheck': '5.8', 'valid': True}} >Thread-287332::DEBUG::2014-01-16 16:57:48,477::task::1168::TaskManager.Task::(prepare) Task=`641ffcc5-6950-45e8-b3a0-1564bb65cba8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000402261', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286433', 'lastCheck': '5.8', 'valid': True}} >Thread-287332::DEBUG::2014-01-16 16:57:48,477::task::579::TaskManager.Task::(_updateState) Task=`641ffcc5-6950-45e8-b3a0-1564bb65cba8`::moving from state preparing -> state finished >Thread-287332::DEBUG::2014-01-16 16:57:48,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287332::DEBUG::2014-01-16 16:57:48,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287332::DEBUG::2014-01-16 16:57:48,478::task::974::TaskManager.Task::(_decref) Task=`641ffcc5-6950-45e8-b3a0-1564bb65cba8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:48,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:49,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:49,745::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 16:57:49,981::task::579::TaskManager.Task::(_updateState) Task=`55b9e72c-cb23-4a9c-841e-992585e41c1c`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:57:49,981::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:57:49,982::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:57:49,982::task::1168::TaskManager.Task::(prepare) Task=`55b9e72c-cb23-4a9c-841e-992585e41c1c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:57:49,982::task::579::TaskManager.Task::(_updateState) Task=`55b9e72c-cb23-4a9c-841e-992585e41c1c`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:57:49,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:57:49,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:57:49,982::task::974::TaskManager.Task::(_decref) Task=`55b9e72c-cb23-4a9c-841e-992585e41c1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:50,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:50,746::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:51,707::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:57:51,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:51,748::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:57:52,276::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:57:52,292::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002975 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:57:52,704::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:57:52,719::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:57:52,722::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000207406 s, 19.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:57:53,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:53,749::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:54,722::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:57:54,879::task::579::TaskManager.Task::(_updateState) Task=`a27a771d-bd17-41a1-bf2c-c8872106d8c1`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:57:54,880::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:57:54,880::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:57:54,880::task::1168::TaskManager.Task::(prepare) Task=`a27a771d-bd17-41a1-bf2c-c8872106d8c1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:57:54,880::task::579::TaskManager.Task::(_updateState) Task=`a27a771d-bd17-41a1-bf2c-c8872106d8c1`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:57:54,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:57:54,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:57:54,881::task::974::TaskManager.Task::(_decref) Task=`a27a771d-bd17-41a1-bf2c-c8872106d8c1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:57:55,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:55,750::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:57:55,752::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:56,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:57:56,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:57:56,725::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:57,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:57:57,727::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:57,753::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:57:58,727::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:57:58,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:57:58,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:57:59,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:57:59,729::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:57:59,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:00,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:58:00,730::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:00,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:58:00,757::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:58:00,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 16:58:01,374::task::579::TaskManager.Task::(_updateState) Task=`4bfb4a66-7d41-4cd6-af93-7d682ab5f0e2`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:58:01,374::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:58:01,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:58:01,375::task::1168::TaskManager.Task::(prepare) Task=`4bfb4a66-7d41-4cd6-af93-7d682ab5f0e2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:58:01,375::task::579::TaskManager.Task::(_updateState) Task=`4bfb4a66-7d41-4cd6-af93-7d682ab5f0e2`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:58:01,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:58:01,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:58:01,375::task::974::TaskManager.Task::(_decref) Task=`4bfb4a66-7d41-4cd6-af93-7d682ab5f0e2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:01,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:01,760::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:58:02,300::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:58:02,317::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281676 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:58:02,727::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:58:02,742::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:58:02,744::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:58:02,746::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000250762 s, 16.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 16:58:03,745::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:58:03,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:03,761::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:04,746::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:58:04,747::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:58:04,747::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:58:04,747::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287338::DEBUG::2014-01-16 16:58:04,915::task::579::TaskManager.Task::(_updateState) Task=`4ffa4e8a-4dfe-426f-bd40-f8abf7e9e292`::moving from state init -> state preparing >Thread-287338::INFO::2014-01-16 16:58:04,915::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287338::INFO::2014-01-16 16:58:04,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281676', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250762', 'lastCheck': '2.2', 'valid': True}} >Thread-287338::DEBUG::2014-01-16 16:58:04,916::task::1168::TaskManager.Task::(prepare) Task=`4ffa4e8a-4dfe-426f-bd40-f8abf7e9e292`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281676', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250762', 'lastCheck': '2.2', 'valid': True}} >Thread-287338::DEBUG::2014-01-16 16:58:04,916::task::579::TaskManager.Task::(_updateState) Task=`4ffa4e8a-4dfe-426f-bd40-f8abf7e9e292`::moving from state preparing -> state finished >Thread-287338::DEBUG::2014-01-16 16:58:04,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287338::DEBUG::2014-01-16 16:58:04,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287338::DEBUG::2014-01-16 16:58:04,916::task::974::TaskManager.Task::(_decref) Task=`4ffa4e8a-4dfe-426f-bd40-f8abf7e9e292`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:05,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:58:05,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:58:05,749::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:05,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:05,763::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:06,750::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:58:06,750::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:58:06,977::task::579::TaskManager.Task::(_updateState) Task=`e69a0fbe-e5b7-4e9b-bc03-549130d31e15`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:58:06,977::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:58:06,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:58:06,977::task::1168::TaskManager.Task::(prepare) Task=`e69a0fbe-e5b7-4e9b-bc03-549130d31e15`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:58:06,977::task::579::TaskManager.Task::(_updateState) Task=`e69a0fbe-e5b7-4e9b-bc03-549130d31e15`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:58:06,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:58:06,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:58:06,978::task::974::TaskManager.Task::(_decref) Task=`e69a0fbe-e5b7-4e9b-bc03-549130d31e15`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:58:06,983::task::579::TaskManager.Task::(_updateState) Task=`33705821-1f30-4f55-ac40-8b97a2be8ca9`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:58:06,984::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:58:06,984::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:58:06,984::task::1168::TaskManager.Task::(prepare) Task=`33705821-1f30-4f55-ac40-8b97a2be8ca9`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:58:06,985::task::579::TaskManager.Task::(_updateState) Task=`33705821-1f30-4f55-ac40-8b97a2be8ca9`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:58:06,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:58:06,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:58:06,985::task::974::TaskManager.Task::(_decref) Task=`33705821-1f30-4f55-ac40-8b97a2be8ca9`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:58:07,725::task::579::TaskManager.Task::(_updateState) Task=`76983934-60a9-44b7-94c8-c946d280d25c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:58:07,725::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:58:07,726::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:58:07,726::task::1168::TaskManager.Task::(prepare) Task=`76983934-60a9-44b7-94c8-c946d280d25c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:58:07,726::task::579::TaskManager.Task::(_updateState) Task=`76983934-60a9-44b7-94c8-c946d280d25c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:58:07,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:58:07,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:58:07,726::task::974::TaskManager.Task::(_decref) Task=`76983934-60a9-44b7-94c8-c946d280d25c`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:58:07,727::task::579::TaskManager.Task::(_updateState) Task=`6224d6c9-5dcb-4ed2-8948-ab47c49b2cda`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:58:07,727::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:58:07,727::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:58:07,727::task::1168::TaskManager.Task::(prepare) Task=`6224d6c9-5dcb-4ed2-8948-ab47c49b2cda`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:58:07,727::task::579::TaskManager.Task::(_updateState) Task=`6224d6c9-5dcb-4ed2-8948-ab47c49b2cda`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:58:07,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:58:07,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:58:07,728::task::974::TaskManager.Task::(_decref) Task=`6224d6c9-5dcb-4ed2-8948-ab47c49b2cda`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:07,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:58:07,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:58:07,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:58:07,751::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:07,764::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 16:58:08,478::task::579::TaskManager.Task::(_updateState) Task=`6edea28b-1084-42fd-9be9-89a18913ebd3`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:58:08,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:58:08,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:58:08,479::task::1168::TaskManager.Task::(prepare) Task=`6edea28b-1084-42fd-9be9-89a18913ebd3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:58:08,479::task::579::TaskManager.Task::(_updateState) Task=`6edea28b-1084-42fd-9be9-89a18913ebd3`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:58:08,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:58:08,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:58:08,479::task::974::TaskManager.Task::(_decref) Task=`6edea28b-1084-42fd-9be9-89a18913ebd3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:08,752::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 16:58:08,769::task::579::TaskManager.Task::(_updateState) Task=`41eb07ee-d8bf-4997-bf99-689868e2c409`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:58:08,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:58:08,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:58:08,771::task::1168::TaskManager.Task::(prepare) Task=`41eb07ee-d8bf-4997-bf99-689868e2c409`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:58:08,771::task::579::TaskManager.Task::(_updateState) Task=`41eb07ee-d8bf-4997-bf99-689868e2c409`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:58:08,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:58:08,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:58:08,772::task::974::TaskManager.Task::(_decref) Task=`41eb07ee-d8bf-4997-bf99-689868e2c409`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:58:08,772::task::579::TaskManager.Task::(_updateState) Task=`08905624-d0c6-48c0-b1ab-d0a16aa09422`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:58:08,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:58:08,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:58:08,773::task::1168::TaskManager.Task::(prepare) Task=`08905624-d0c6-48c0-b1ab-d0a16aa09422`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:58:08,773::task::579::TaskManager.Task::(_updateState) Task=`08905624-d0c6-48c0-b1ab-d0a16aa09422`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:58:08,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:58:08,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:58:08,773::task::974::TaskManager.Task::(_decref) Task=`08905624-d0c6-48c0-b1ab-d0a16aa09422`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:09,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:58:09,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:58:09,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:58:09,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:09,754::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:58:09,754::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 16:58:09,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:10,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:10,767::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:11,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:58:11,756::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:58:11,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:11,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 16:58:12,325::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:58:12,342::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000322731 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:58:12,587::task::579::TaskManager.Task::(_updateState) Task=`428b559b-1051-4457-84e0-1277a07a7a62`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:58:12,588::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:58:12,588::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:58:12,588::task::1168::TaskManager.Task::(prepare) Task=`428b559b-1051-4457-84e0-1277a07a7a62`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:58:12,589::task::579::TaskManager.Task::(_updateState) Task=`428b559b-1051-4457-84e0-1277a07a7a62`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:58:12,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:58:12,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:58:12,589::task::974::TaskManager.Task::(_decref) Task=`428b559b-1051-4457-84e0-1277a07a7a62`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:58:12,687::task::579::TaskManager.Task::(_updateState) Task=`d1dd257c-6e76-4951-8c9f-55b90e1e43c1`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:58:12,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:58:12,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:58:12,688::task::1168::TaskManager.Task::(prepare) Task=`d1dd257c-6e76-4951-8c9f-55b90e1e43c1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:58:12,688::task::579::TaskManager.Task::(_updateState) Task=`d1dd257c-6e76-4951-8c9f-55b90e1e43c1`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:58:12,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:58:12,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:58:12,690::task::974::TaskManager.Task::(_decref) Task=`d1dd257c-6e76-4951-8c9f-55b90e1e43c1`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:58:12,751::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:58:12,767::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:58:12,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:58:12,770::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:58:12,773::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0003368 s, 12.2 MB/s\n'; <rc> = 0 >Thread-17110::DEBUG::2014-01-16 16:58:13,630::task::579::TaskManager.Task::(_updateState) Task=`9109ef71-9449-4bb4-aa91-985e80b1a43b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:58:13,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:58:13,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:58:13,631::task::1168::TaskManager.Task::(prepare) Task=`9109ef71-9449-4bb4-aa91-985e80b1a43b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:58:13,631::task::579::TaskManager.Task::(_updateState) Task=`9109ef71-9449-4bb4-aa91-985e80b1a43b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:58:13,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:58:13,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:58:13,632::task::974::TaskManager.Task::(_decref) Task=`9109ef71-9449-4bb4-aa91-985e80b1a43b`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:58:13,632::task::579::TaskManager.Task::(_updateState) Task=`0e851aea-3217-41fb-8e6b-9d871671078b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:58:13,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 16:58:13,633::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:58:13,633::task::1168::TaskManager.Task::(prepare) Task=`0e851aea-3217-41fb-8e6b-9d871671078b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:58:13,633::task::579::TaskManager.Task::(_updateState) Task=`0e851aea-3217-41fb-8e6b-9d871671078b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:58:13,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:58:13,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:58:13,633::task::974::TaskManager.Task::(_decref) Task=`0e851aea-3217-41fb-8e6b-9d871671078b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:13,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:13,772::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:58:13,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:58:13,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:58:13,773::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:58:13,809::task::579::TaskManager.Task::(_updateState) Task=`a837f404-0feb-4a11-ae44-6e8154268b4c`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:58:13,809::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:58:13,809::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:58:13,810::task::1168::TaskManager.Task::(prepare) Task=`a837f404-0feb-4a11-ae44-6e8154268b4c`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:58:13,810::task::579::TaskManager.Task::(_updateState) Task=`a837f404-0feb-4a11-ae44-6e8154268b4c`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:58:13,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:58:13,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:58:13,810::task::974::TaskManager.Task::(_decref) Task=`a837f404-0feb-4a11-ae44-6e8154268b4c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:58:13,947::task::579::TaskManager.Task::(_updateState) Task=`94b89de6-019a-4d35-ae9d-a6e757b40426`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:58:13,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:58:13,947::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:58:13,947::task::1168::TaskManager.Task::(prepare) Task=`94b89de6-019a-4d35-ae9d-a6e757b40426`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:58:13,948::task::579::TaskManager.Task::(_updateState) Task=`94b89de6-019a-4d35-ae9d-a6e757b40426`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:58:13,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:58:13,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:58:13,948::task::974::TaskManager.Task::(_decref) Task=`94b89de6-019a-4d35-ae9d-a6e757b40426`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:58:13,948::task::579::TaskManager.Task::(_updateState) Task=`b83d86e6-34fa-4417-b7b4-b414605d79f2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:58:13,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:58:13,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:58:13,949::task::1168::TaskManager.Task::(prepare) Task=`b83d86e6-34fa-4417-b7b4-b414605d79f2`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:58:13,949::task::579::TaskManager.Task::(_updateState) Task=`b83d86e6-34fa-4417-b7b4-b414605d79f2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:58:13,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:58:13,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:58:13,950::task::974::TaskManager.Task::(_decref) Task=`b83d86e6-34fa-4417-b7b4-b414605d79f2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:58:13,950::task::579::TaskManager.Task::(_updateState) Task=`5295aed2-597d-4647-a648-a098af3d1d9e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:58:13,950::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:58:13,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:58:13,951::task::1168::TaskManager.Task::(prepare) Task=`5295aed2-597d-4647-a648-a098af3d1d9e`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:58:13,951::task::579::TaskManager.Task::(_updateState) Task=`5295aed2-597d-4647-a648-a098af3d1d9e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:58:13,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:58:13,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:58:13,951::task::974::TaskManager.Task::(_decref) Task=`5295aed2-597d-4647-a648-a098af3d1d9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:14,774::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:58:14,815::task::579::TaskManager.Task::(_updateState) Task=`db736743-daf9-4cb7-b5a4-b6c479953868`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:58:14,815::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:58:14,815::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:58:14,816::task::1168::TaskManager.Task::(prepare) Task=`db736743-daf9-4cb7-b5a4-b6c479953868`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:58:14,816::task::579::TaskManager.Task::(_updateState) Task=`db736743-daf9-4cb7-b5a4-b6c479953868`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:58:14,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:58:14,816::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:58:14,816::task::974::TaskManager.Task::(_decref) Task=`db736743-daf9-4cb7-b5a4-b6c479953868`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:15,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:15,772::task::579::TaskManager.Task::(_updateState) Task=`e2abf814-d9c0-4ca5-8784-1f53d4b2435d`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:58:15,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:58:15,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:58:15,773::task::1168::TaskManager.Task::(prepare) Task=`e2abf814-d9c0-4ca5-8784-1f53d4b2435d`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:58:15,773::task::579::TaskManager.Task::(_updateState) Task=`e2abf814-d9c0-4ca5-8784-1f53d4b2435d`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:58:15,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:58:15,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:58:15,774::task::974::TaskManager.Task::(_decref) Task=`e2abf814-d9c0-4ca5-8784-1f53d4b2435d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:15,775::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:58:15,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:15,776::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:58:15,776::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:58:15,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:15,779::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:15,780::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:16,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:17,778::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:17,781::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 16:58:18,101::task::579::TaskManager.Task::(_updateState) Task=`7cb8af60-8105-4116-aa8d-e74057d54a78`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:58:18,101::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:58:18,101::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:58:18,102::task::1168::TaskManager.Task::(prepare) Task=`7cb8af60-8105-4116-aa8d-e74057d54a78`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:58:18,102::task::579::TaskManager.Task::(_updateState) Task=`7cb8af60-8105-4116-aa8d-e74057d54a78`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:58:18,102::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:58:18,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:58:18,102::task::974::TaskManager.Task::(_decref) Task=`7cb8af60-8105-4116-aa8d-e74057d54a78`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:58:18,442::task::579::TaskManager.Task::(_updateState) Task=`e8742318-3ccd-4d76-bd72-4c442baee2df`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:58:18,443::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:58:18,443::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:58:18,443::task::1168::TaskManager.Task::(prepare) Task=`e8742318-3ccd-4d76-bd72-4c442baee2df`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:58:18,443::task::579::TaskManager.Task::(_updateState) Task=`e8742318-3ccd-4d76-bd72-4c442baee2df`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:58:18,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:58:18,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:58:18,444::task::974::TaskManager.Task::(_decref) Task=`e8742318-3ccd-4d76-bd72-4c442baee2df`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:18,779::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:19,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:19,782::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:20,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:20,783::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 16:58:21,509::task::579::TaskManager.Task::(_updateState) Task=`98ebb76f-e83e-4518-ab7c-85124d4c07a3`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:58:21,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:58:21,509::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:58:21,509::task::1168::TaskManager.Task::(prepare) Task=`98ebb76f-e83e-4518-ab7c-85124d4c07a3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:58:21,510::task::579::TaskManager.Task::(_updateState) Task=`98ebb76f-e83e-4518-ab7c-85124d4c07a3`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:58:21,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:58:21,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:58:21,510::task::974::TaskManager.Task::(_decref) Task=`98ebb76f-e83e-4518-ab7c-85124d4c07a3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:21,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:58:21,783::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:21,785::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287344::DEBUG::2014-01-16 16:58:21,809::task::579::TaskManager.Task::(_updateState) Task=`d8f9f8c9-6e60-45fd-8f82-f9a6fe50c3a4`::moving from state init -> state preparing >Thread-287344::INFO::2014-01-16 16:58:21,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287344::INFO::2014-01-16 16:58:21,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322731', 'lastCheck': '9.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003368', 'lastCheck': '9.0', 'valid': True}} >Thread-287344::DEBUG::2014-01-16 16:58:21,809::task::1168::TaskManager.Task::(prepare) Task=`d8f9f8c9-6e60-45fd-8f82-f9a6fe50c3a4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322731', 'lastCheck': '9.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003368', 'lastCheck': '9.0', 'valid': True}} >Thread-287344::DEBUG::2014-01-16 16:58:21,809::task::579::TaskManager.Task::(_updateState) Task=`d8f9f8c9-6e60-45fd-8f82-f9a6fe50c3a4`::moving from state preparing -> state finished >Thread-287344::DEBUG::2014-01-16 16:58:21,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287344::DEBUG::2014-01-16 16:58:21,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287344::DEBUG::2014-01-16 16:58:21,810::task::974::TaskManager.Task::(_decref) Task=`d8f9f8c9-6e60-45fd-8f82-f9a6fe50c3a4`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:58:22,352::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:58:22,373::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271319 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:58:22,779::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:58:22,796::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:58:22,799::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000190863 s, 21.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:58:23,787::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:23,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:24,800::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:25,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:25,794::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:25,801::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 16:58:26,290::task::579::TaskManager.Task::(_updateState) Task=`47f3da9a-316e-4398-86dd-e549a15e669a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:58:26,290::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:58:26,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:58:26,291::task::1168::TaskManager.Task::(prepare) Task=`47f3da9a-316e-4398-86dd-e549a15e669a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:58:26,292::task::579::TaskManager.Task::(_updateState) Task=`47f3da9a-316e-4398-86dd-e549a15e669a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:58:26,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:58:26,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:58:26,292::task::974::TaskManager.Task::(_decref) Task=`47f3da9a-316e-4398-86dd-e549a15e669a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:26,802::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:58:26,803::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:58:26,803::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:27,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:27,803::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:58:27,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:28,805::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:58:28,805::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:58:28,805::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:58:29,397::task::579::TaskManager.Task::(_updateState) Task=`2869d83c-a200-4814-8619-39fac66caa3b`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:58:29,397::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:58:29,398::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:58:29,398::task::1168::TaskManager.Task::(prepare) Task=`2869d83c-a200-4814-8619-39fac66caa3b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:58:29,398::task::579::TaskManager.Task::(_updateState) Task=`2869d83c-a200-4814-8619-39fac66caa3b`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:58:29,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:58:29,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:58:29,398::task::974::TaskManager.Task::(_decref) Task=`2869d83c-a200-4814-8619-39fac66caa3b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:29,797::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:29,807::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:58:29,807::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:30,800::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:58:30,800::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:58:30,807::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:30,808::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:58:30,808::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:31,808::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:31,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:58:32,381::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:58:32,398::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297032 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:58:32,806::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:58:32,824::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:58:32,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:58:32,828::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000294941 s, 13.9 MB/s\n'; <rc> = 0 >Thread-48925::DEBUG::2014-01-16 16:58:32,969::task::579::TaskManager.Task::(_updateState) Task=`c81246eb-a8be-4025-9e7b-f395cff8a7cb`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:58:32,970::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:58:32,970::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:58:32,970::task::1168::TaskManager.Task::(prepare) Task=`c81246eb-a8be-4025-9e7b-f395cff8a7cb`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:58:32,970::task::579::TaskManager.Task::(_updateState) Task=`c81246eb-a8be-4025-9e7b-f395cff8a7cb`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:58:32,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:58:32,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:58:32,971::task::974::TaskManager.Task::(_decref) Task=`c81246eb-a8be-4025-9e7b-f395cff8a7cb`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:58:32,971::task::579::TaskManager.Task::(_updateState) Task=`8ef66dac-0eed-4218-9763-0831c1a16034`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:58:32,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:58:32,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:58:32,972::task::1168::TaskManager.Task::(prepare) Task=`8ef66dac-0eed-4218-9763-0831c1a16034`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:58:32,972::task::579::TaskManager.Task::(_updateState) Task=`8ef66dac-0eed-4218-9763-0831c1a16034`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:58:32,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:58:32,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:58:32,973::task::974::TaskManager.Task::(_decref) Task=`8ef66dac-0eed-4218-9763-0831c1a16034`::ref 0 aborting False >Thread-3175::DEBUG::2014-01-16 16:58:33,061::task::579::TaskManager.Task::(_updateState) Task=`19d5952b-888c-4d4c-b971-14b8dbdcf351`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:58:33,062::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:58:33,062::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:58:33,062::task::1168::TaskManager.Task::(prepare) Task=`19d5952b-888c-4d4c-b971-14b8dbdcf351`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:58:33,062::task::579::TaskManager.Task::(_updateState) Task=`19d5952b-888c-4d4c-b971-14b8dbdcf351`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:58:33,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:58:33,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:58:33,063::task::974::TaskManager.Task::(_decref) Task=`19d5952b-888c-4d4c-b971-14b8dbdcf351`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:58:33,084::task::579::TaskManager.Task::(_updateState) Task=`63482a6d-3c11-466e-bfb3-d3f08d236988`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:58:33,084::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:58:33,085::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:58:33,085::task::1168::TaskManager.Task::(prepare) Task=`63482a6d-3c11-466e-bfb3-d3f08d236988`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:58:33,085::task::579::TaskManager.Task::(_updateState) Task=`63482a6d-3c11-466e-bfb3-d3f08d236988`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:58:33,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:58:33,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:58:33,086::task::974::TaskManager.Task::(_decref) Task=`63482a6d-3c11-466e-bfb3-d3f08d236988`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:33,809::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:33,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:58:33,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:34,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:58:34,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:58:34,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:58:34,830::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:35,811::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:35,812::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:35,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:58:35,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:58:35,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:36,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:58:36,832::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:37,813::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:37,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:58:37,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:58:37,833::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:58:37,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:58:38,165::task::579::TaskManager.Task::(_updateState) Task=`309a90c7-0689-42f3-9407-1aa2e77c608f`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:58:38,166::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:58:38,166::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:58:38,166::task::1168::TaskManager.Task::(prepare) Task=`309a90c7-0689-42f3-9407-1aa2e77c608f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:58:38,166::task::579::TaskManager.Task::(_updateState) Task=`309a90c7-0689-42f3-9407-1aa2e77c608f`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:58:38,166::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:58:38,166::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:58:38,167::task::974::TaskManager.Task::(_decref) Task=`309a90c7-0689-42f3-9407-1aa2e77c608f`::ref 0 aborting False >Thread-287350::DEBUG::2014-01-16 16:58:38,480::task::579::TaskManager.Task::(_updateState) Task=`134e150f-3cb6-40ab-8396-559daff5e229`::moving from state init -> state preparing >Thread-287350::INFO::2014-01-16 16:58:38,481::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287350::INFO::2014-01-16 16:58:38,481::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297032', 'lastCheck': '6.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294941', 'lastCheck': '5.6', 'valid': True}} >Thread-287350::DEBUG::2014-01-16 16:58:38,481::task::1168::TaskManager.Task::(prepare) Task=`134e150f-3cb6-40ab-8396-559daff5e229`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297032', 'lastCheck': '6.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294941', 'lastCheck': '5.6', 'valid': True}} >Thread-287350::DEBUG::2014-01-16 16:58:38,481::task::579::TaskManager.Task::(_updateState) Task=`134e150f-3cb6-40ab-8396-559daff5e229`::moving from state preparing -> state finished >Thread-287350::DEBUG::2014-01-16 16:58:38,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287350::DEBUG::2014-01-16 16:58:38,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287350::DEBUG::2014-01-16 16:58:38,482::task::974::TaskManager.Task::(_decref) Task=`134e150f-3cb6-40ab-8396-559daff5e229`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:38,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:39,815::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:39,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:58:39,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:58:39,836::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:58:39,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:39,836::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:58:39,837::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-3168::DEBUG::2014-01-16 16:58:40,565::task::579::TaskManager.Task::(_updateState) Task=`6610b5b6-e256-4299-b5ac-e43254854ba6`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:58:40,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:58:40,566::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:58:40,566::task::1168::TaskManager.Task::(prepare) Task=`6610b5b6-e256-4299-b5ac-e43254854ba6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:58:40,566::task::579::TaskManager.Task::(_updateState) Task=`6610b5b6-e256-4299-b5ac-e43254854ba6`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:58:40,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:58:40,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:58:40,566::task::974::TaskManager.Task::(_decref) Task=`6610b5b6-e256-4299-b5ac-e43254854ba6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:40,818::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:40,838::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:58:41,512::task::579::TaskManager.Task::(_updateState) Task=`e3000478-bc6a-4d07-937e-dac47f5e35d9`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:58:41,512::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:58:41,512::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:58:41,513::task::1168::TaskManager.Task::(prepare) Task=`e3000478-bc6a-4d07-937e-dac47f5e35d9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:58:41,513::task::579::TaskManager.Task::(_updateState) Task=`e3000478-bc6a-4d07-937e-dac47f5e35d9`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:58:41,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:58:41,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:58:41,513::task::974::TaskManager.Task::(_decref) Task=`e3000478-bc6a-4d07-937e-dac47f5e35d9`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:58:41,559::task::579::TaskManager.Task::(_updateState) Task=`d7e16b1c-3b92-4d24-9173-34b3aa5c1b61`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:58:41,559::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:58:41,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:58:41,560::task::1168::TaskManager.Task::(prepare) Task=`d7e16b1c-3b92-4d24-9173-34b3aa5c1b61`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:58:41,560::task::579::TaskManager.Task::(_updateState) Task=`d7e16b1c-3b92-4d24-9173-34b3aa5c1b61`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:58:41,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:58:41,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:58:41,560::task::974::TaskManager.Task::(_decref) Task=`d7e16b1c-3b92-4d24-9173-34b3aa5c1b61`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:58:41,568::task::579::TaskManager.Task::(_updateState) Task=`51aef393-82dc-47c8-982a-a61d6f0d02f4`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:58:41,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:58:41,568::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:58:41,568::task::1168::TaskManager.Task::(prepare) Task=`51aef393-82dc-47c8-982a-a61d6f0d02f4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:58:41,568::task::579::TaskManager.Task::(_updateState) Task=`51aef393-82dc-47c8-982a-a61d6f0d02f4`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:58:41,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:58:41,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:58:41,569::task::974::TaskManager.Task::(_decref) Task=`51aef393-82dc-47c8-982a-a61d6f0d02f4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:41,820::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:41,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:58:41,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:58:41,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:58:42,236::task::579::TaskManager.Task::(_updateState) Task=`47e4a2ec-e6f3-4ac2-8192-a56f895b5669`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:58:42,236::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:58:42,237::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:58:42,237::task::1168::TaskManager.Task::(prepare) Task=`47e4a2ec-e6f3-4ac2-8192-a56f895b5669`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:58:42,237::task::579::TaskManager.Task::(_updateState) Task=`47e4a2ec-e6f3-4ac2-8192-a56f895b5669`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:58:42,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:58:42,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:58:42,237::task::974::TaskManager.Task::(_decref) Task=`47e4a2ec-e6f3-4ac2-8192-a56f895b5669`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:58:42,405::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:58:42,422::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000304736 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:58:42,563::task::579::TaskManager.Task::(_updateState) Task=`2d4890f6-69a3-4f42-822e-359f577f915e`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:58:42,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:58:42,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:58:42,563::task::1168::TaskManager.Task::(prepare) Task=`2d4890f6-69a3-4f42-822e-359f577f915e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:58:42,564::task::579::TaskManager.Task::(_updateState) Task=`2d4890f6-69a3-4f42-822e-359f577f915e`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:58:42,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:58:42,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:58:42,564::task::974::TaskManager.Task::(_decref) Task=`2d4890f6-69a3-4f42-822e-359f577f915e`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:58:42,834::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:58:42,849::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:58:42,852::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:58:42,854::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:58:42,856::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000236216 s, 17.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:58:43,822::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:43,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:58:43,857::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:58:43,857::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:58:43,857::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:44,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:45,823::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:45,826::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:58:45,826::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:58:45,827::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:45,858::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:58:45,859::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:46,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:58:47,803::task::579::TaskManager.Task::(_updateState) Task=`13e5da42-4c0d-49b7-ade1-cdebd07527b6`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:58:47,804::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:58:47,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:58:47,805::task::1168::TaskManager.Task::(prepare) Task=`13e5da42-4c0d-49b7-ade1-cdebd07527b6`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:58:47,805::task::579::TaskManager.Task::(_updateState) Task=`13e5da42-4c0d-49b7-ade1-cdebd07527b6`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:58:47,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:58:47,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:58:47,806::task::974::TaskManager.Task::(_decref) Task=`13e5da42-4c0d-49b7-ade1-cdebd07527b6`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:58:47,806::task::579::TaskManager.Task::(_updateState) Task=`53f9a2a3-7cff-4757-92d0-32254ca98b95`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:58:47,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:58:47,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:58:47,806::task::1168::TaskManager.Task::(prepare) Task=`53f9a2a3-7cff-4757-92d0-32254ca98b95`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:58:47,806::task::579::TaskManager.Task::(_updateState) Task=`53f9a2a3-7cff-4757-92d0-32254ca98b95`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:58:47,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:58:47,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:58:47,807::task::974::TaskManager.Task::(_decref) Task=`53f9a2a3-7cff-4757-92d0-32254ca98b95`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:58:47,807::task::579::TaskManager.Task::(_updateState) Task=`5cf619b7-1258-4924-ba79-3f6c7d5a5393`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:58:47,807::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:58:47,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:58:47,808::task::1168::TaskManager.Task::(prepare) Task=`5cf619b7-1258-4924-ba79-3f6c7d5a5393`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:58:47,808::task::579::TaskManager.Task::(_updateState) Task=`5cf619b7-1258-4924-ba79-3f6c7d5a5393`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:58:47,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:58:47,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:58:47,808::task::974::TaskManager.Task::(_decref) Task=`5cf619b7-1258-4924-ba79-3f6c7d5a5393`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:47,828::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:47,861::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:48,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:49,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:49,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:58:50,156::task::579::TaskManager.Task::(_updateState) Task=`0bfcbc02-c67f-4656-a4e0-f122ba0a502e`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:58:50,156::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:58:50,156::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:58:50,156::task::1168::TaskManager.Task::(prepare) Task=`0bfcbc02-c67f-4656-a4e0-f122ba0a502e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:58:50,157::task::579::TaskManager.Task::(_updateState) Task=`0bfcbc02-c67f-4656-a4e0-f122ba0a502e`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:58:50,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:58:50,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:58:50,157::task::974::TaskManager.Task::(_decref) Task=`0bfcbc02-c67f-4656-a4e0-f122ba0a502e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:50,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:50,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:51,832::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:51,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:58:51,867::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:58:52,430::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:58:52,447::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292428 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:58:52,862::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:58:52,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:58:52,882::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000189406 s, 21.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:58:53,834::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:53,881::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287356::DEBUG::2014-01-16 16:58:54,388::task::579::TaskManager.Task::(_updateState) Task=`df0db987-f231-4997-b69c-839e229a4439`::moving from state init -> state preparing >Thread-287356::INFO::2014-01-16 16:58:54,388::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287356::INFO::2014-01-16 16:58:54,389::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292428', 'lastCheck': '1.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000189406', 'lastCheck': '1.5', 'valid': True}} >Thread-287356::DEBUG::2014-01-16 16:58:54,389::task::1168::TaskManager.Task::(prepare) Task=`df0db987-f231-4997-b69c-839e229a4439`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000292428', 'lastCheck': '1.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000189406', 'lastCheck': '1.5', 'valid': True}} >Thread-287356::DEBUG::2014-01-16 16:58:54,389::task::579::TaskManager.Task::(_updateState) Task=`df0db987-f231-4997-b69c-839e229a4439`::moving from state preparing -> state finished >Thread-287356::DEBUG::2014-01-16 16:58:54,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287356::DEBUG::2014-01-16 16:58:54,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287356::DEBUG::2014-01-16 16:58:54,389::task::974::TaskManager.Task::(_decref) Task=`df0db987-f231-4997-b69c-839e229a4439`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:58:54,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:58:55,069::task::579::TaskManager.Task::(_updateState) Task=`95695fdc-019a-4d93-8088-80ba82fbef4c`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:58:55,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:58:55,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:58:55,070::task::1168::TaskManager.Task::(prepare) Task=`95695fdc-019a-4d93-8088-80ba82fbef4c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:58:55,070::task::579::TaskManager.Task::(_updateState) Task=`95695fdc-019a-4d93-8088-80ba82fbef4c`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:58:55,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:58:55,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:58:55,071::task::974::TaskManager.Task::(_decref) Task=`95695fdc-019a-4d93-8088-80ba82fbef4c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:58:55,835::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:58:55,836::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:55,884::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:56,885::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:58:56,885::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:58:56,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:57,837::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:57,886::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:58:57,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:58:58,887::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:58:58,887::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:58:58,888::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:58:59,839::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:58:59,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:58:59,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:00,841::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:59:00,841::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:59:00,843::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:00,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:59:00,890::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 16:59:01,555::task::579::TaskManager.Task::(_updateState) Task=`91291194-9e57-497e-8419-a284f09c8a65`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 16:59:01,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 16:59:01,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:59:01,555::task::1168::TaskManager.Task::(prepare) Task=`91291194-9e57-497e-8419-a284f09c8a65`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 16:59:01,556::task::579::TaskManager.Task::(_updateState) Task=`91291194-9e57-497e-8419-a284f09c8a65`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 16:59:01,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 16:59:01,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 16:59:01,556::task::974::TaskManager.Task::(_decref) Task=`91291194-9e57-497e-8419-a284f09c8a65`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:01,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:01,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:59:02,455::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:59:02,472::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000311745 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:59:02,887::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:59:02,902::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:59:02,904::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:59:02,906::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000217026 s, 18.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:59:03,845::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:03,905::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:59:03,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:04,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:59:04,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:59:04,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:59:04,907::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:05,846::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:05,848::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:05,908::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:59:05,908::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:59:05,909::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:06,910::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:59:06,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 16:59:07,052::task::579::TaskManager.Task::(_updateState) Task=`ceb797e3-4053-4ef5-a4cb-700a2aebfcd0`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 16:59:07,052::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 16:59:07,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:59:07,054::task::1168::TaskManager.Task::(prepare) Task=`ceb797e3-4053-4ef5-a4cb-700a2aebfcd0`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 16:59:07,054::task::579::TaskManager.Task::(_updateState) Task=`ceb797e3-4053-4ef5-a4cb-700a2aebfcd0`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 16:59:07,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 16:59:07,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 16:59:07,054::task::974::TaskManager.Task::(_decref) Task=`ceb797e3-4053-4ef5-a4cb-700a2aebfcd0`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 16:59:07,064::task::579::TaskManager.Task::(_updateState) Task=`065d852d-ddfa-488f-8cf9-08ad6b5e30dd`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 16:59:07,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 16:59:07,065::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:59:07,065::task::1168::TaskManager.Task::(prepare) Task=`065d852d-ddfa-488f-8cf9-08ad6b5e30dd`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 16:59:07,065::task::579::TaskManager.Task::(_updateState) Task=`065d852d-ddfa-488f-8cf9-08ad6b5e30dd`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 16:59:07,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 16:59:07,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 16:59:07,065::task::974::TaskManager.Task::(_decref) Task=`065d852d-ddfa-488f-8cf9-08ad6b5e30dd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:07,849::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:07,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:59:07,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:59:07,912::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:59:07,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 16:59:07,950::task::579::TaskManager.Task::(_updateState) Task=`3dcd93a4-2344-4255-ab6f-673001d65365`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:59:07,950::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 16:59:07,951::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:59:07,951::task::1168::TaskManager.Task::(prepare) Task=`3dcd93a4-2344-4255-ab6f-673001d65365`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 16:59:07,951::task::579::TaskManager.Task::(_updateState) Task=`3dcd93a4-2344-4255-ab6f-673001d65365`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:59:07,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:59:07,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:59:07,951::task::974::TaskManager.Task::(_decref) Task=`3dcd93a4-2344-4255-ab6f-673001d65365`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 16:59:07,952::task::579::TaskManager.Task::(_updateState) Task=`bb5aba7f-7f69-486d-8bc0-dc2100a07519`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 16:59:07,952::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 16:59:07,952::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:59:07,952::task::1168::TaskManager.Task::(prepare) Task=`bb5aba7f-7f69-486d-8bc0-dc2100a07519`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 16:59:07,952::task::579::TaskManager.Task::(_updateState) Task=`bb5aba7f-7f69-486d-8bc0-dc2100a07519`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 16:59:07,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 16:59:07,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 16:59:07,953::task::974::TaskManager.Task::(_decref) Task=`bb5aba7f-7f69-486d-8bc0-dc2100a07519`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 16:59:08,662::task::579::TaskManager.Task::(_updateState) Task=`b2933f47-4e6b-431b-8be7-e3916cac2c82`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 16:59:08,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 16:59:08,663::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:59:08,663::task::1168::TaskManager.Task::(prepare) Task=`b2933f47-4e6b-431b-8be7-e3916cac2c82`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 16:59:08,663::task::579::TaskManager.Task::(_updateState) Task=`b2933f47-4e6b-431b-8be7-e3916cac2c82`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 16:59:08,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 16:59:08,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 16:59:08,663::task::974::TaskManager.Task::(_decref) Task=`b2933f47-4e6b-431b-8be7-e3916cac2c82`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:59:08,866::task::579::TaskManager.Task::(_updateState) Task=`40190248-959b-4fdc-b2a4-d285720fc8e5`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:59:08,866::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 16:59:08,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:59:08,867::task::1168::TaskManager.Task::(prepare) Task=`40190248-959b-4fdc-b2a4-d285720fc8e5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 16:59:08,867::task::579::TaskManager.Task::(_updateState) Task=`40190248-959b-4fdc-b2a4-d285720fc8e5`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:59:08,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:59:08,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:59:08,867::task::974::TaskManager.Task::(_decref) Task=`40190248-959b-4fdc-b2a4-d285720fc8e5`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 16:59:08,867::task::579::TaskManager.Task::(_updateState) Task=`18b047c7-1758-4417-9b82-f9ead2f59727`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 16:59:08,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 16:59:08,868::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:59:08,868::task::1168::TaskManager.Task::(prepare) Task=`18b047c7-1758-4417-9b82-f9ead2f59727`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 16:59:08,868::task::579::TaskManager.Task::(_updateState) Task=`18b047c7-1758-4417-9b82-f9ead2f59727`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 16:59:08,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 16:59:08,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 16:59:08,868::task::974::TaskManager.Task::(_decref) Task=`18b047c7-1758-4417-9b82-f9ead2f59727`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:08,913::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:09,850::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:09,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:59:09,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:59:09,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:59:09,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:09,914::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:59:09,915::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-287362::DEBUG::2014-01-16 16:59:10,298::task::579::TaskManager.Task::(_updateState) Task=`0ff5b29f-c3a1-4fc6-a8d8-f1bb1bef3959`::moving from state init -> state preparing >Thread-287362::INFO::2014-01-16 16:59:10,298::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287362::INFO::2014-01-16 16:59:10,298::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311745', 'lastCheck': '7.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000217026', 'lastCheck': '7.4', 'valid': True}} >Thread-287362::DEBUG::2014-01-16 16:59:10,298::task::1168::TaskManager.Task::(prepare) Task=`0ff5b29f-c3a1-4fc6-a8d8-f1bb1bef3959`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311745', 'lastCheck': '7.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000217026', 'lastCheck': '7.4', 'valid': True}} >Thread-287362::DEBUG::2014-01-16 16:59:10,299::task::579::TaskManager.Task::(_updateState) Task=`0ff5b29f-c3a1-4fc6-a8d8-f1bb1bef3959`::moving from state preparing -> state finished >Thread-287362::DEBUG::2014-01-16 16:59:10,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287362::DEBUG::2014-01-16 16:59:10,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287362::DEBUG::2014-01-16 16:59:10,299::task::974::TaskManager.Task::(_decref) Task=`0ff5b29f-c3a1-4fc6-a8d8-f1bb1bef3959`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:10,852::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:10,916::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:11,853::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:11,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:59:11,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:59:11,918::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:59:12,480::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:59:12,496::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000338269 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 16:59:12,726::task::579::TaskManager.Task::(_updateState) Task=`236fdab2-9215-4b0e-b916-9e9dace41bae`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 16:59:12,726::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 16:59:12,727::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:59:12,727::task::1168::TaskManager.Task::(prepare) Task=`236fdab2-9215-4b0e-b916-9e9dace41bae`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 16:59:12,727::task::579::TaskManager.Task::(_updateState) Task=`236fdab2-9215-4b0e-b916-9e9dace41bae`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 16:59:12,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 16:59:12,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 16:59:12,728::task::974::TaskManager.Task::(_decref) Task=`236fdab2-9215-4b0e-b916-9e9dace41bae`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 16:59:12,859::task::579::TaskManager.Task::(_updateState) Task=`84e8b61f-1c0f-470e-9cf0-71e6934a9a88`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 16:59:12,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 16:59:12,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:59:12,860::task::1168::TaskManager.Task::(prepare) Task=`84e8b61f-1c0f-470e-9cf0-71e6934a9a88`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 16:59:12,860::task::579::TaskManager.Task::(_updateState) Task=`84e8b61f-1c0f-470e-9cf0-71e6934a9a88`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 16:59:12,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 16:59:12,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 16:59:12,861::task::974::TaskManager.Task::(_decref) Task=`84e8b61f-1c0f-470e-9cf0-71e6934a9a88`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:59:12,912::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:59:12,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:59:12,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:59:12,932::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:59:12,934::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000214741 s, 19.1 MB/s\n'; <rc> = 0 >Thread-17110::DEBUG::2014-01-16 16:59:13,852::task::579::TaskManager.Task::(_updateState) Task=`7bb3782c-4fab-4f14-a27a-875da4e189f4`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:59:13,853::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 16:59:13,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:59:13,853::task::1168::TaskManager.Task::(prepare) Task=`7bb3782c-4fab-4f14-a27a-875da4e189f4`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 16:59:13,853::task::579::TaskManager.Task::(_updateState) Task=`7bb3782c-4fab-4f14-a27a-875da4e189f4`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:59:13,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:59:13,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:59:13,854::task::974::TaskManager.Task::(_decref) Task=`7bb3782c-4fab-4f14-a27a-875da4e189f4`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 16:59:13,854::task::579::TaskManager.Task::(_updateState) Task=`82bd2c00-0e3b-443d-a33b-bf1334c60f4f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 16:59:13,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-189817::DEBUG::2014-01-16 16:59:13,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::INFO::2014-01-16 16:59:13,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:59:13,856::task::1168::TaskManager.Task::(prepare) Task=`82bd2c00-0e3b-443d-a33b-bf1334c60f4f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 16:59:13,856::task::579::TaskManager.Task::(_updateState) Task=`82bd2c00-0e3b-443d-a33b-bf1334c60f4f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 16:59:13,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 16:59:13,857::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 16:59:13,857::task::974::TaskManager.Task::(_decref) Task=`82bd2c00-0e3b-443d-a33b-bf1334c60f4f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:13,934::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:59:13,934::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:59:13,934::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:59:13,935::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 16:59:13,976::task::579::TaskManager.Task::(_updateState) Task=`7a3998b8-b1be-4335-bbd3-05f76c64763c`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 16:59:13,976::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 16:59:13,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:59:13,977::task::1168::TaskManager.Task::(prepare) Task=`7a3998b8-b1be-4335-bbd3-05f76c64763c`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 16:59:13,977::task::579::TaskManager.Task::(_updateState) Task=`7a3998b8-b1be-4335-bbd3-05f76c64763c`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 16:59:13,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 16:59:13,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 16:59:13,977::task::974::TaskManager.Task::(_decref) Task=`7a3998b8-b1be-4335-bbd3-05f76c64763c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:59:14,536::task::579::TaskManager.Task::(_updateState) Task=`585bbe8a-8efc-4372-bcdb-9633838dca4e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:59:14,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 16:59:14,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:59:14,537::task::1168::TaskManager.Task::(prepare) Task=`585bbe8a-8efc-4372-bcdb-9633838dca4e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 16:59:14,537::task::579::TaskManager.Task::(_updateState) Task=`585bbe8a-8efc-4372-bcdb-9633838dca4e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:59:14,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:59:14,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:59:14,538::task::974::TaskManager.Task::(_decref) Task=`585bbe8a-8efc-4372-bcdb-9633838dca4e`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:59:14,538::task::579::TaskManager.Task::(_updateState) Task=`59237cee-6de0-462a-a259-c42ddc125b32`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:59:14,538::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 16:59:14,538::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:59:14,538::task::1168::TaskManager.Task::(prepare) Task=`59237cee-6de0-462a-a259-c42ddc125b32`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 16:59:14,539::task::579::TaskManager.Task::(_updateState) Task=`59237cee-6de0-462a-a259-c42ddc125b32`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:59:14,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:59:14,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:59:14,539::task::974::TaskManager.Task::(_decref) Task=`59237cee-6de0-462a-a259-c42ddc125b32`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 16:59:14,539::task::579::TaskManager.Task::(_updateState) Task=`9db459c5-2d27-457a-888f-627e766c3902`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 16:59:14,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 16:59:14,540::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:59:14,540::task::1168::TaskManager.Task::(prepare) Task=`9db459c5-2d27-457a-888f-627e766c3902`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 16:59:14,540::task::579::TaskManager.Task::(_updateState) Task=`9db459c5-2d27-457a-888f-627e766c3902`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 16:59:14,540::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 16:59:14,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 16:59:14,540::task::974::TaskManager.Task::(_decref) Task=`9db459c5-2d27-457a-888f-627e766c3902`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:14,936::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 16:59:14,984::task::579::TaskManager.Task::(_updateState) Task=`534aac62-542f-49b3-bed9-d4b6d22fc6ec`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 16:59:14,985::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 16:59:14,985::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:59:14,985::task::1168::TaskManager.Task::(prepare) Task=`534aac62-542f-49b3-bed9-d4b6d22fc6ec`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 16:59:14,985::task::579::TaskManager.Task::(_updateState) Task=`534aac62-542f-49b3-bed9-d4b6d22fc6ec`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 16:59:14,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 16:59:14,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 16:59:14,986::task::974::TaskManager.Task::(_decref) Task=`534aac62-542f-49b3-bed9-d4b6d22fc6ec`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:15,857::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:15,858::task::579::TaskManager.Task::(_updateState) Task=`51861e0f-01a1-4917-bb57-3f951f4e5168`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 16:59:15,858::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 16:59:15,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:59:15,858::task::1168::TaskManager.Task::(prepare) Task=`51861e0f-01a1-4917-bb57-3f951f4e5168`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 16:59:15,858::task::579::TaskManager.Task::(_updateState) Task=`51861e0f-01a1-4917-bb57-3f951f4e5168`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 16:59:15,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 16:59:15,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 16:59:15,859::task::974::TaskManager.Task::(_decref) Task=`51861e0f-01a1-4917-bb57-3f951f4e5168`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:15,860::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:59:15,861::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:59:15,863::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:15,865::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:15,865::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:15,937::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:59:15,937::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:16,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:17,866::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:17,940::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 16:59:18,274::task::579::TaskManager.Task::(_updateState) Task=`cc4f3e97-8ce7-4eba-ba3d-0e3dfd9a1633`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 16:59:18,275::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 16:59:18,275::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:59:18,275::task::1168::TaskManager.Task::(prepare) Task=`cc4f3e97-8ce7-4eba-ba3d-0e3dfd9a1633`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 16:59:18,275::task::579::TaskManager.Task::(_updateState) Task=`cc4f3e97-8ce7-4eba-ba3d-0e3dfd9a1633`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 16:59:18,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 16:59:18,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 16:59:18,276::task::974::TaskManager.Task::(_decref) Task=`cc4f3e97-8ce7-4eba-ba3d-0e3dfd9a1633`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 16:59:18,528::task::579::TaskManager.Task::(_updateState) Task=`c83cf6e6-a537-442b-850f-5cfcc395dc86`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 16:59:18,528::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 16:59:18,528::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:59:18,528::task::1168::TaskManager.Task::(prepare) Task=`c83cf6e6-a537-442b-850f-5cfcc395dc86`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 16:59:18,529::task::579::TaskManager.Task::(_updateState) Task=`c83cf6e6-a537-442b-850f-5cfcc395dc86`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 16:59:18,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 16:59:18,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 16:59:18,529::task::974::TaskManager.Task::(_decref) Task=`c83cf6e6-a537-442b-850f-5cfcc395dc86`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:18,941::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:19,868::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:19,943::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:20,869::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:20,944::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 16:59:21,690::task::579::TaskManager.Task::(_updateState) Task=`43e5b958-2569-4a39-950b-2dddd9e4537f`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 16:59:21,690::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 16:59:21,691::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:59:21,691::task::1168::TaskManager.Task::(prepare) Task=`43e5b958-2569-4a39-950b-2dddd9e4537f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 16:59:21,691::task::579::TaskManager.Task::(_updateState) Task=`43e5b958-2569-4a39-950b-2dddd9e4537f`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 16:59:21,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 16:59:21,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 16:59:21,691::task::974::TaskManager.Task::(_decref) Task=`43e5b958-2569-4a39-950b-2dddd9e4537f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:21,870::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:21,945::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:59:21,945::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:59:22,504::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:59:22,520::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274475 s, 1.3 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:59:22,940::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:59:22,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:59:22,959::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000232777 s, 17.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:59:23,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:23,958::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:24,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:25,873::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:25,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:25,961::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287368::DEBUG::2014-01-16 16:59:26,043::task::579::TaskManager.Task::(_updateState) Task=`9f17ff6a-dc83-4fa6-a4cc-63e306aacd17`::moving from state init -> state preparing >Thread-287368::INFO::2014-01-16 16:59:26,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287368::INFO::2014-01-16 16:59:26,044::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274475', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232777', 'lastCheck': '3.1', 'valid': True}} >Thread-287368::DEBUG::2014-01-16 16:59:26,044::task::1168::TaskManager.Task::(prepare) Task=`9f17ff6a-dc83-4fa6-a4cc-63e306aacd17`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274475', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000232777', 'lastCheck': '3.1', 'valid': True}} >Thread-287368::DEBUG::2014-01-16 16:59:26,044::task::579::TaskManager.Task::(_updateState) Task=`9f17ff6a-dc83-4fa6-a4cc-63e306aacd17`::moving from state preparing -> state finished >Thread-287368::DEBUG::2014-01-16 16:59:26,044::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287368::DEBUG::2014-01-16 16:59:26,044::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287368::DEBUG::2014-01-16 16:59:26,044::task::974::TaskManager.Task::(_decref) Task=`9f17ff6a-dc83-4fa6-a4cc-63e306aacd17`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 16:59:26,357::task::579::TaskManager.Task::(_updateState) Task=`b92a5f76-e6a9-4afa-b54b-d762caa6de88`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 16:59:26,357::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 16:59:26,358::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:59:26,358::task::1168::TaskManager.Task::(prepare) Task=`b92a5f76-e6a9-4afa-b54b-d762caa6de88`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 16:59:26,358::task::579::TaskManager.Task::(_updateState) Task=`b92a5f76-e6a9-4afa-b54b-d762caa6de88`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 16:59:26,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 16:59:26,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 16:59:26,358::task::974::TaskManager.Task::(_decref) Task=`b92a5f76-e6a9-4afa-b54b-d762caa6de88`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:26,962::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:59:26,962::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:59:26,962::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:27,875::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:27,964::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:59:27,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:28,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:59:28,966::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:59:28,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 16:59:29,587::task::579::TaskManager.Task::(_updateState) Task=`58ee5e01-d82d-44bf-a423-424a8115c6a8`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 16:59:29,587::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 16:59:29,588::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:59:29,588::task::1168::TaskManager.Task::(prepare) Task=`58ee5e01-d82d-44bf-a423-424a8115c6a8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 16:59:29,588::task::579::TaskManager.Task::(_updateState) Task=`58ee5e01-d82d-44bf-a423-424a8115c6a8`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 16:59:29,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 16:59:29,588::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 16:59:29,588::task::974::TaskManager.Task::(_decref) Task=`58ee5e01-d82d-44bf-a423-424a8115c6a8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:29,876::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:29,967::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 16:59:29,967::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:30,878::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:59:30,879::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:59:30,880::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:30,968::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 16:59:30,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:31,881::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:31,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:59:32,528::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:59:32,550::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000293193 s, 1.2 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:59:32,964::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:59:32,978::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 16:59:32,981::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:59:32,983::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00025896 s, 15.8 MB/s\n'; <rc> = 0 >Thread-3175::DEBUG::2014-01-16 16:59:33,219::task::579::TaskManager.Task::(_updateState) Task=`bbf05f40-9988-4076-bb84-c11e43949e59`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 16:59:33,220::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 16:59:33,220::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:59:33,220::task::1168::TaskManager.Task::(prepare) Task=`bbf05f40-9988-4076-bb84-c11e43949e59`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 16:59:33,221::task::579::TaskManager.Task::(_updateState) Task=`bbf05f40-9988-4076-bb84-c11e43949e59`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 16:59:33,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 16:59:33,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 16:59:33,221::task::974::TaskManager.Task::(_decref) Task=`bbf05f40-9988-4076-bb84-c11e43949e59`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 16:59:33,250::task::579::TaskManager.Task::(_updateState) Task=`79c55071-6d00-4fff-9a38-8d83056bf598`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 16:59:33,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 16:59:33,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:59:33,251::task::1168::TaskManager.Task::(prepare) Task=`79c55071-6d00-4fff-9a38-8d83056bf598`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 16:59:33,251::task::579::TaskManager.Task::(_updateState) Task=`79c55071-6d00-4fff-9a38-8d83056bf598`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 16:59:33,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 16:59:33,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 16:59:33,252::task::974::TaskManager.Task::(_decref) Task=`79c55071-6d00-4fff-9a38-8d83056bf598`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:59:33,326::task::579::TaskManager.Task::(_updateState) Task=`15b19236-0358-4c2f-b530-f4431e09a951`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:59:33,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 16:59:33,326::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:59:33,326::task::1168::TaskManager.Task::(prepare) Task=`15b19236-0358-4c2f-b530-f4431e09a951`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 16:59:33,327::task::579::TaskManager.Task::(_updateState) Task=`15b19236-0358-4c2f-b530-f4431e09a951`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:59:33,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:59:33,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:59:33,327::task::974::TaskManager.Task::(_decref) Task=`15b19236-0358-4c2f-b530-f4431e09a951`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 16:59:33,327::task::579::TaskManager.Task::(_updateState) Task=`815f28b4-072e-4234-85bf-7dee98ef7113`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 16:59:33,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 16:59:33,328::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:59:33,328::task::1168::TaskManager.Task::(prepare) Task=`815f28b4-072e-4234-85bf-7dee98ef7113`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 16:59:33,328::task::579::TaskManager.Task::(_updateState) Task=`815f28b4-072e-4234-85bf-7dee98ef7113`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 16:59:33,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 16:59:33,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 16:59:33,329::task::974::TaskManager.Task::(_decref) Task=`815f28b4-072e-4234-85bf-7dee98ef7113`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:33,883::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:33,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 16:59:33,982::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:34,983::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 16:59:34,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 16:59:34,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 16:59:34,984::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:35,884::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:35,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:35,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 16:59:35,985::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 16:59:35,985::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:36,986::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 16:59:36,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:37,886::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:37,987::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 16:59:37,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 16:59:37,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 16:59:37,988::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 16:59:38,330::task::579::TaskManager.Task::(_updateState) Task=`1e97b73f-f06d-425e-aae7-6f36d01470bf`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 16:59:38,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 16:59:38,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:59:38,331::task::1168::TaskManager.Task::(prepare) Task=`1e97b73f-f06d-425e-aae7-6f36d01470bf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 16:59:38,331::task::579::TaskManager.Task::(_updateState) Task=`1e97b73f-f06d-425e-aae7-6f36d01470bf`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 16:59:38,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 16:59:38,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 16:59:38,332::task::974::TaskManager.Task::(_decref) Task=`1e97b73f-f06d-425e-aae7-6f36d01470bf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:38,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:39,887::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:39,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 16:59:39,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 16:59:39,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 16:59:39,991::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:39,991::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 16:59:39,991::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-3168::DEBUG::2014-01-16 16:59:40,747::task::579::TaskManager.Task::(_updateState) Task=`84bd9152-cfff-4bb2-8341-ad5a920b9ea5`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 16:59:40,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 16:59:40,748::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:59:40,748::task::1168::TaskManager.Task::(prepare) Task=`84bd9152-cfff-4bb2-8341-ad5a920b9ea5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 16:59:40,748::task::579::TaskManager.Task::(_updateState) Task=`84bd9152-cfff-4bb2-8341-ad5a920b9ea5`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 16:59:40,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 16:59:40,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 16:59:40,748::task::974::TaskManager.Task::(_decref) Task=`84bd9152-cfff-4bb2-8341-ad5a920b9ea5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:40,888::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:40,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 16:59:41,678::task::579::TaskManager.Task::(_updateState) Task=`8f888719-d5f7-478a-8f5a-21b610e02381`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 16:59:41,678::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 16:59:41,678::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:59:41,678::task::1168::TaskManager.Task::(prepare) Task=`8f888719-d5f7-478a-8f5a-21b610e02381`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 16:59:41,679::task::579::TaskManager.Task::(_updateState) Task=`8f888719-d5f7-478a-8f5a-21b610e02381`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 16:59:41,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 16:59:41,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 16:59:41,679::task::974::TaskManager.Task::(_decref) Task=`8f888719-d5f7-478a-8f5a-21b610e02381`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 16:59:41,739::task::579::TaskManager.Task::(_updateState) Task=`f8afdb50-70d3-4e47-baac-889440bab72c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 16:59:41,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 16:59:41,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:59:41,740::task::1168::TaskManager.Task::(prepare) Task=`f8afdb50-70d3-4e47-baac-889440bab72c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 16:59:41,740::task::579::TaskManager.Task::(_updateState) Task=`f8afdb50-70d3-4e47-baac-889440bab72c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 16:59:41,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 16:59:41,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 16:59:41,741::task::974::TaskManager.Task::(_decref) Task=`f8afdb50-70d3-4e47-baac-889440bab72c`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 16:59:41,751::task::579::TaskManager.Task::(_updateState) Task=`cdfa13dc-179a-4ee0-b61b-48a41a6f1418`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 16:59:41,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 16:59:41,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:59:41,751::task::1168::TaskManager.Task::(prepare) Task=`cdfa13dc-179a-4ee0-b61b-48a41a6f1418`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 16:59:41,752::task::579::TaskManager.Task::(_updateState) Task=`cdfa13dc-179a-4ee0-b61b-48a41a6f1418`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 16:59:41,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 16:59:41,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 16:59:41,752::task::974::TaskManager.Task::(_decref) Task=`cdfa13dc-179a-4ee0-b61b-48a41a6f1418`::ref 0 aborting False >Thread-287374::DEBUG::2014-01-16 16:59:41,799::task::579::TaskManager.Task::(_updateState) Task=`8a756bc5-5bde-4e23-a9e1-7f080e2d4c39`::moving from state init -> state preparing >Thread-287374::INFO::2014-01-16 16:59:41,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287374::INFO::2014-01-16 16:59:41,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293193', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025896', 'lastCheck': '8.8', 'valid': True}} >Thread-287374::DEBUG::2014-01-16 16:59:41,800::task::1168::TaskManager.Task::(prepare) Task=`8a756bc5-5bde-4e23-a9e1-7f080e2d4c39`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293193', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025896', 'lastCheck': '8.8', 'valid': True}} >Thread-287374::DEBUG::2014-01-16 16:59:41,800::task::579::TaskManager.Task::(_updateState) Task=`8a756bc5-5bde-4e23-a9e1-7f080e2d4c39`::moving from state preparing -> state finished >Thread-287374::DEBUG::2014-01-16 16:59:41,801::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287374::DEBUG::2014-01-16 16:59:41,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287374::DEBUG::2014-01-16 16:59:41,801::task::974::TaskManager.Task::(_decref) Task=`8a756bc5-5bde-4e23-a9e1-7f080e2d4c39`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:41,892::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:41,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 16:59:41,993::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 16:59:41,993::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 16:59:42,404::task::579::TaskManager.Task::(_updateState) Task=`40c61e4b-25c9-46da-af57-8079b454e21b`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 16:59:42,404::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 16:59:42,405::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:59:42,405::task::1168::TaskManager.Task::(prepare) Task=`40c61e4b-25c9-46da-af57-8079b454e21b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 16:59:42,405::task::579::TaskManager.Task::(_updateState) Task=`40c61e4b-25c9-46da-af57-8079b454e21b`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 16:59:42,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 16:59:42,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 16:59:42,405::task::974::TaskManager.Task::(_decref) Task=`40c61e4b-25c9-46da-af57-8079b454e21b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 16:59:42,558::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:59:42,574::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029833 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 16:59:42,750::task::579::TaskManager.Task::(_updateState) Task=`9b280e5a-7152-453d-9947-0b17e32145f4`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 16:59:42,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 16:59:42,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:59:42,751::task::1168::TaskManager.Task::(prepare) Task=`9b280e5a-7152-453d-9947-0b17e32145f4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 16:59:42,751::task::579::TaskManager.Task::(_updateState) Task=`9b280e5a-7152-453d-9947-0b17e32145f4`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 16:59:42,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 16:59:42,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 16:59:42,752::task::974::TaskManager.Task::(_decref) Task=`9b280e5a-7152-453d-9947-0b17e32145f4`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 16:59:42,988::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:59:43,004::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 16:59:43,006::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 16:59:43,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:59:43,010::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000261439 s, 15.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:59:43,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:44,010::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 16:59:44,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 16:59:44,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 16:59:44,011::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:45,012::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:45,895::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:45,897::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 16:59:45,897::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 16:59:45,898::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:46,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 16:59:46,013::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:47,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:47,899::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:48,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 16:59:48,078::task::579::TaskManager.Task::(_updateState) Task=`c6f17ef1-c4b8-4c98-8126-ee20dba8f41d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:59:48,078::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 16:59:48,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:59:48,079::task::1168::TaskManager.Task::(prepare) Task=`c6f17ef1-c4b8-4c98-8126-ee20dba8f41d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 16:59:48,079::task::579::TaskManager.Task::(_updateState) Task=`c6f17ef1-c4b8-4c98-8126-ee20dba8f41d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:59:48,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:59:48,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:59:48,079::task::974::TaskManager.Task::(_decref) Task=`c6f17ef1-c4b8-4c98-8126-ee20dba8f41d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:59:48,079::task::579::TaskManager.Task::(_updateState) Task=`fb49a57f-4895-4660-904b-43ebd8ad89c4`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:59:48,080::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 16:59:48,080::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:59:48,080::task::1168::TaskManager.Task::(prepare) Task=`fb49a57f-4895-4660-904b-43ebd8ad89c4`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:59:48,080::task::579::TaskManager.Task::(_updateState) Task=`fb49a57f-4895-4660-904b-43ebd8ad89c4`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:59:48,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:59:48,080::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:59:48,080::task::974::TaskManager.Task::(_decref) Task=`fb49a57f-4895-4660-904b-43ebd8ad89c4`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 16:59:48,081::task::579::TaskManager.Task::(_updateState) Task=`50278f97-f7ef-4344-a88e-035254325582`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 16:59:48,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 16:59:48,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:59:48,081::task::1168::TaskManager.Task::(prepare) Task=`50278f97-f7ef-4344-a88e-035254325582`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 16:59:48,081::task::579::TaskManager.Task::(_updateState) Task=`50278f97-f7ef-4344-a88e-035254325582`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 16:59:48,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 16:59:48,082::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 16:59:48,082::task::974::TaskManager.Task::(_decref) Task=`50278f97-f7ef-4344-a88e-035254325582`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 16:59:49,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:49,901::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:50,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 16:59:50,312::task::579::TaskManager.Task::(_updateState) Task=`467c0975-5d40-4eb1-9f76-2a75552ad9c3`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 16:59:50,313::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 16:59:50,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:59:50,313::task::1168::TaskManager.Task::(prepare) Task=`467c0975-5d40-4eb1-9f76-2a75552ad9c3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 16:59:50,313::task::579::TaskManager.Task::(_updateState) Task=`467c0975-5d40-4eb1-9f76-2a75552ad9c3`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 16:59:50,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 16:59:50,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 16:59:50,314::task::974::TaskManager.Task::(_decref) Task=`467c0975-5d40-4eb1-9f76-2a75552ad9c3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:50,902::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:51,020::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:51,904::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:52,021::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 16:59:52,021::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 16:59:52,582::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 16:59:52,598::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000318486 s, 1.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 16:59:53,016::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 16:59:53,032::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 16:59:53,035::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000266654 s, 15.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 16:59:53,905::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:54,034::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:55,035::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 16:59:55,248::task::579::TaskManager.Task::(_updateState) Task=`cf06ef53-0dd7-4f86-9c3e-c00317cedd0f`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 16:59:55,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 16:59:55,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:59:55,249::task::1168::TaskManager.Task::(prepare) Task=`cf06ef53-0dd7-4f86-9c3e-c00317cedd0f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 16:59:55,250::task::579::TaskManager.Task::(_updateState) Task=`cf06ef53-0dd7-4f86-9c3e-c00317cedd0f`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 16:59:55,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 16:59:55,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 16:59:55,250::task::974::TaskManager.Task::(_decref) Task=`cf06ef53-0dd7-4f86-9c3e-c00317cedd0f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:55,907::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 16:59:55,908::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:56,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:57,036::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 16:59:57,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 16:59:57,037::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287380::DEBUG::2014-01-16 16:59:57,643::task::579::TaskManager.Task::(_updateState) Task=`6b3fb57d-7c74-4b09-aeeb-6e5ef9bca5e2`::moving from state init -> state preparing >Thread-287380::INFO::2014-01-16 16:59:57,643::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287380::INFO::2014-01-16 16:59:57,643::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318486', 'lastCheck': '5.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266654', 'lastCheck': '4.6', 'valid': True}} >Thread-287380::DEBUG::2014-01-16 16:59:57,643::task::1168::TaskManager.Task::(prepare) Task=`6b3fb57d-7c74-4b09-aeeb-6e5ef9bca5e2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318486', 'lastCheck': '5.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266654', 'lastCheck': '4.6', 'valid': True}} >Thread-287380::DEBUG::2014-01-16 16:59:57,644::task::579::TaskManager.Task::(_updateState) Task=`6b3fb57d-7c74-4b09-aeeb-6e5ef9bca5e2`::moving from state preparing -> state finished >Thread-287380::DEBUG::2014-01-16 16:59:57,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287380::DEBUG::2014-01-16 16:59:57,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287380::DEBUG::2014-01-16 16:59:57,644::task::974::TaskManager.Task::(_decref) Task=`6b3fb57d-7c74-4b09-aeeb-6e5ef9bca5e2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 16:59:57,910::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 16:59:58,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 16:59:58,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 16:59:59,039::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 16:59:59,039::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 16:59:59,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 16:59:59,911::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:00,040::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:00:00,040::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:00,913::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:00:00,913::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:00:00,914::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:01,042::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:00:01,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:00:01,732::task::579::TaskManager.Task::(_updateState) Task=`fc7c941e-6bf8-4335-a860-637118cccd70`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:00:01,733::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:00:01,733::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:00:01,733::task::1168::TaskManager.Task::(prepare) Task=`fc7c941e-6bf8-4335-a860-637118cccd70`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:00:01,733::task::579::TaskManager.Task::(_updateState) Task=`fc7c941e-6bf8-4335-a860-637118cccd70`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:00:01,733::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:00:01,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:00:01,734::task::974::TaskManager.Task::(_decref) Task=`fc7c941e-6bf8-4335-a860-637118cccd70`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:01,916::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:02,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:00:02,609::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:00:02,631::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00038322 s, 952 kB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:00:03,041::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:00:03,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:00:03,058::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:00:03,060::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00032524 s, 12.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:00:03,918::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:04,060::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:00:04,060::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:05,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:00:05,062::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:00:05,062::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:00:05,062::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:05,919::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:05,921::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:06,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:00:06,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:00:06,064::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:07,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:00:07,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:00:07,131::task::579::TaskManager.Task::(_updateState) Task=`740bb291-c0a9-41ca-b1dc-f4dfa6d218d9`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:00:07,131::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:00:07,131::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:00:07,132::task::1168::TaskManager.Task::(prepare) Task=`740bb291-c0a9-41ca-b1dc-f4dfa6d218d9`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:00:07,132::task::579::TaskManager.Task::(_updateState) Task=`740bb291-c0a9-41ca-b1dc-f4dfa6d218d9`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:00:07,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:00:07,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:00:07,132::task::974::TaskManager.Task::(_decref) Task=`740bb291-c0a9-41ca-b1dc-f4dfa6d218d9`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:00:07,141::task::579::TaskManager.Task::(_updateState) Task=`7ecf0ba2-3277-4e07-8184-c984a9712c5c`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:00:07,141::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:00:07,142::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:00:07,142::task::1168::TaskManager.Task::(prepare) Task=`7ecf0ba2-3277-4e07-8184-c984a9712c5c`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:00:07,142::task::579::TaskManager.Task::(_updateState) Task=`7ecf0ba2-3277-4e07-8184-c984a9712c5c`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:00:07,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:00:07,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:00:07,142::task::974::TaskManager.Task::(_decref) Task=`7ecf0ba2-3277-4e07-8184-c984a9712c5c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:07,922::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:08,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:00:08,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:00:08,067::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:00:08,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:00:08,177::task::579::TaskManager.Task::(_updateState) Task=`cf860f06-ca9b-41ca-bbf4-d3fbb64c2b78`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:00:08,177::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:00:08,178::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:00:08,178::task::1168::TaskManager.Task::(prepare) Task=`cf860f06-ca9b-41ca-bbf4-d3fbb64c2b78`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:00:08,178::task::579::TaskManager.Task::(_updateState) Task=`cf860f06-ca9b-41ca-bbf4-d3fbb64c2b78`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:00:08,178::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:00:08,178::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:00:08,178::task::974::TaskManager.Task::(_decref) Task=`cf860f06-ca9b-41ca-bbf4-d3fbb64c2b78`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:00:08,179::task::579::TaskManager.Task::(_updateState) Task=`32158fc0-3d32-4fe7-aec6-cffdef1cf125`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:00:08,179::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:00:08,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:00:08,179::task::1168::TaskManager.Task::(prepare) Task=`32158fc0-3d32-4fe7-aec6-cffdef1cf125`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:00:08,179::task::579::TaskManager.Task::(_updateState) Task=`32158fc0-3d32-4fe7-aec6-cffdef1cf125`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:00:08,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:00:08,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:00:08,180::task::974::TaskManager.Task::(_decref) Task=`32158fc0-3d32-4fe7-aec6-cffdef1cf125`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:00:08,838::task::579::TaskManager.Task::(_updateState) Task=`cbabdf34-0cd2-4c8e-bd1f-99303e802060`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:00:08,838::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:00:08,839::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:00:08,839::task::1168::TaskManager.Task::(prepare) Task=`cbabdf34-0cd2-4c8e-bd1f-99303e802060`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:00:08,839::task::579::TaskManager.Task::(_updateState) Task=`cbabdf34-0cd2-4c8e-bd1f-99303e802060`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:00:08,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:00:08,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:00:08,839::task::974::TaskManager.Task::(_decref) Task=`cbabdf34-0cd2-4c8e-bd1f-99303e802060`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:00:08,961::task::579::TaskManager.Task::(_updateState) Task=`7760a661-3f25-4f08-97ba-4c777e7d8325`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:00:08,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:00:08,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:00:08,963::task::1168::TaskManager.Task::(prepare) Task=`7760a661-3f25-4f08-97ba-4c777e7d8325`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:00:08,963::task::579::TaskManager.Task::(_updateState) Task=`7760a661-3f25-4f08-97ba-4c777e7d8325`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:00:08,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:00:08,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:00:08,964::task::974::TaskManager.Task::(_decref) Task=`7760a661-3f25-4f08-97ba-4c777e7d8325`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:00:08,964::task::579::TaskManager.Task::(_updateState) Task=`c253cea5-bc1b-4c4b-96da-65e12f0ac60e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:00:08,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:00:08,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:00:08,964::task::1168::TaskManager.Task::(prepare) Task=`c253cea5-bc1b-4c4b-96da-65e12f0ac60e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:00:08,964::task::579::TaskManager.Task::(_updateState) Task=`c253cea5-bc1b-4c4b-96da-65e12f0ac60e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:00:08,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:00:08,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:00:08,965::task::974::TaskManager.Task::(_decref) Task=`c253cea5-bc1b-4c4b-96da-65e12f0ac60e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:09,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:09,923::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:10,069::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:00:10,069::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:00:10,070::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:00:10,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:10,070::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:00:10,071::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:00:10,925::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:11,072::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:11,927::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:12,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:00:12,074::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:00:12,074::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:00:12,640::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:00:12,657::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00027893 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:00:12,869::task::579::TaskManager.Task::(_updateState) Task=`4ba347ef-4e93-45b0-ad66-5bc19d59c9ba`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:00:12,870::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:00:12,870::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:00:12,871::task::1168::TaskManager.Task::(prepare) Task=`4ba347ef-4e93-45b0-ad66-5bc19d59c9ba`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:00:12,871::task::579::TaskManager.Task::(_updateState) Task=`4ba347ef-4e93-45b0-ad66-5bc19d59c9ba`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:00:12,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:00:12,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:00:12,872::task::974::TaskManager.Task::(_decref) Task=`4ba347ef-4e93-45b0-ad66-5bc19d59c9ba`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:00:13,037::task::579::TaskManager.Task::(_updateState) Task=`283c7e63-7f1a-42c5-91fb-fbb7c5a01840`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:00:13,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:00:13,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:00:13,038::task::1168::TaskManager.Task::(prepare) Task=`283c7e63-7f1a-42c5-91fb-fbb7c5a01840`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:00:13,038::task::579::TaskManager.Task::(_updateState) Task=`283c7e63-7f1a-42c5-91fb-fbb7c5a01840`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:00:13,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:00:13,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:00:13,039::task::974::TaskManager.Task::(_decref) Task=`283c7e63-7f1a-42c5-91fb-fbb7c5a01840`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:00:13,064::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:00:13,064::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:00:13,064::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:00:13,064::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:00:13,067::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:00:13,084::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:00:13,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:00:13,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:00:13,088::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000296273 s, 6.9 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:00:13,089::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000296273 s, 6.9 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:00:13,089::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:00:13,089::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:00:13,090::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:00:13,090::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:00:13,090::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:00:13,090::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:00:13,091::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:00:13,091::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:00:13,092::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 17:00:13,334::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:00:13,342::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:00:13,342::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:00:13,343::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:00:13,343::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:00:13,343::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 17:00:13,344::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-287386::DEBUG::2014-01-16 17:00:13,429::task::579::TaskManager.Task::(_updateState) Task=`97d4e053-cbe6-45bb-b0c2-ab752ee6287e`::moving from state init -> state preparing >Thread-287386::INFO::2014-01-16 17:00:13,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287386::INFO::2014-01-16 17:00:13,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027893', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032524', 'lastCheck': '10.4', 'valid': True}} >Thread-287386::DEBUG::2014-01-16 17:00:13,430::task::1168::TaskManager.Task::(prepare) Task=`97d4e053-cbe6-45bb-b0c2-ab752ee6287e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027893', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032524', 'lastCheck': '10.4', 'valid': True}} >Thread-287386::DEBUG::2014-01-16 17:00:13,431::task::579::TaskManager.Task::(_updateState) Task=`97d4e053-cbe6-45bb-b0c2-ab752ee6287e`::moving from state preparing -> state finished >Thread-287386::DEBUG::2014-01-16 17:00:13,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287386::DEBUG::2014-01-16 17:00:13,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287386::DEBUG::2014-01-16 17:00:13,431::task::974::TaskManager.Task::(_decref) Task=`97d4e053-cbe6-45bb-b0c2-ab752ee6287e`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:00:13,514::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:00:13,539::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:00:13,581::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258369 s, 15.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:00:13,928::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 17:00:14,083::task::579::TaskManager.Task::(_updateState) Task=`44d78e11-74f6-4741-b801-f41137016ea9`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:00:14,083::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:00:14,083::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:00:14,083::task::1168::TaskManager.Task::(prepare) Task=`44d78e11-74f6-4741-b801-f41137016ea9`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:00:14,084::task::579::TaskManager.Task::(_updateState) Task=`44d78e11-74f6-4741-b801-f41137016ea9`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:00:14,084::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:00:14,084::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:00:14,084::task::974::TaskManager.Task::(_decref) Task=`44d78e11-74f6-4741-b801-f41137016ea9`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:00:14,084::task::579::TaskManager.Task::(_updateState) Task=`c317f47f-ab8c-40d0-b926-2a728f8be1d2`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:00:14,085::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:00:14,085::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:00:14,085::task::1168::TaskManager.Task::(prepare) Task=`c317f47f-ab8c-40d0-b926-2a728f8be1d2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:00:14,085::task::579::TaskManager.Task::(_updateState) Task=`c317f47f-ab8c-40d0-b926-2a728f8be1d2`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:00:14,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:00:14,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:00:14,086::task::974::TaskManager.Task::(_decref) Task=`c317f47f-ab8c-40d0-b926-2a728f8be1d2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:14,089::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:00:14,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:00:14,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:00:14,090::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:00:14,159::task::579::TaskManager.Task::(_updateState) Task=`345354ea-c3e0-4c44-ba82-38ca8865a084`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:00:14,159::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:00:14,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:00:14,160::task::1168::TaskManager.Task::(prepare) Task=`345354ea-c3e0-4c44-ba82-38ca8865a084`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:00:14,160::task::579::TaskManager.Task::(_updateState) Task=`345354ea-c3e0-4c44-ba82-38ca8865a084`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:00:14,160::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:00:14,160::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:00:14,160::task::974::TaskManager.Task::(_decref) Task=`345354ea-c3e0-4c44-ba82-38ca8865a084`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:15,091::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:00:15,134::task::579::TaskManager.Task::(_updateState) Task=`d38f02cd-fed8-449e-9d93-15b30e2f6fa0`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:00:15,135::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:00:15,135::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:00:15,135::task::1168::TaskManager.Task::(prepare) Task=`d38f02cd-fed8-449e-9d93-15b30e2f6fa0`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:00:15,136::task::579::TaskManager.Task::(_updateState) Task=`d38f02cd-fed8-449e-9d93-15b30e2f6fa0`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:00:15,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:00:15,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:00:15,136::task::974::TaskManager.Task::(_decref) Task=`d38f02cd-fed8-449e-9d93-15b30e2f6fa0`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:00:15,136::task::579::TaskManager.Task::(_updateState) Task=`47c7a123-7cd0-48eb-aea8-1f429ce036c6`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:00:15,136::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:00:15,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:00:15,137::task::1168::TaskManager.Task::(prepare) Task=`47c7a123-7cd0-48eb-aea8-1f429ce036c6`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:00:15,137::task::579::TaskManager.Task::(_updateState) Task=`47c7a123-7cd0-48eb-aea8-1f429ce036c6`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:00:15,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:00:15,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:00:15,137::task::974::TaskManager.Task::(_decref) Task=`47c7a123-7cd0-48eb-aea8-1f429ce036c6`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:00:15,138::task::579::TaskManager.Task::(_updateState) Task=`dd948d3b-605a-4ad1-81b0-61305f0adee3`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:00:15,138::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:00:15,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:00:15,138::task::1168::TaskManager.Task::(prepare) Task=`dd948d3b-605a-4ad1-81b0-61305f0adee3`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:00:15,138::task::579::TaskManager.Task::(_updateState) Task=`dd948d3b-605a-4ad1-81b0-61305f0adee3`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:00:15,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:00:15,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:00:15,139::task::974::TaskManager.Task::(_decref) Task=`dd948d3b-605a-4ad1-81b0-61305f0adee3`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 17:00:15,166::task::579::TaskManager.Task::(_updateState) Task=`e70b3fa1-6a9f-41da-bb16-baec642c1892`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:00:15,166::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:00:15,167::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:00:15,167::task::1168::TaskManager.Task::(prepare) Task=`e70b3fa1-6a9f-41da-bb16-baec642c1892`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:00:15,167::task::579::TaskManager.Task::(_updateState) Task=`e70b3fa1-6a9f-41da-bb16-baec642c1892`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:00:15,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:00:15,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:00:15,167::task::974::TaskManager.Task::(_decref) Task=`e70b3fa1-6a9f-41da-bb16-baec642c1892`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:15,930::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:15,930::task::579::TaskManager.Task::(_updateState) Task=`6057b4d3-38ef-44a7-91cf-6818603e7c5c`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:00:15,931::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:00:15,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:00:15,931::task::1168::TaskManager.Task::(prepare) Task=`6057b4d3-38ef-44a7-91cf-6818603e7c5c`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:00:15,931::task::579::TaskManager.Task::(_updateState) Task=`6057b4d3-38ef-44a7-91cf-6818603e7c5c`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:00:15,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:00:15,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:00:15,932::task::974::TaskManager.Task::(_decref) Task=`6057b4d3-38ef-44a7-91cf-6818603e7c5c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:15,934::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:00:15,934::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:00:15,936::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:15,938::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:15,940::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:16,093::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:00:16,093::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:17,094::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:17,941::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:18,095::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:00:18,468::task::579::TaskManager.Task::(_updateState) Task=`e8ada762-9d07-41c7-9892-e7c18da874a4`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:00:18,469::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:00:18,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:00:18,469::task::1168::TaskManager.Task::(prepare) Task=`e8ada762-9d07-41c7-9892-e7c18da874a4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:00:18,470::task::579::TaskManager.Task::(_updateState) Task=`e8ada762-9d07-41c7-9892-e7c18da874a4`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:00:18,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:00:18,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:00:18,470::task::974::TaskManager.Task::(_decref) Task=`e8ada762-9d07-41c7-9892-e7c18da874a4`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:00:18,616::task::579::TaskManager.Task::(_updateState) Task=`3514d0f9-552f-4195-b16c-0df21849bc9e`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:00:18,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:00:18,617::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:00:18,618::task::1168::TaskManager.Task::(prepare) Task=`3514d0f9-552f-4195-b16c-0df21849bc9e`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:00:18,618::task::579::TaskManager.Task::(_updateState) Task=`3514d0f9-552f-4195-b16c-0df21849bc9e`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:00:18,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:00:18,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:00:18,618::task::974::TaskManager.Task::(_decref) Task=`3514d0f9-552f-4195-b16c-0df21849bc9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:19,096::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:19,943::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:20,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:20,944::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:21,098::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:00:21,858::task::579::TaskManager.Task::(_updateState) Task=`e9c740f4-3404-4deb-86f9-31209f30f77c`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:00:21,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:00:21,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:00:21,859::task::1168::TaskManager.Task::(prepare) Task=`e9c740f4-3404-4deb-86f9-31209f30f77c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:00:21,859::task::579::TaskManager.Task::(_updateState) Task=`e9c740f4-3404-4deb-86f9-31209f30f77c`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:00:21,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:00:21,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:00:21,860::task::974::TaskManager.Task::(_decref) Task=`e9c740f4-3404-4deb-86f9-31209f30f77c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:21,946::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:22,099::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:00:22,100::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:00:22,665::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:00:22,682::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264341 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:00:23,100::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:00:23,594::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:00:23,611::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268386 s, 15.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:00:23,947::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:24,102::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:25,103::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:25,949::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:25,950::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:26,105::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:00:26,420::task::579::TaskManager.Task::(_updateState) Task=`af186e4e-306c-4fcf-8175-98d65ef5007a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:00:26,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:00:26,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:00:26,422::task::1168::TaskManager.Task::(prepare) Task=`af186e4e-306c-4fcf-8175-98d65ef5007a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:00:26,422::task::579::TaskManager.Task::(_updateState) Task=`af186e4e-306c-4fcf-8175-98d65ef5007a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:00:26,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:00:26,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:00:26,422::task::974::TaskManager.Task::(_decref) Task=`af186e4e-306c-4fcf-8175-98d65ef5007a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:27,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:00:27,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:00:27,106::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:27,951::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:28,107::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:00:28,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:29,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:00:29,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:00:29,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287392::DEBUG::2014-01-16 17:00:29,253::task::579::TaskManager.Task::(_updateState) Task=`29d28a85-a2ff-48c1-ad09-ec7459578d31`::moving from state init -> state preparing >Thread-287392::INFO::2014-01-16 17:00:29,254::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287392::INFO::2014-01-16 17:00:29,254::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264341', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268386', 'lastCheck': '5.6', 'valid': True}} >Thread-287392::DEBUG::2014-01-16 17:00:29,254::task::1168::TaskManager.Task::(prepare) Task=`29d28a85-a2ff-48c1-ad09-ec7459578d31`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264341', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268386', 'lastCheck': '5.6', 'valid': True}} >Thread-287392::DEBUG::2014-01-16 17:00:29,254::task::579::TaskManager.Task::(_updateState) Task=`29d28a85-a2ff-48c1-ad09-ec7459578d31`::moving from state preparing -> state finished >Thread-287392::DEBUG::2014-01-16 17:00:29,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287392::DEBUG::2014-01-16 17:00:29,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287392::DEBUG::2014-01-16 17:00:29,254::task::974::TaskManager.Task::(_decref) Task=`29d28a85-a2ff-48c1-ad09-ec7459578d31`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 17:00:29,771::task::579::TaskManager.Task::(_updateState) Task=`e7615c69-8063-414c-9268-fb8df35f2cee`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:00:29,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:00:29,772::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:00:29,772::task::1168::TaskManager.Task::(prepare) Task=`e7615c69-8063-414c-9268-fb8df35f2cee`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:00:29,772::task::579::TaskManager.Task::(_updateState) Task=`e7615c69-8063-414c-9268-fb8df35f2cee`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:00:29,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:00:29,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:00:29,773::task::974::TaskManager.Task::(_decref) Task=`e7615c69-8063-414c-9268-fb8df35f2cee`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:29,953::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:30,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:00:30,111::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:30,955::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:00:30,956::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:00:30,958::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:31,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:00:31,112::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:31,959::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:32,113::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:00:32,690::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:00:32,707::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000305672 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:00:33,115::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:00:33,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:00:33,413::task::579::TaskManager.Task::(_updateState) Task=`61843264-7ab8-46e1-bdfd-0bce1f34ace5`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:00:33,414::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:00:33,414::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:00:33,414::task::1168::TaskManager.Task::(prepare) Task=`61843264-7ab8-46e1-bdfd-0bce1f34ace5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:00:33,414::task::579::TaskManager.Task::(_updateState) Task=`61843264-7ab8-46e1-bdfd-0bce1f34ace5`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:00:33,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:00:33,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:00:33,415::task::974::TaskManager.Task::(_decref) Task=`61843264-7ab8-46e1-bdfd-0bce1f34ace5`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:00:33,416::task::579::TaskManager.Task::(_updateState) Task=`0b238a88-4232-4d3f-a53b-e5e21d5e35b9`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:00:33,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:00:33,417::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:00:33,417::task::1168::TaskManager.Task::(prepare) Task=`0b238a88-4232-4d3f-a53b-e5e21d5e35b9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:00:33,417::task::579::TaskManager.Task::(_updateState) Task=`0b238a88-4232-4d3f-a53b-e5e21d5e35b9`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:00:33,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:00:33,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:00:33,418::task::974::TaskManager.Task::(_decref) Task=`0b238a88-4232-4d3f-a53b-e5e21d5e35b9`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:00:33,617::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:00:33,633::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000299926 s, 13.7 MB/s\n'; <rc> = 0 >Thread-48925::DEBUG::2014-01-16 17:00:33,714::task::579::TaskManager.Task::(_updateState) Task=`a081506f-8ac3-414f-83f9-f45ccd73d71d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:00:33,714::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:00:33,715::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:00:33,715::task::1168::TaskManager.Task::(prepare) Task=`a081506f-8ac3-414f-83f9-f45ccd73d71d`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:00:33,715::task::579::TaskManager.Task::(_updateState) Task=`a081506f-8ac3-414f-83f9-f45ccd73d71d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:00:33,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:00:33,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:00:33,715::task::974::TaskManager.Task::(_decref) Task=`a081506f-8ac3-414f-83f9-f45ccd73d71d`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:00:33,716::task::579::TaskManager.Task::(_updateState) Task=`dd352c92-6e4c-4fe6-9811-acc9e51ab49d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:00:33,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:00:33,716::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:00:33,716::task::1168::TaskManager.Task::(prepare) Task=`dd352c92-6e4c-4fe6-9811-acc9e51ab49d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:00:33,717::task::579::TaskManager.Task::(_updateState) Task=`dd352c92-6e4c-4fe6-9811-acc9e51ab49d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:00:33,717::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:00:33,717::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:00:33,717::task::974::TaskManager.Task::(_decref) Task=`dd352c92-6e4c-4fe6-9811-acc9e51ab49d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:33,961::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:34,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:00:34,116::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:35,117::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:00:35,118::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:00:35,118::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:00:35,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:35,963::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:35,964::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:36,119::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:00:36,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:00:36,120::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:37,121::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:00:37,121::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:37,965::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:38,122::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:00:38,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:00:38,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:00:38,123::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:00:38,515::task::579::TaskManager.Task::(_updateState) Task=`f2193813-65b5-4306-a372-c3b4ab8c079a`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:00:38,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:00:38,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:00:38,516::task::1168::TaskManager.Task::(prepare) Task=`f2193813-65b5-4306-a372-c3b4ab8c079a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:00:38,516::task::579::TaskManager.Task::(_updateState) Task=`f2193813-65b5-4306-a372-c3b4ab8c079a`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:00:38,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:00:38,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:00:38,517::task::974::TaskManager.Task::(_decref) Task=`f2193813-65b5-4306-a372-c3b4ab8c079a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:39,124::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:00:39,166::vm::2305::vm.Vm::(_rtcUpdate) vmId=`3ac853f1-a6ef-44aa-9695-5140e0d1b086`::new rtc offset -2 >Thread-189817::DEBUG::2014-01-16 17:00:39,967::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:40,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:00:40,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:00:40,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:00:40,125::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:40,125::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:00:40,127::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >libvirtEventLoop::DEBUG::2014-01-16 17:00:40,730::vm::2262::vm.Vm::(onReboot) vmId=`3ac853f1-a6ef-44aa-9695-5140e0d1b086`::reboot event >Thread-3168::DEBUG::2014-01-16 17:00:40,941::task::579::TaskManager.Task::(_updateState) Task=`08821bd8-2833-42b9-9406-36cfa851cdc3`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:00:40,941::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:00:40,941::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:00:40,941::task::1168::TaskManager.Task::(prepare) Task=`08821bd8-2833-42b9-9406-36cfa851cdc3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:00:40,942::task::579::TaskManager.Task::(_updateState) Task=`08821bd8-2833-42b9-9406-36cfa851cdc3`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:00:40,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:00:40,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:00:40,942::task::974::TaskManager.Task::(_decref) Task=`08821bd8-2833-42b9-9406-36cfa851cdc3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:40,968::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:41,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:00:41,847::task::579::TaskManager.Task::(_updateState) Task=`3a44ec84-af0a-43e0-ae63-4659c5e9e1c2`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:00:41,847::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:00:41,847::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:00:41,848::task::1168::TaskManager.Task::(prepare) Task=`3a44ec84-af0a-43e0-ae63-4659c5e9e1c2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:00:41,848::task::579::TaskManager.Task::(_updateState) Task=`3a44ec84-af0a-43e0-ae63-4659c5e9e1c2`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:00:41,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:00:41,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:00:41,848::task::974::TaskManager.Task::(_decref) Task=`3a44ec84-af0a-43e0-ae63-4659c5e9e1c2`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:00:41,921::task::579::TaskManager.Task::(_updateState) Task=`f46b64ea-5535-4548-a0d6-fa512995dbe5`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:00:41,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:00:41,922::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:00:41,922::task::1168::TaskManager.Task::(prepare) Task=`f46b64ea-5535-4548-a0d6-fa512995dbe5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:00:41,922::task::579::TaskManager.Task::(_updateState) Task=`f46b64ea-5535-4548-a0d6-fa512995dbe5`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:00:41,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:00:41,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:00:41,923::task::974::TaskManager.Task::(_decref) Task=`f46b64ea-5535-4548-a0d6-fa512995dbe5`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:00:41,933::task::579::TaskManager.Task::(_updateState) Task=`8c4c7ff9-003e-498a-bffd-adfb589f130f`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:00:41,933::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:00:41,933::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:00:41,934::task::1168::TaskManager.Task::(prepare) Task=`8c4c7ff9-003e-498a-bffd-adfb589f130f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:00:41,934::task::579::TaskManager.Task::(_updateState) Task=`8c4c7ff9-003e-498a-bffd-adfb589f130f`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:00:41,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:00:41,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:00:41,934::task::974::TaskManager.Task::(_decref) Task=`8c4c7ff9-003e-498a-bffd-adfb589f130f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:41,970::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:42,129::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:00:42,129::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:00:42,129::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:00:42,576::task::579::TaskManager.Task::(_updateState) Task=`33c4eb8c-2353-49d1-962a-f2765bc9cbfd`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:00:42,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:00:42,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:00:42,577::task::1168::TaskManager.Task::(prepare) Task=`33c4eb8c-2353-49d1-962a-f2765bc9cbfd`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:00:42,577::task::579::TaskManager.Task::(_updateState) Task=`33c4eb8c-2353-49d1-962a-f2765bc9cbfd`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:00:42,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:00:42,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:00:42,578::task::974::TaskManager.Task::(_decref) Task=`33c4eb8c-2353-49d1-962a-f2765bc9cbfd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:00:42,715::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:00:42,734::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300169 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:00:42,971::task::579::TaskManager.Task::(_updateState) Task=`714bc367-ddc3-469c-ae8a-2990e794709d`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:00:42,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:00:42,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:00:42,973::task::1168::TaskManager.Task::(prepare) Task=`714bc367-ddc3-469c-ae8a-2990e794709d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:00:42,973::task::579::TaskManager.Task::(_updateState) Task=`714bc367-ddc3-469c-ae8a-2990e794709d`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:00:42,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:00:42,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:00:42,974::task::974::TaskManager.Task::(_decref) Task=`714bc367-ddc3-469c-ae8a-2990e794709d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:00:43,130::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:00:43,131::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:00:43,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:00:43,640::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:00:43,656::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000270998 s, 15.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:00:43,972::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:44,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:00:44,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:00:44,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:00:44,133::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:45,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287398::DEBUG::2014-01-16 17:00:45,208::task::579::TaskManager.Task::(_updateState) Task=`598982b7-54c5-4266-8240-7925187a6384`::moving from state init -> state preparing >Thread-287398::INFO::2014-01-16 17:00:45,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287398::INFO::2014-01-16 17:00:45,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300169', 'lastCheck': '2.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270998', 'lastCheck': '1.5', 'valid': True}} >Thread-287398::DEBUG::2014-01-16 17:00:45,208::task::1168::TaskManager.Task::(prepare) Task=`598982b7-54c5-4266-8240-7925187a6384`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300169', 'lastCheck': '2.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270998', 'lastCheck': '1.5', 'valid': True}} >Thread-287398::DEBUG::2014-01-16 17:00:45,209::task::579::TaskManager.Task::(_updateState) Task=`598982b7-54c5-4266-8240-7925187a6384`::moving from state preparing -> state finished >Thread-287398::DEBUG::2014-01-16 17:00:45,209::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287398::DEBUG::2014-01-16 17:00:45,209::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287398::DEBUG::2014-01-16 17:00:45,209::task::974::TaskManager.Task::(_decref) Task=`598982b7-54c5-4266-8240-7925187a6384`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:45,973::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:45,975::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:00:45,976::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:00:45,977::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:46,135::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:00:46,135::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:47,137::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:47,979::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:48,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:00:48,367::task::579::TaskManager.Task::(_updateState) Task=`31cb40cd-20fe-44a2-9097-44cfbca94b92`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:00:48,367::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:00:48,367::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:00:48,367::task::1168::TaskManager.Task::(prepare) Task=`31cb40cd-20fe-44a2-9097-44cfbca94b92`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:00:48,368::task::579::TaskManager.Task::(_updateState) Task=`31cb40cd-20fe-44a2-9097-44cfbca94b92`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:00:48,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:00:48,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:00:48,368::task::974::TaskManager.Task::(_decref) Task=`31cb40cd-20fe-44a2-9097-44cfbca94b92`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:00:48,368::task::579::TaskManager.Task::(_updateState) Task=`117256ec-55e7-432f-a0a8-3d3d59cccba3`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:00:48,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:00:48,369::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:00:48,369::task::1168::TaskManager.Task::(prepare) Task=`117256ec-55e7-432f-a0a8-3d3d59cccba3`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:00:48,369::task::579::TaskManager.Task::(_updateState) Task=`117256ec-55e7-432f-a0a8-3d3d59cccba3`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:00:48,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:00:48,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:00:48,369::task::974::TaskManager.Task::(_decref) Task=`117256ec-55e7-432f-a0a8-3d3d59cccba3`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:00:48,370::task::579::TaskManager.Task::(_updateState) Task=`1f00d3fc-6ecf-4d67-861f-1e5f31b06a92`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:00:48,370::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:00:48,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:00:48,370::task::1168::TaskManager.Task::(prepare) Task=`1f00d3fc-6ecf-4d67-861f-1e5f31b06a92`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:00:48,370::task::579::TaskManager.Task::(_updateState) Task=`1f00d3fc-6ecf-4d67-861f-1e5f31b06a92`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:00:48,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:00:48,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:00:48,371::task::974::TaskManager.Task::(_decref) Task=`1f00d3fc-6ecf-4d67-861f-1e5f31b06a92`::ref 0 aborting False >Thread-287401::DEBUG::2014-01-16 17:00:48,750::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287401::DEBUG::2014-01-16 17:00:48,750::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '8.90', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '1.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:00:49,139::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:49,980::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:50,140::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:00:50,485::task::579::TaskManager.Task::(_updateState) Task=`ff56fb09-26cf-48be-9e5b-03f5909f3e5e`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:00:50,485::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:00:50,485::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:00:50,486::task::1168::TaskManager.Task::(prepare) Task=`ff56fb09-26cf-48be-9e5b-03f5909f3e5e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:00:50,486::task::579::TaskManager.Task::(_updateState) Task=`ff56fb09-26cf-48be-9e5b-03f5909f3e5e`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:00:50,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:00:50,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:00:50,486::task::974::TaskManager.Task::(_decref) Task=`ff56fb09-26cf-48be-9e5b-03f5909f3e5e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:50,982::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:51,141::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287403::DEBUG::2014-01-16 17:00:51,859::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287403::DEBUG::2014-01-16 17:00:51,859::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '8.90', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.28', 'elapsedTime': '11', 'vmType': 'kvm', 'cpuSys': '1.60', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:00:51,984::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:52,142::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:00:52,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:00:52,741::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:00:52,758::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000334845 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:00:53,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:00:53,661::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:00:53,678::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000237508 s, 17.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:00:53,985::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:54,145::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287405::DEBUG::2014-01-16 17:00:54,957::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287405::DEBUG::2014-01-16 17:00:54,958::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '37.27', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.36', 'elapsedTime': '14', 'vmType': 'kvm', 'cpuSys': '26.81', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:00:55,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:00:55,443::task::579::TaskManager.Task::(_updateState) Task=`6067f88d-467c-430d-81dc-033674d4a314`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:00:55,443::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:00:55,444::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:00:55,444::task::1168::TaskManager.Task::(prepare) Task=`6067f88d-467c-430d-81dc-033674d4a314`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:00:55,444::task::579::TaskManager.Task::(_updateState) Task=`6067f88d-467c-430d-81dc-033674d4a314`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:00:55,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:00:55,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:00:55,445::task::974::TaskManager.Task::(_decref) Task=`6067f88d-467c-430d-81dc-033674d4a314`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:00:55,987::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:00:55,989::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:56,148::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:00:57,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:00:57,150::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:00:57,150::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:57,990::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:00:58,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:00:58,152::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287407::DEBUG::2014-01-16 17:00:58,153::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287407::DEBUG::2014-01-16 17:00:58,153::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '37.27', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.56', 'elapsedTime': '17', 'vmType': 'kvm', 'cpuSys': '26.81', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:00:59,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:00:59,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:00:59,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:00:59,991::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:00,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:01:00,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:00,994::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:01:00,994::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:01:00,995::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:01,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:01:01,155::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287408::DEBUG::2014-01-16 17:01:01,212::task::579::TaskManager.Task::(_updateState) Task=`446dfd79-c483-439e-a437-abbd1384ff96`::moving from state init -> state preparing >Thread-287408::INFO::2014-01-16 17:01:01,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287408::INFO::2014-01-16 17:01:01,212::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334845', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237508', 'lastCheck': '7.5', 'valid': True}} >Thread-287408::DEBUG::2014-01-16 17:01:01,212::task::1168::TaskManager.Task::(prepare) Task=`446dfd79-c483-439e-a437-abbd1384ff96`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334845', 'lastCheck': '8.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000237508', 'lastCheck': '7.5', 'valid': True}} >Thread-287408::DEBUG::2014-01-16 17:01:01,212::task::579::TaskManager.Task::(_updateState) Task=`446dfd79-c483-439e-a437-abbd1384ff96`::moving from state preparing -> state finished >Thread-287408::DEBUG::2014-01-16 17:01:01,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287408::DEBUG::2014-01-16 17:01:01,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287408::DEBUG::2014-01-16 17:01:01,213::task::974::TaskManager.Task::(_decref) Task=`446dfd79-c483-439e-a437-abbd1384ff96`::ref 0 aborting False >Thread-84941::DEBUG::2014-01-16 17:01:01,932::task::579::TaskManager.Task::(_updateState) Task=`c267282a-6fa8-448b-858f-445619c79245`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:01:01,933::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:01:01,933::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:01:01,933::task::1168::TaskManager.Task::(prepare) Task=`c267282a-6fa8-448b-858f-445619c79245`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:01:01,934::task::579::TaskManager.Task::(_updateState) Task=`c267282a-6fa8-448b-858f-445619c79245`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:01:01,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:01:01,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:01:01,934::task::974::TaskManager.Task::(_decref) Task=`c267282a-6fa8-448b-858f-445619c79245`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:01,997::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:02,156::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:01:02,766::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:01:02,783::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000255738 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:01:03,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:01:03,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:01:03,685::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:01:03,703::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000276598 s, 14.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:01:04,003::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:04,159::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:01:04,160::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287411::DEBUG::2014-01-16 17:01:04,731::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287411::DEBUG::2014-01-16 17:01:04,732::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '37.27', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.11', 'elapsedTime': '24', 'vmType': 'kvm', 'cpuSys': '26.81', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:01:05,160::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:01:05,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:01:05,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:01:05,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:06,005::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:06,006::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:06,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:01:06,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:01:06,162::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:07,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:01:07,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:01:07,216::task::579::TaskManager.Task::(_updateState) Task=`a84b3804-bb80-42ec-939e-22bb8340be1b`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:01:07,217::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 17:01:07,218::task::579::TaskManager.Task::(_updateState) Task=`4aac9d0a-ae09-4e08-a197-1e0d7b05381c`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:01:07,218::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 17:01:07,219::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:01:07,219::task::1168::TaskManager.Task::(prepare) Task=`a84b3804-bb80-42ec-939e-22bb8340be1b`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:01:07,219::task::579::TaskManager.Task::(_updateState) Task=`a84b3804-bb80-42ec-939e-22bb8340be1b`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:01:07,220::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::INFO::2014-01-16 17:01:07,220::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:01:07,220::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:01:07,220::task::1168::TaskManager.Task::(prepare) Task=`4aac9d0a-ae09-4e08-a197-1e0d7b05381c`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:01:07,220::task::974::TaskManager.Task::(_decref) Task=`a84b3804-bb80-42ec-939e-22bb8340be1b`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:01:07,221::task::579::TaskManager.Task::(_updateState) Task=`4aac9d0a-ae09-4e08-a197-1e0d7b05381c`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:01:07,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:01:07,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:01:07,221::task::974::TaskManager.Task::(_decref) Task=`4aac9d0a-ae09-4e08-a197-1e0d7b05381c`::ref 0 aborting False >Thread-287413::DEBUG::2014-01-16 17:01:07,829::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287413::DEBUG::2014-01-16 17:01:07,830::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '37.27', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.21', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '26.81', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:01:08,007::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:08,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:01:08,166::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:01:08,166::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:01:08,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:01:08,411::task::579::TaskManager.Task::(_updateState) Task=`0d68a86e-50b3-473a-84f0-1186b2023839`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:01:08,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:01:08,411::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:01:08,411::task::1168::TaskManager.Task::(prepare) Task=`0d68a86e-50b3-473a-84f0-1186b2023839`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:01:08,412::task::579::TaskManager.Task::(_updateState) Task=`0d68a86e-50b3-473a-84f0-1186b2023839`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:01:08,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:01:08,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:01:08,412::task::974::TaskManager.Task::(_decref) Task=`0d68a86e-50b3-473a-84f0-1186b2023839`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:01:08,412::task::579::TaskManager.Task::(_updateState) Task=`db26e878-823b-439b-af07-c5e76e7b6378`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:01:08,412::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:01:08,413::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:01:08,413::task::1168::TaskManager.Task::(prepare) Task=`db26e878-823b-439b-af07-c5e76e7b6378`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:01:08,413::task::579::TaskManager.Task::(_updateState) Task=`db26e878-823b-439b-af07-c5e76e7b6378`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:01:08,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:01:08,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:01:08,413::task::974::TaskManager.Task::(_decref) Task=`db26e878-823b-439b-af07-c5e76e7b6378`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:01:09,046::task::579::TaskManager.Task::(_updateState) Task=`e0289cd4-caa7-403e-b133-8e0405dd166a`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:01:09,046::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:01:09,047::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:01:09,047::task::1168::TaskManager.Task::(prepare) Task=`e0289cd4-caa7-403e-b133-8e0405dd166a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:01:09,047::task::579::TaskManager.Task::(_updateState) Task=`e0289cd4-caa7-403e-b133-8e0405dd166a`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:01:09,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:01:09,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:01:09,047::task::974::TaskManager.Task::(_decref) Task=`e0289cd4-caa7-403e-b133-8e0405dd166a`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:01:09,048::task::579::TaskManager.Task::(_updateState) Task=`b8dd42af-d80b-4f52-ac02-65633c01755d`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:01:09,048::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:01:09,049::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:01:09,050::task::1168::TaskManager.Task::(prepare) Task=`b8dd42af-d80b-4f52-ac02-65633c01755d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:01:09,050::task::579::TaskManager.Task::(_updateState) Task=`b8dd42af-d80b-4f52-ac02-65633c01755d`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:01:09,050::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:01:09,050::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:01:09,050::task::974::TaskManager.Task::(_decref) Task=`b8dd42af-d80b-4f52-ac02-65633c01755d`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:01:09,050::task::579::TaskManager.Task::(_updateState) Task=`beea3787-71c0-4c63-8a02-69935357a56a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:01:09,051::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:01:09,051::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:01:09,051::task::1168::TaskManager.Task::(prepare) Task=`beea3787-71c0-4c63-8a02-69935357a56a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:01:09,051::task::579::TaskManager.Task::(_updateState) Task=`beea3787-71c0-4c63-8a02-69935357a56a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:01:09,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:01:09,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:01:09,052::task::974::TaskManager.Task::(_decref) Task=`beea3787-71c0-4c63-8a02-69935357a56a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:09,167::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:10,008::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:10,169::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:01:10,169::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:01:10,169::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:01:10,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:10,169::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:01:10,170::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-287415::DEBUG::2014-01-16 17:01:10,973::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287415::DEBUG::2014-01-16 17:01:10,974::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '26.54', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.34', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '3.52', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:01:11,009::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:11,172::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:12,010::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:12,173::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:01:12,173::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:01:12,173::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:01:12,785::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:01:12,789::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:01:12,790::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:01:12,795::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:01:12,796::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:01:12,796::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:01:12,797::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 17:01:12,802::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:01:12,818::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000272646 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:01:13,052::task::579::TaskManager.Task::(_updateState) Task=`4c3c21f4-74c3-4960-a3e9-49773d943854`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:01:13,052::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:01:13,052::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:01:13,053::task::1168::TaskManager.Task::(prepare) Task=`4c3c21f4-74c3-4960-a3e9-49773d943854`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:01:13,053::task::579::TaskManager.Task::(_updateState) Task=`4c3c21f4-74c3-4960-a3e9-49773d943854`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:01:13,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:01:13,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:01:13,053::task::974::TaskManager.Task::(_decref) Task=`4c3c21f4-74c3-4960-a3e9-49773d943854`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:13,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:01:13,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:01:13,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:01:13,229::task::579::TaskManager.Task::(_updateState) Task=`552cf173-69af-4eff-964a-677577cd69d6`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:01:13,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:01:13,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:01:13,230::task::1168::TaskManager.Task::(prepare) Task=`552cf173-69af-4eff-964a-677577cd69d6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:01:13,230::task::579::TaskManager.Task::(_updateState) Task=`552cf173-69af-4eff-964a-677577cd69d6`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:01:13,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:01:13,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:01:13,231::task::974::TaskManager.Task::(_decref) Task=`552cf173-69af-4eff-964a-677577cd69d6`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:01:13,711::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:01:13,729::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000215796 s, 19.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:01:14,012::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287418::DEBUG::2014-01-16 17:01:14,071::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287418::DEBUG::2014-01-16 17:01:14,072::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '26.54', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '3.52', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:01:14,176::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:01:14,176::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:01:14,177::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:01:14,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:01:14,304::task::579::TaskManager.Task::(_updateState) Task=`407ed4d1-3946-47b3-a822-7bdc904fe181`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:01:14,304::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:01:14,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:01:14,304::task::1168::TaskManager.Task::(prepare) Task=`407ed4d1-3946-47b3-a822-7bdc904fe181`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:01:14,304::task::579::TaskManager.Task::(_updateState) Task=`407ed4d1-3946-47b3-a822-7bdc904fe181`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:01:14,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:01:14,305::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:01:14,305::task::974::TaskManager.Task::(_decref) Task=`407ed4d1-3946-47b3-a822-7bdc904fe181`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:01:14,305::task::579::TaskManager.Task::(_updateState) Task=`453a52ab-cb65-4abb-81e3-9d795858407f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:01:14,305::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:01:14,306::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:01:14,306::task::1168::TaskManager.Task::(prepare) Task=`453a52ab-cb65-4abb-81e3-9d795858407f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:01:14,306::task::579::TaskManager.Task::(_updateState) Task=`453a52ab-cb65-4abb-81e3-9d795858407f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:01:14,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:01:14,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:01:14,306::task::974::TaskManager.Task::(_decref) Task=`453a52ab-cb65-4abb-81e3-9d795858407f`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 17:01:14,331::task::579::TaskManager.Task::(_updateState) Task=`8a4e8620-124c-4740-862a-581997041ea4`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:01:14,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:01:14,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:01:14,332::task::1168::TaskManager.Task::(prepare) Task=`8a4e8620-124c-4740-862a-581997041ea4`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:01:14,332::task::579::TaskManager.Task::(_updateState) Task=`8a4e8620-124c-4740-862a-581997041ea4`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:01:14,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:01:14,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:01:14,332::task::974::TaskManager.Task::(_decref) Task=`8a4e8620-124c-4740-862a-581997041ea4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:15,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:01:15,346::task::579::TaskManager.Task::(_updateState) Task=`8d21c71e-a73d-4b30-8dfe-0e794c314212`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:01:15,346::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:01:15,347::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:01:15,347::task::1168::TaskManager.Task::(prepare) Task=`8d21c71e-a73d-4b30-8dfe-0e794c314212`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:01:15,347::task::579::TaskManager.Task::(_updateState) Task=`8d21c71e-a73d-4b30-8dfe-0e794c314212`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:01:15,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:01:15,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:01:15,347::task::974::TaskManager.Task::(_decref) Task=`8d21c71e-a73d-4b30-8dfe-0e794c314212`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:01:15,709::task::579::TaskManager.Task::(_updateState) Task=`8b6e9c79-7487-4fc3-8f8e-0bd72f30ee48`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:01:15,709::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:01:15,709::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:01:15,709::task::1168::TaskManager.Task::(prepare) Task=`8b6e9c79-7487-4fc3-8f8e-0bd72f30ee48`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:01:15,710::task::579::TaskManager.Task::(_updateState) Task=`8b6e9c79-7487-4fc3-8f8e-0bd72f30ee48`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:01:15,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:01:15,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:01:15,710::task::974::TaskManager.Task::(_decref) Task=`8b6e9c79-7487-4fc3-8f8e-0bd72f30ee48`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:01:15,711::task::579::TaskManager.Task::(_updateState) Task=`745a0b3c-980f-40f3-bf65-3747f0128ca1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:01:15,711::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:01:15,711::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:01:15,711::task::1168::TaskManager.Task::(prepare) Task=`745a0b3c-980f-40f3-bf65-3747f0128ca1`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:01:15,712::task::579::TaskManager.Task::(_updateState) Task=`745a0b3c-980f-40f3-bf65-3747f0128ca1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:01:15,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:01:15,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:01:15,712::task::974::TaskManager.Task::(_decref) Task=`745a0b3c-980f-40f3-bf65-3747f0128ca1`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:01:15,712::task::579::TaskManager.Task::(_updateState) Task=`b51cba81-6d6a-4aa0-9165-0a502f1b8763`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:01:15,713::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:01:15,713::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:01:15,713::task::1168::TaskManager.Task::(prepare) Task=`b51cba81-6d6a-4aa0-9165-0a502f1b8763`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:01:15,713::task::579::TaskManager.Task::(_updateState) Task=`b51cba81-6d6a-4aa0-9165-0a502f1b8763`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:01:15,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:01:15,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:01:15,714::task::974::TaskManager.Task::(_decref) Task=`b51cba81-6d6a-4aa0-9165-0a502f1b8763`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:16,013::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:16,014::task::579::TaskManager.Task::(_updateState) Task=`5fb39b1c-00a0-4c20-a2be-a89af2d9a36c`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:01:16,014::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:01:16,014::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:01:16,014::task::1168::TaskManager.Task::(prepare) Task=`5fb39b1c-00a0-4c20-a2be-a89af2d9a36c`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:01:16,014::task::579::TaskManager.Task::(_updateState) Task=`5fb39b1c-00a0-4c20-a2be-a89af2d9a36c`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:01:16,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:01:16,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:01:16,015::task::974::TaskManager.Task::(_decref) Task=`5fb39b1c-00a0-4c20-a2be-a89af2d9a36c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:16,016::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:01:16,017::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:01:16,024::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:16,026::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:16,026::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:16,179::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:01:16,179::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:17,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287419::DEBUG::2014-01-16 17:01:17,189::task::579::TaskManager.Task::(_updateState) Task=`9c2b35ec-621a-42c2-8833-b58f90257248`::moving from state init -> state preparing >Thread-287419::INFO::2014-01-16 17:01:17,189::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287419::INFO::2014-01-16 17:01:17,190::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272646', 'lastCheck': '4.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000215796', 'lastCheck': '3.5', 'valid': True}} >Thread-287419::DEBUG::2014-01-16 17:01:17,190::task::1168::TaskManager.Task::(prepare) Task=`9c2b35ec-621a-42c2-8833-b58f90257248`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272646', 'lastCheck': '4.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000215796', 'lastCheck': '3.5', 'valid': True}} >Thread-287419::DEBUG::2014-01-16 17:01:17,190::task::579::TaskManager.Task::(_updateState) Task=`9c2b35ec-621a-42c2-8833-b58f90257248`::moving from state preparing -> state finished >Thread-287419::DEBUG::2014-01-16 17:01:17,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287419::DEBUG::2014-01-16 17:01:17,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287419::DEBUG::2014-01-16 17:01:17,190::task::974::TaskManager.Task::(_decref) Task=`9c2b35ec-621a-42c2-8833-b58f90257248`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:18,028::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:18,182::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:01:18,655::task::579::TaskManager.Task::(_updateState) Task=`04d6d4f8-4dbf-4326-ad41-4101945152ca`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:01:18,656::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:01:18,656::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:01:18,656::task::1168::TaskManager.Task::(prepare) Task=`04d6d4f8-4dbf-4326-ad41-4101945152ca`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:01:18,656::task::579::TaskManager.Task::(_updateState) Task=`04d6d4f8-4dbf-4326-ad41-4101945152ca`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:01:18,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:01:18,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:01:18,657::task::974::TaskManager.Task::(_decref) Task=`04d6d4f8-4dbf-4326-ad41-4101945152ca`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:01:18,727::task::579::TaskManager.Task::(_updateState) Task=`4bf0d889-b1f6-432c-879d-eaa9c192e6da`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:01:18,727::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:01:18,728::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:01:18,729::task::1168::TaskManager.Task::(prepare) Task=`4bf0d889-b1f6-432c-879d-eaa9c192e6da`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:01:18,729::task::579::TaskManager.Task::(_updateState) Task=`4bf0d889-b1f6-432c-879d-eaa9c192e6da`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:01:18,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:01:18,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:01:18,729::task::974::TaskManager.Task::(_decref) Task=`4bf0d889-b1f6-432c-879d-eaa9c192e6da`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:19,183::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:20,030::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:20,184::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287422::DEBUG::2014-01-16 17:01:20,779::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287422::DEBUG::2014-01-16 17:01:20,780::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '26.54', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.12', 'elapsedTime': '40', 'vmType': 'kvm', 'cpuSys': '3.52', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:01:21,032::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:21,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:22,033::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:01:22,063::task::579::TaskManager.Task::(_updateState) Task=`93ec1273-fab4-4a9f-b369-6cac8fcd4031`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:01:22,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:01:22,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:01:22,063::task::1168::TaskManager.Task::(prepare) Task=`93ec1273-fab4-4a9f-b369-6cac8fcd4031`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:01:22,064::task::579::TaskManager.Task::(_updateState) Task=`93ec1273-fab4-4a9f-b369-6cac8fcd4031`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:01:22,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:01:22,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:01:22,064::task::974::TaskManager.Task::(_decref) Task=`93ec1273-fab4-4a9f-b369-6cac8fcd4031`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:22,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:01:22,186::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:01:22,827::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:01:22,847::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00030049 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:01:23,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:01:23,734::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:01:23,750::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000233648 s, 17.5 MB/s\n'; <rc> = 0 >Thread-287424::DEBUG::2014-01-16 17:01:23,882::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287424::DEBUG::2014-01-16 17:01:23,883::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.03', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:01:24,034::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:24,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:25,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:26,036::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:26,037::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:26,191::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:01:26,492::task::579::TaskManager.Task::(_updateState) Task=`eae8a65d-99ed-4c20-b3bd-98020b4e193a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:01:26,492::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:01:26,493::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:01:26,493::task::1168::TaskManager.Task::(prepare) Task=`eae8a65d-99ed-4c20-b3bd-98020b4e193a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:01:26,493::task::579::TaskManager.Task::(_updateState) Task=`eae8a65d-99ed-4c20-b3bd-98020b4e193a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:01:26,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:01:26,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:01:26,494::task::974::TaskManager.Task::(_decref) Task=`eae8a65d-99ed-4c20-b3bd-98020b4e193a`::ref 0 aborting False >Thread-287426::DEBUG::2014-01-16 17:01:26,982::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287426::DEBUG::2014-01-16 17:01:26,983::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.03', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.31', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:01:27,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:01:27,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:01:27,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:28,038::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:28,193::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:01:28,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:29,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:01:29,194::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:01:29,195::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:01:29,947::task::579::TaskManager.Task::(_updateState) Task=`a23b0fcd-f263-4fb9-9f03-9e20d790b611`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:01:29,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:01:29,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:01:29,948::task::1168::TaskManager.Task::(prepare) Task=`a23b0fcd-f263-4fb9-9f03-9e20d790b611`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:01:29,948::task::579::TaskManager.Task::(_updateState) Task=`a23b0fcd-f263-4fb9-9f03-9e20d790b611`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:01:29,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:01:29,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:01:29,948::task::974::TaskManager.Task::(_decref) Task=`a23b0fcd-f263-4fb9-9f03-9e20d790b611`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:30,040::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287428::DEBUG::2014-01-16 17:01:30,094::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287428::DEBUG::2014-01-16 17:01:30,095::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.03', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.41', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:01:30,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:01:30,196::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:31,042::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:01:31,042::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:01:31,051::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:31,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:01:31,198::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:32,052::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:32,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:01:32,854::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:01:32,870::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000309057 s, 1.2 MB/s\n'; <rc> = 0 >Thread-287429::DEBUG::2014-01-16 17:01:33,153::task::579::TaskManager.Task::(_updateState) Task=`c3f1fb71-7195-4bef-bfd5-40cc6fd56004`::moving from state init -> state preparing >Thread-287429::INFO::2014-01-16 17:01:33,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287429::INFO::2014-01-16 17:01:33,153::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309057', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233648', 'lastCheck': '9.4', 'valid': True}} >Thread-287429::DEBUG::2014-01-16 17:01:33,154::task::1168::TaskManager.Task::(prepare) Task=`c3f1fb71-7195-4bef-bfd5-40cc6fd56004`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309057', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233648', 'lastCheck': '9.4', 'valid': True}} >Thread-287429::DEBUG::2014-01-16 17:01:33,154::task::579::TaskManager.Task::(_updateState) Task=`c3f1fb71-7195-4bef-bfd5-40cc6fd56004`::moving from state preparing -> state finished >Thread-287429::DEBUG::2014-01-16 17:01:33,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287429::DEBUG::2014-01-16 17:01:33,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287429::DEBUG::2014-01-16 17:01:33,154::task::974::TaskManager.Task::(_decref) Task=`c3f1fb71-7195-4bef-bfd5-40cc6fd56004`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:33,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:01:33,200::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:01:33,596::task::579::TaskManager.Task::(_updateState) Task=`fbf5aced-6208-4541-9189-7a4db2ab36fc`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:01:33,596::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:01:33,596::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:01:33,597::task::1168::TaskManager.Task::(prepare) Task=`fbf5aced-6208-4541-9189-7a4db2ab36fc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:01:33,597::task::579::TaskManager.Task::(_updateState) Task=`fbf5aced-6208-4541-9189-7a4db2ab36fc`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:01:33,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:01:33,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:01:33,597::task::974::TaskManager.Task::(_decref) Task=`fbf5aced-6208-4541-9189-7a4db2ab36fc`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:01:33,612::task::579::TaskManager.Task::(_updateState) Task=`7b74f287-d476-4a90-85b2-07531adb2646`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:01:33,612::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:01:33,612::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:01:33,612::task::1168::TaskManager.Task::(prepare) Task=`7b74f287-d476-4a90-85b2-07531adb2646`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:01:33,613::task::579::TaskManager.Task::(_updateState) Task=`7b74f287-d476-4a90-85b2-07531adb2646`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:01:33,613::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:01:33,613::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:01:33,613::task::974::TaskManager.Task::(_decref) Task=`7b74f287-d476-4a90-85b2-07531adb2646`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:01:33,757::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:01:33,775::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000214979 s, 19.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:01:34,053::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:01:34,108::task::579::TaskManager.Task::(_updateState) Task=`a469febd-73d9-4243-bddc-c29adf738770`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:01:34,108::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:01:34,108::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:01:34,109::task::1168::TaskManager.Task::(prepare) Task=`a469febd-73d9-4243-bddc-c29adf738770`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:01:34,109::task::579::TaskManager.Task::(_updateState) Task=`a469febd-73d9-4243-bddc-c29adf738770`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:01:34,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:01:34,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:01:34,109::task::974::TaskManager.Task::(_decref) Task=`a469febd-73d9-4243-bddc-c29adf738770`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:01:34,110::task::579::TaskManager.Task::(_updateState) Task=`7b25de91-9923-49c3-9302-4fef4214608b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:01:34,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:01:34,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:01:34,110::task::1168::TaskManager.Task::(prepare) Task=`7b25de91-9923-49c3-9302-4fef4214608b`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:01:34,110::task::579::TaskManager.Task::(_updateState) Task=`7b25de91-9923-49c3-9302-4fef4214608b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:01:34,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:01:34,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:01:34,111::task::974::TaskManager.Task::(_decref) Task=`7b25de91-9923-49c3-9302-4fef4214608b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:34,201::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:01:34,201::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:35,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:01:35,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:01:35,202::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:01:35,203::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:36,055::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:36,056::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:36,203::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:01:36,204::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:01:36,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287432::DEBUG::2014-01-16 17:01:36,686::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287432::DEBUG::2014-01-16 17:01:36,687::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.03', 'disks': {u'vda': {'readLatency': '3453805', 'apparentsize': '1073741824', 'writeLatency': '607120', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '436595', 'readRate': '24839.05', 'truesize': '1073741824', 'writeRate': '3198.45'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.99', 'elapsedTime': '55', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:01:37,205::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:01:37,205::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:38,058::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:38,206::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:01:38,206::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:01:38,206::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:01:38,206::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:01:38,707::task::579::TaskManager.Task::(_updateState) Task=`ada98d28-81ac-4004-b7ee-a5e4d1c68ba5`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:01:38,708::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:01:38,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:01:38,708::task::1168::TaskManager.Task::(prepare) Task=`ada98d28-81ac-4004-b7ee-a5e4d1c68ba5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:01:38,708::task::579::TaskManager.Task::(_updateState) Task=`ada98d28-81ac-4004-b7ee-a5e4d1c68ba5`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:01:38,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:01:38,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:01:38,709::task::974::TaskManager.Task::(_decref) Task=`ada98d28-81ac-4004-b7ee-a5e4d1c68ba5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:39,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287434::DEBUG::2014-01-16 17:01:39,784::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287434::DEBUG::2014-01-16 17:01:39,785::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.48', 'disks': {u'vda': {'readLatency': '1257200', 'apparentsize': '1073741824', 'writeLatency': '1253596', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '798792', 'readRate': '1241805.76', 'truesize': '1073741824', 'writeRate': '19361.08'}, u'hdc': {'readLatency': '11603', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.08', 'elapsedTime': '59', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:01:40,059::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:40,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:01:40,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:01:40,209::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:01:40,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:40,209::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:01:40,211::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:01:41,061::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 17:01:41,127::task::579::TaskManager.Task::(_updateState) Task=`97a8c2af-f9a1-4af6-bbce-b42a7f8fcc88`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:01:41,127::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:01:41,127::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:01:41,127::task::1168::TaskManager.Task::(prepare) Task=`97a8c2af-f9a1-4af6-bbce-b42a7f8fcc88`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:01:41,127::task::579::TaskManager.Task::(_updateState) Task=`97a8c2af-f9a1-4af6-bbce-b42a7f8fcc88`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:01:41,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:01:41,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:01:41,128::task::974::TaskManager.Task::(_decref) Task=`97a8c2af-f9a1-4af6-bbce-b42a7f8fcc88`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:41,212::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:01:42,033::task::579::TaskManager.Task::(_updateState) Task=`0ce4179a-f208-4ebd-9bb2-bc33ad7a1cdc`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:01:42,033::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:01:42,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:01:42,034::task::1168::TaskManager.Task::(prepare) Task=`0ce4179a-f208-4ebd-9bb2-bc33ad7a1cdc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:01:42,034::task::579::TaskManager.Task::(_updateState) Task=`0ce4179a-f208-4ebd-9bb2-bc33ad7a1cdc`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:01:42,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:01:42,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:01:42,034::task::974::TaskManager.Task::(_decref) Task=`0ce4179a-f208-4ebd-9bb2-bc33ad7a1cdc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:42,062::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:01:42,116::task::579::TaskManager.Task::(_updateState) Task=`b556359d-9708-4fc2-a965-acb894bd56dc`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:01:42,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:01:42,116::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:01:42,116::task::1168::TaskManager.Task::(prepare) Task=`b556359d-9708-4fc2-a965-acb894bd56dc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:01:42,117::task::579::TaskManager.Task::(_updateState) Task=`b556359d-9708-4fc2-a965-acb894bd56dc`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:01:42,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:01:42,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:01:42,117::task::974::TaskManager.Task::(_decref) Task=`b556359d-9708-4fc2-a965-acb894bd56dc`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:01:42,123::task::579::TaskManager.Task::(_updateState) Task=`3ff589df-4df6-4670-aede-bba2fbba0dec`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:01:42,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:01:42,123::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:01:42,123::task::1168::TaskManager.Task::(prepare) Task=`3ff589df-4df6-4670-aede-bba2fbba0dec`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:01:42,123::task::579::TaskManager.Task::(_updateState) Task=`3ff589df-4df6-4670-aede-bba2fbba0dec`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:01:42,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:01:42,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:01:42,124::task::974::TaskManager.Task::(_decref) Task=`3ff589df-4df6-4670-aede-bba2fbba0dec`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:42,213::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:01:42,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:01:42,214::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:01:42,751::task::579::TaskManager.Task::(_updateState) Task=`2ab6f57e-4aa4-4657-9a36-cc3649500fbd`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:01:42,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:01:42,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:01:42,752::task::1168::TaskManager.Task::(prepare) Task=`2ab6f57e-4aa4-4657-9a36-cc3649500fbd`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:01:42,752::task::579::TaskManager.Task::(_updateState) Task=`2ab6f57e-4aa4-4657-9a36-cc3649500fbd`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:01:42,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:01:42,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:01:42,752::task::974::TaskManager.Task::(_decref) Task=`2ab6f57e-4aa4-4657-9a36-cc3649500fbd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:01:42,878::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:01:42,910::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000280196 s, 1.3 MB/s\n'; <rc> = 0 >Thread-287436::DEBUG::2014-01-16 17:01:42,958::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('3ac853f1-a6ef-44aa-9695-5140e0d1b086',) {} >Thread-287436::DEBUG::2014-01-16 17:01:42,959::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24023', 'displayIp': '0', 'displayPort': u'5958', 'session': 'Unknown', 'displaySecurePort': u'5959', 'timeOffset': -2L, 'hash': '5697079326493831553', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet32': {'macAddr': '00:1a:4a:22:39:84', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet32'}}, 'vmId': '3ac853f1-a6ef-44aa-9695-5140e0d1b086', 'displayType': 'qxl', 'cpuUser': '-0.48', 'disks': {u'vda': {'readLatency': '1257200', 'apparentsize': '1073741824', 'writeLatency': '1253596', 'imageID': 'da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', 'flushLatency': '798792', 'readRate': '1241805.76', 'truesize': '1073741824', 'writeRate': '19361.08'}, u'hdc': {'readLatency': '11603', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '2.86', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.22', 'elapsedTime': '62', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-12152::DEBUG::2014-01-16 17:01:43,143::task::579::TaskManager.Task::(_updateState) Task=`95f41734-9bfa-47f3-bd7d-49b62a331224`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:01:43,143::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:01:43,143::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:01:43,144::task::1168::TaskManager.Task::(prepare) Task=`95f41734-9bfa-47f3-bd7d-49b62a331224`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:01:43,144::task::579::TaskManager.Task::(_updateState) Task=`95f41734-9bfa-47f3-bd7d-49b62a331224`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:01:43,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:01:43,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:01:43,145::task::974::TaskManager.Task::(_decref) Task=`95f41734-9bfa-47f3-bd7d-49b62a331224`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:43,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:01:43,215::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:01:43,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:01:43,782::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:01:43,801::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287279 s, 14.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:01:44,064::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:44,215::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:01:44,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:01:44,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:01:44,217::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:45,218::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:46,065::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:46,067::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:01:46,067::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:01:46,068::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:46,219::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:01:46,219::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:47,220::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:48,069::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:48,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:01:48,652::task::579::TaskManager.Task::(_updateState) Task=`8b581f14-6bd7-4248-95fb-02d4ce3ef74b`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:01:48,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:01:48,653::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:01:48,653::task::1168::TaskManager.Task::(prepare) Task=`8b581f14-6bd7-4248-95fb-02d4ce3ef74b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:01:48,653::task::579::TaskManager.Task::(_updateState) Task=`8b581f14-6bd7-4248-95fb-02d4ce3ef74b`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:01:48,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:01:48,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:01:48,654::task::974::TaskManager.Task::(_decref) Task=`8b581f14-6bd7-4248-95fb-02d4ce3ef74b`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:01:48,654::task::579::TaskManager.Task::(_updateState) Task=`b800abc7-3f14-49cb-9030-60b1d70e6207`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:01:48,654::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:01:48,654::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:01:48,655::task::1168::TaskManager.Task::(prepare) Task=`b800abc7-3f14-49cb-9030-60b1d70e6207`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:01:48,655::task::579::TaskManager.Task::(_updateState) Task=`b800abc7-3f14-49cb-9030-60b1d70e6207`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:01:48,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:01:48,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:01:48,655::task::974::TaskManager.Task::(_decref) Task=`b800abc7-3f14-49cb-9030-60b1d70e6207`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:01:48,655::task::579::TaskManager.Task::(_updateState) Task=`c8a74a3a-3ddf-48f8-8070-1a76132abf78`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:01:48,656::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:01:48,656::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:01:48,656::task::1168::TaskManager.Task::(prepare) Task=`c8a74a3a-3ddf-48f8-8070-1a76132abf78`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:01:48,656::task::579::TaskManager.Task::(_updateState) Task=`c8a74a3a-3ddf-48f8-8070-1a76132abf78`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:01:48,656::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:01:48,656::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:01:48,656::task::974::TaskManager.Task::(_decref) Task=`c8a74a3a-3ddf-48f8-8070-1a76132abf78`::ref 0 aborting False >Thread-287438::DEBUG::2014-01-16 17:01:49,123::task::579::TaskManager.Task::(_updateState) Task=`be5a687d-b17c-4a01-b3f4-6565b3bec322`::moving from state init -> state preparing >Thread-287438::INFO::2014-01-16 17:01:49,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287438::INFO::2014-01-16 17:01:49,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000280196', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287279', 'lastCheck': '5.3', 'valid': True}} >Thread-287438::DEBUG::2014-01-16 17:01:49,124::task::1168::TaskManager.Task::(prepare) Task=`be5a687d-b17c-4a01-b3f4-6565b3bec322`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000280196', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287279', 'lastCheck': '5.3', 'valid': True}} >Thread-287438::DEBUG::2014-01-16 17:01:49,124::task::579::TaskManager.Task::(_updateState) Task=`be5a687d-b17c-4a01-b3f4-6565b3bec322`::moving from state preparing -> state finished >Thread-287438::DEBUG::2014-01-16 17:01:49,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287438::DEBUG::2014-01-16 17:01:49,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287438::DEBUG::2014-01-16 17:01:49,125::task::974::TaskManager.Task::(_decref) Task=`be5a687d-b17c-4a01-b3f4-6565b3bec322`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:01:49,228::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:50,071::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:50,228::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:01:50,650::task::579::TaskManager.Task::(_updateState) Task=`fef8486f-224e-43ba-ba93-fa4facc173e9`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:01:50,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:01:50,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:01:50,651::task::1168::TaskManager.Task::(prepare) Task=`fef8486f-224e-43ba-ba93-fa4facc173e9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:01:50,651::task::579::TaskManager.Task::(_updateState) Task=`fef8486f-224e-43ba-ba93-fa4facc173e9`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:01:50,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:01:50,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:01:50,652::task::974::TaskManager.Task::(_decref) Task=`fef8486f-224e-43ba-ba93-fa4facc173e9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:51,072::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:51,229::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:52,073::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:52,229::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:01:52,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:01:52,922::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:01:52,939::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00030243 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:01:53,231::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:01:53,807::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:01:53,826::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000285365 s, 14.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:01:54,075::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:54,232::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:55,233::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:01:55,618::task::579::TaskManager.Task::(_updateState) Task=`48ee731c-6817-4641-91f8-e65c7512db7f`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:01:55,619::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:01:55,619::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:01:55,619::task::1168::TaskManager.Task::(prepare) Task=`48ee731c-6817-4641-91f8-e65c7512db7f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:01:55,620::task::579::TaskManager.Task::(_updateState) Task=`48ee731c-6817-4641-91f8-e65c7512db7f`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:01:55,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:01:55,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:01:55,620::task::974::TaskManager.Task::(_decref) Task=`48ee731c-6817-4641-91f8-e65c7512db7f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:01:56,076::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:01:56,077::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:56,235::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:57,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:01:57,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:01:57,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:01:58,078::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:01:58,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:01:58,238::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:01:59,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:01:59,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:01:59,239::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:00,080::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:00,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:02:00,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:01,082::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:02:01,083::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:02:01,084::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:01,242::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:02:01,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:02,085::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:02:02,112::task::579::TaskManager.Task::(_updateState) Task=`c273eef8-4561-4599-9dc1-8d9ad40dc932`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:02:02,112::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:02:02,113::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:02:02,113::task::1168::TaskManager.Task::(prepare) Task=`c273eef8-4561-4599-9dc1-8d9ad40dc932`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:02:02,113::task::579::TaskManager.Task::(_updateState) Task=`c273eef8-4561-4599-9dc1-8d9ad40dc932`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:02:02,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:02:02,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:02:02,113::task::974::TaskManager.Task::(_decref) Task=`c273eef8-4561-4599-9dc1-8d9ad40dc932`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:02,243::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:02:02,946::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:02:02,963::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264691 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:02:03,245::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:02:03,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:02:03,834::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:02:03,856::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000296554 s, 13.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:02:04,087::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:04,246::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:02:04,246::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287444::DEBUG::2014-01-16 17:02:04,940::task::579::TaskManager.Task::(_updateState) Task=`5b1ceea2-d9ab-4d01-b01e-c13b1544dd9e`::moving from state init -> state preparing >Thread-287444::INFO::2014-01-16 17:02:04,941::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287444::INFO::2014-01-16 17:02:04,941::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264691', 'lastCheck': '2.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296554', 'lastCheck': '1.1', 'valid': True}} >Thread-287444::DEBUG::2014-01-16 17:02:04,941::task::1168::TaskManager.Task::(prepare) Task=`5b1ceea2-d9ab-4d01-b01e-c13b1544dd9e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264691', 'lastCheck': '2.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296554', 'lastCheck': '1.1', 'valid': True}} >Thread-287444::DEBUG::2014-01-16 17:02:04,941::task::579::TaskManager.Task::(_updateState) Task=`5b1ceea2-d9ab-4d01-b01e-c13b1544dd9e`::moving from state preparing -> state finished >Thread-287444::DEBUG::2014-01-16 17:02:04,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287444::DEBUG::2014-01-16 17:02:04,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287444::DEBUG::2014-01-16 17:02:04,942::task::974::TaskManager.Task::(_decref) Task=`5b1ceea2-d9ab-4d01-b01e-c13b1544dd9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:05,247::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:02:05,247::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:02:05,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:02:05,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:06,088::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:06,089::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:06,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:02:06,248::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:02:06,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:07,250::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:02:07,250::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 17:02:07,322::task::579::TaskManager.Task::(_updateState) Task=`d3270e97-9669-4eb3-94dd-70389052cdc3`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 17:02:07,322::task::579::TaskManager.Task::(_updateState) Task=`a94485f5-10f2-4a5f-a71a-187a0b3744b9`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:02:07,322::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 17:02:07,323::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 17:02:07,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 17:02:07,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:02:07,324::task::1168::TaskManager.Task::(prepare) Task=`d3270e97-9669-4eb3-94dd-70389052cdc3`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:02:07,324::task::1168::TaskManager.Task::(prepare) Task=`a94485f5-10f2-4a5f-a71a-187a0b3744b9`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:02:07,325::task::579::TaskManager.Task::(_updateState) Task=`d3270e97-9669-4eb3-94dd-70389052cdc3`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:02:07,325::task::579::TaskManager.Task::(_updateState) Task=`a94485f5-10f2-4a5f-a71a-187a0b3744b9`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:02:07,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:02:07,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:02:07,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:02:07,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:02:07,326::task::974::TaskManager.Task::(_decref) Task=`d3270e97-9669-4eb3-94dd-70389052cdc3`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:02:07,326::task::974::TaskManager.Task::(_decref) Task=`a94485f5-10f2-4a5f-a71a-187a0b3744b9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:02:08,090::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:08,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:02:08,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:02:08,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:02:08,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:02:08,644::task::579::TaskManager.Task::(_updateState) Task=`19a1fadc-1958-43fc-974b-db0bc87913a7`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:02:08,644::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:02:08,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:02:08,645::task::1168::TaskManager.Task::(prepare) Task=`19a1fadc-1958-43fc-974b-db0bc87913a7`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:02:08,645::task::579::TaskManager.Task::(_updateState) Task=`19a1fadc-1958-43fc-974b-db0bc87913a7`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:02:08,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:02:08,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:02:08,646::task::974::TaskManager.Task::(_decref) Task=`19a1fadc-1958-43fc-974b-db0bc87913a7`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:02:08,646::task::579::TaskManager.Task::(_updateState) Task=`84007de8-934b-4f1c-b9b9-b79149a327f1`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:02:08,646::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:02:08,646::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:02:08,646::task::1168::TaskManager.Task::(prepare) Task=`84007de8-934b-4f1c-b9b9-b79149a327f1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:02:08,647::task::579::TaskManager.Task::(_updateState) Task=`84007de8-934b-4f1c-b9b9-b79149a327f1`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:02:08,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:02:08,647::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:02:08,647::task::974::TaskManager.Task::(_decref) Task=`84007de8-934b-4f1c-b9b9-b79149a327f1`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:02:09,158::task::579::TaskManager.Task::(_updateState) Task=`3ed7221e-b497-42a6-ad84-cedbe42bf503`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:02:09,159::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:02:09,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:02:09,160::task::1168::TaskManager.Task::(prepare) Task=`3ed7221e-b497-42a6-ad84-cedbe42bf503`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:02:09,160::task::579::TaskManager.Task::(_updateState) Task=`3ed7221e-b497-42a6-ad84-cedbe42bf503`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:02:09,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:02:09,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:02:09,161::task::974::TaskManager.Task::(_decref) Task=`3ed7221e-b497-42a6-ad84-cedbe42bf503`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:02:09,161::task::579::TaskManager.Task::(_updateState) Task=`9100ca5e-6f28-4e08-9846-d100f9a5b838`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:02:09,161::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:02:09,161::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:02:09,162::task::1168::TaskManager.Task::(prepare) Task=`9100ca5e-6f28-4e08-9846-d100f9a5b838`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:02:09,162::task::579::TaskManager.Task::(_updateState) Task=`9100ca5e-6f28-4e08-9846-d100f9a5b838`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:02:09,162::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:02:09,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:02:09,162::task::974::TaskManager.Task::(_decref) Task=`9100ca5e-6f28-4e08-9846-d100f9a5b838`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:02:09,227::task::579::TaskManager.Task::(_updateState) Task=`1ab6dd76-c4d5-42ea-90dc-a8f364d3995b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:02:09,227::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:02:09,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:02:09,228::task::1168::TaskManager.Task::(prepare) Task=`1ab6dd76-c4d5-42ea-90dc-a8f364d3995b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:02:09,228::task::579::TaskManager.Task::(_updateState) Task=`1ab6dd76-c4d5-42ea-90dc-a8f364d3995b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:02:09,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:02:09,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:02:09,228::task::974::TaskManager.Task::(_decref) Task=`1ab6dd76-c4d5-42ea-90dc-a8f364d3995b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:09,252::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:10,092::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:10,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:02:10,254::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:02:10,254::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:02:10,254::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:10,254::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:02:10,255::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:02:11,093::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:11,256::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:12,094::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:12,257::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:02:12,257::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:02:12,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:02:12,971::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:02:12,987::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279877 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:02:13,199::task::579::TaskManager.Task::(_updateState) Task=`e7a9aefa-d3cf-4051-8c1a-cfed0be3bc66`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:02:13,199::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:02:13,200::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:02:13,200::task::1168::TaskManager.Task::(prepare) Task=`e7a9aefa-d3cf-4051-8c1a-cfed0be3bc66`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:02:13,200::task::579::TaskManager.Task::(_updateState) Task=`e7a9aefa-d3cf-4051-8c1a-cfed0be3bc66`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:02:13,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:02:13,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:02:13,201::task::974::TaskManager.Task::(_decref) Task=`e7a9aefa-d3cf-4051-8c1a-cfed0be3bc66`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:13,258::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:02:13,259::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:02:13,259::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:02:13,408::task::579::TaskManager.Task::(_updateState) Task=`1b9065d6-16a5-4a8c-9d13-c2ce344edc26`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:02:13,408::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:02:13,409::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:02:13,409::task::1168::TaskManager.Task::(prepare) Task=`1b9065d6-16a5-4a8c-9d13-c2ce344edc26`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:02:13,409::task::579::TaskManager.Task::(_updateState) Task=`1b9065d6-16a5-4a8c-9d13-c2ce344edc26`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:02:13,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:02:13,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:02:13,410::task::974::TaskManager.Task::(_decref) Task=`1b9065d6-16a5-4a8c-9d13-c2ce344edc26`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:02:13,862::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:02:13,878::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000277993 s, 14.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:02:14,096::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:14,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:02:14,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:02:14,260::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:02:14,261::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:02:14,519::task::579::TaskManager.Task::(_updateState) Task=`88bf6214-d833-40ad-acdd-f04674e41611`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:02:14,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:02:14,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:02:14,520::task::1168::TaskManager.Task::(prepare) Task=`88bf6214-d833-40ad-acdd-f04674e41611`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:02:14,520::task::579::TaskManager.Task::(_updateState) Task=`88bf6214-d833-40ad-acdd-f04674e41611`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:02:14,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:02:14,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:02:14,520::task::974::TaskManager.Task::(_decref) Task=`88bf6214-d833-40ad-acdd-f04674e41611`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:02:14,529::task::579::TaskManager.Task::(_updateState) Task=`3f951ba9-8078-471c-99e8-254a6c0fe8d7`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:02:14,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:02:14,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:02:14,530::task::1168::TaskManager.Task::(prepare) Task=`3f951ba9-8078-471c-99e8-254a6c0fe8d7`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:02:14,530::task::579::TaskManager.Task::(_updateState) Task=`3f951ba9-8078-471c-99e8-254a6c0fe8d7`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:02:14,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:02:14,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:02:14,531::task::974::TaskManager.Task::(_decref) Task=`3f951ba9-8078-471c-99e8-254a6c0fe8d7`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:02:14,531::task::579::TaskManager.Task::(_updateState) Task=`4161ff95-01a6-4d40-8c5d-f349f9583316`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:02:14,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:02:14,531::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:02:14,531::task::1168::TaskManager.Task::(prepare) Task=`4161ff95-01a6-4d40-8c5d-f349f9583316`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:02:14,532::task::579::TaskManager.Task::(_updateState) Task=`4161ff95-01a6-4d40-8c5d-f349f9583316`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:02:14,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:02:14,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:02:14,532::task::974::TaskManager.Task::(_decref) Task=`4161ff95-01a6-4d40-8c5d-f349f9583316`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:15,261::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:02:15,516::task::579::TaskManager.Task::(_updateState) Task=`f3d9daf9-007b-47e8-a2b4-7ab35a321c77`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:02:15,517::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:02:15,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:02:15,517::task::1168::TaskManager.Task::(prepare) Task=`f3d9daf9-007b-47e8-a2b4-7ab35a321c77`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:02:15,517::task::579::TaskManager.Task::(_updateState) Task=`f3d9daf9-007b-47e8-a2b4-7ab35a321c77`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:02:15,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:02:15,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:02:15,518::task::974::TaskManager.Task::(_decref) Task=`f3d9daf9-007b-47e8-a2b4-7ab35a321c77`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:02:16,097::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:16,098::task::579::TaskManager.Task::(_updateState) Task=`578683a5-6a26-4a9a-94fc-b206e7df3581`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:02:16,098::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:02:16,098::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:02:16,098::task::1168::TaskManager.Task::(prepare) Task=`578683a5-6a26-4a9a-94fc-b206e7df3581`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:02:16,098::task::579::TaskManager.Task::(_updateState) Task=`578683a5-6a26-4a9a-94fc-b206e7df3581`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:02:16,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:02:16,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:02:16,099::task::974::TaskManager.Task::(_decref) Task=`578683a5-6a26-4a9a-94fc-b206e7df3581`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:02:16,100::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:02:16,101::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:02:16,102::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:16,103::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:16,104::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:16,263::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:02:16,263::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:02:16,296::task::579::TaskManager.Task::(_updateState) Task=`a15c334a-333b-43a2-abfb-4e73d160d3ba`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:02:16,296::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:02:16,296::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:02:16,296::task::1168::TaskManager.Task::(prepare) Task=`a15c334a-333b-43a2-abfb-4e73d160d3ba`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:02:16,297::task::579::TaskManager.Task::(_updateState) Task=`a15c334a-333b-43a2-abfb-4e73d160d3ba`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:02:16,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:02:16,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:02:16,297::task::974::TaskManager.Task::(_decref) Task=`a15c334a-333b-43a2-abfb-4e73d160d3ba`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:02:16,297::task::579::TaskManager.Task::(_updateState) Task=`9e78fe04-ebdf-4c45-a8ba-ae36a201dab5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:02:16,297::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:02:16,298::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:02:16,298::task::1168::TaskManager.Task::(prepare) Task=`9e78fe04-ebdf-4c45-a8ba-ae36a201dab5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:02:16,298::task::579::TaskManager.Task::(_updateState) Task=`9e78fe04-ebdf-4c45-a8ba-ae36a201dab5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:02:16,298::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:02:16,298::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:02:16,298::task::974::TaskManager.Task::(_decref) Task=`9e78fe04-ebdf-4c45-a8ba-ae36a201dab5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:02:16,299::task::579::TaskManager.Task::(_updateState) Task=`6ec93321-44bb-480b-8d2e-d10e5662e330`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:02:16,299::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:02:16,299::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:02:16,299::task::1168::TaskManager.Task::(prepare) Task=`6ec93321-44bb-480b-8d2e-d10e5662e330`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:02:16,299::task::579::TaskManager.Task::(_updateState) Task=`6ec93321-44bb-480b-8d2e-d10e5662e330`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:02:16,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:02:16,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:02:16,300::task::974::TaskManager.Task::(_decref) Task=`6ec93321-44bb-480b-8d2e-d10e5662e330`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:17,264::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:18,105::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:18,265::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:02:18,843::task::579::TaskManager.Task::(_updateState) Task=`527b6461-78cd-4125-a081-f043efa2c54c`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:02:18,844::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:02:18,844::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:02:18,844::task::1168::TaskManager.Task::(prepare) Task=`527b6461-78cd-4125-a081-f043efa2c54c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:02:18,845::task::579::TaskManager.Task::(_updateState) Task=`527b6461-78cd-4125-a081-f043efa2c54c`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:02:18,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:02:18,845::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:02:18,845::task::974::TaskManager.Task::(_decref) Task=`527b6461-78cd-4125-a081-f043efa2c54c`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:02:18,859::task::579::TaskManager.Task::(_updateState) Task=`8b213164-24e1-431a-9cb4-ba55a5ed6b15`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:02:18,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:02:18,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:02:18,861::task::1168::TaskManager.Task::(prepare) Task=`8b213164-24e1-431a-9cb4-ba55a5ed6b15`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:02:18,861::task::579::TaskManager.Task::(_updateState) Task=`8b213164-24e1-431a-9cb4-ba55a5ed6b15`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:02:18,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:02:18,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:02:18,862::task::974::TaskManager.Task::(_decref) Task=`8b213164-24e1-431a-9cb4-ba55a5ed6b15`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:19,267::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:20,107::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:20,268::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287450::DEBUG::2014-01-16 17:02:20,734::task::579::TaskManager.Task::(_updateState) Task=`e26c740f-26ce-4dd3-b503-cfd0d40e33e4`::moving from state init -> state preparing >Thread-287450::INFO::2014-01-16 17:02:20,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287450::INFO::2014-01-16 17:02:20,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279877', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277993', 'lastCheck': '6.9', 'valid': True}} >Thread-287450::DEBUG::2014-01-16 17:02:20,735::task::1168::TaskManager.Task::(prepare) Task=`e26c740f-26ce-4dd3-b503-cfd0d40e33e4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279877', 'lastCheck': '7.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277993', 'lastCheck': '6.9', 'valid': True}} >Thread-287450::DEBUG::2014-01-16 17:02:20,735::task::579::TaskManager.Task::(_updateState) Task=`e26c740f-26ce-4dd3-b503-cfd0d40e33e4`::moving from state preparing -> state finished >Thread-287450::DEBUG::2014-01-16 17:02:20,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287450::DEBUG::2014-01-16 17:02:20,735::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287450::DEBUG::2014-01-16 17:02:20,735::task::974::TaskManager.Task::(_decref) Task=`e26c740f-26ce-4dd3-b503-cfd0d40e33e4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:02:21,108::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:21,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:22,109::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:02:22,233::task::579::TaskManager.Task::(_updateState) Task=`bca69d76-ed25-423e-bad1-9cf301848d5d`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:02:22,233::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:02:22,234::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:02:22,234::task::1168::TaskManager.Task::(prepare) Task=`bca69d76-ed25-423e-bad1-9cf301848d5d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:02:22,234::task::579::TaskManager.Task::(_updateState) Task=`bca69d76-ed25-423e-bad1-9cf301848d5d`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:02:22,234::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:02:22,234::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:02:22,234::task::974::TaskManager.Task::(_decref) Task=`bca69d76-ed25-423e-bad1-9cf301848d5d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:22,270::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:02:22,270::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:02:22,995::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:02:23,011::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300299 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:02:23,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:02:23,884::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:02:23,901::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00023218 s, 17.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:02:24,111::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:24,273::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:25,274::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:26,112::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:26,113::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:26,276::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:02:26,563::task::579::TaskManager.Task::(_updateState) Task=`60753b95-3d61-4bfe-8f6e-354cef63f759`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:02:26,564::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:02:26,564::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:02:26,564::task::1168::TaskManager.Task::(prepare) Task=`60753b95-3d61-4bfe-8f6e-354cef63f759`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:02:26,564::task::579::TaskManager.Task::(_updateState) Task=`60753b95-3d61-4bfe-8f6e-354cef63f759`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:02:26,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:02:26,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:02:26,565::task::974::TaskManager.Task::(_decref) Task=`60753b95-3d61-4bfe-8f6e-354cef63f759`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:27,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:02:27,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:02:27,278::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:28,114::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:28,279::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:02:28,279::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:29,280::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:02:29,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:02:29,281::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:02:30,115::task::579::TaskManager.Task::(_updateState) Task=`07062902-5517-48c7-b090-6e3683774d12`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:02:30,116::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:02:30,116::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:02:30,116::task::1168::TaskManager.Task::(prepare) Task=`07062902-5517-48c7-b090-6e3683774d12`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189817::DEBUG::2014-01-16 17:02:30,116::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:02:30,116::task::579::TaskManager.Task::(_updateState) Task=`07062902-5517-48c7-b090-6e3683774d12`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:02:30,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:02:30,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:02:30,117::task::974::TaskManager.Task::(_decref) Task=`07062902-5517-48c7-b090-6e3683774d12`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:30,282::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:02:30,283::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:31,119::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:02:31,119::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:02:31,121::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:31,283::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:02:31,284::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:32,122::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:32,285::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:02:33,018::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:02:33,035::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289969 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:02:33,286::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:02:33,287::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:02:33,772::task::579::TaskManager.Task::(_updateState) Task=`edaa2266-beb4-47ed-80c6-f45364f2832f`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:02:33,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:02:33,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:02:33,773::task::1168::TaskManager.Task::(prepare) Task=`edaa2266-beb4-47ed-80c6-f45364f2832f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:02:33,773::task::579::TaskManager.Task::(_updateState) Task=`edaa2266-beb4-47ed-80c6-f45364f2832f`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:02:33,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:02:33,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:02:33,773::task::974::TaskManager.Task::(_decref) Task=`edaa2266-beb4-47ed-80c6-f45364f2832f`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:02:33,783::task::579::TaskManager.Task::(_updateState) Task=`fa6130d2-7090-486b-aabe-59ba73bcea85`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:02:33,783::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:02:33,784::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:02:33,784::task::1168::TaskManager.Task::(prepare) Task=`fa6130d2-7090-486b-aabe-59ba73bcea85`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:02:33,784::task::579::TaskManager.Task::(_updateState) Task=`fa6130d2-7090-486b-aabe-59ba73bcea85`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:02:33,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:02:33,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:02:33,784::task::974::TaskManager.Task::(_decref) Task=`fa6130d2-7090-486b-aabe-59ba73bcea85`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:02:33,908::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:02:33,926::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024823 s, 16.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:02:34,124::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:34,288::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:02:34,288::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:02:34,487::task::579::TaskManager.Task::(_updateState) Task=`60077315-468f-418c-bc01-b705ce52c64b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:02:34,487::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:02:34,487::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:02:34,488::task::1168::TaskManager.Task::(prepare) Task=`60077315-468f-418c-bc01-b705ce52c64b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:02:34,488::task::579::TaskManager.Task::(_updateState) Task=`60077315-468f-418c-bc01-b705ce52c64b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:02:34,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:02:34,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:02:34,488::task::974::TaskManager.Task::(_decref) Task=`60077315-468f-418c-bc01-b705ce52c64b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:02:34,489::task::579::TaskManager.Task::(_updateState) Task=`402628bb-b7d9-4e89-861e-b51e027a416a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:02:34,489::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:02:34,489::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:02:34,489::task::1168::TaskManager.Task::(prepare) Task=`402628bb-b7d9-4e89-861e-b51e027a416a`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:02:34,489::task::579::TaskManager.Task::(_updateState) Task=`402628bb-b7d9-4e89-861e-b51e027a416a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:02:34,490::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:02:34,490::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:02:34,490::task::974::TaskManager.Task::(_decref) Task=`402628bb-b7d9-4e89-861e-b51e027a416a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:35,289::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:02:35,289::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:02:35,290::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:02:35,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:36,126::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:36,127::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:36,290::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:02:36,291::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:02:36,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287456::DEBUG::2014-01-16 17:02:36,585::task::579::TaskManager.Task::(_updateState) Task=`bbb40603-37be-4bf4-b03b-9c4d40f3a56c`::moving from state init -> state preparing >Thread-287456::INFO::2014-01-16 17:02:36,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287456::INFO::2014-01-16 17:02:36,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289969', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024823', 'lastCheck': '2.7', 'valid': True}} >Thread-287456::DEBUG::2014-01-16 17:02:36,586::task::1168::TaskManager.Task::(prepare) Task=`bbb40603-37be-4bf4-b03b-9c4d40f3a56c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289969', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024823', 'lastCheck': '2.7', 'valid': True}} >Thread-287456::DEBUG::2014-01-16 17:02:36,586::task::579::TaskManager.Task::(_updateState) Task=`bbb40603-37be-4bf4-b03b-9c4d40f3a56c`::moving from state preparing -> state finished >Thread-287456::DEBUG::2014-01-16 17:02:36,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287456::DEBUG::2014-01-16 17:02:36,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287456::DEBUG::2014-01-16 17:02:36,586::task::974::TaskManager.Task::(_decref) Task=`bbb40603-37be-4bf4-b03b-9c4d40f3a56c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:37,293::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:02:37,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:38,128::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:38,294::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:02:38,295::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:02:38,295::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:02:38,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:02:38,895::task::579::TaskManager.Task::(_updateState) Task=`d86dee19-0389-4532-9dc8-84fbc0d3f632`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:02:38,896::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:02:38,896::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:02:38,896::task::1168::TaskManager.Task::(prepare) Task=`d86dee19-0389-4532-9dc8-84fbc0d3f632`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:02:38,896::task::579::TaskManager.Task::(_updateState) Task=`d86dee19-0389-4532-9dc8-84fbc0d3f632`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:02:38,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:02:38,897::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:02:38,897::task::974::TaskManager.Task::(_decref) Task=`d86dee19-0389-4532-9dc8-84fbc0d3f632`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:39,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:40,129::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:40,297::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:02:40,297::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:02:40,298::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:02:40,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:40,298::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:02:40,299::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:02:41,130::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 17:02:41,295::task::579::TaskManager.Task::(_updateState) Task=`ece83772-3e55-49d6-bc5d-dbeae190b942`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:02:41,295::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:02:41,296::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:02:41,296::task::1168::TaskManager.Task::(prepare) Task=`ece83772-3e55-49d6-bc5d-dbeae190b942`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:02:41,296::task::579::TaskManager.Task::(_updateState) Task=`ece83772-3e55-49d6-bc5d-dbeae190b942`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:02:41,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:02:41,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:02:41,296::task::974::TaskManager.Task::(_decref) Task=`ece83772-3e55-49d6-bc5d-dbeae190b942`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:41,300::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:42,131::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 17:02:42,194::task::579::TaskManager.Task::(_updateState) Task=`3ad54837-d3a2-4b50-add4-b4d0fdc001e2`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:02:42,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:02:42,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:02:42,195::task::1168::TaskManager.Task::(prepare) Task=`3ad54837-d3a2-4b50-add4-b4d0fdc001e2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:02:42,195::task::579::TaskManager.Task::(_updateState) Task=`3ad54837-d3a2-4b50-add4-b4d0fdc001e2`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:02:42,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:02:42,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:02:42,195::task::974::TaskManager.Task::(_decref) Task=`3ad54837-d3a2-4b50-add4-b4d0fdc001e2`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:02:42,289::task::579::TaskManager.Task::(_updateState) Task=`fd0d34e1-62fa-4425-8633-c6218acd87e7`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:02:42,290::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:02:42,290::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:02:42,290::task::1168::TaskManager.Task::(prepare) Task=`fd0d34e1-62fa-4425-8633-c6218acd87e7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:02:42,290::task::579::TaskManager.Task::(_updateState) Task=`fd0d34e1-62fa-4425-8633-c6218acd87e7`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:02:42,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:02:42,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:02:42,291::task::974::TaskManager.Task::(_decref) Task=`fd0d34e1-62fa-4425-8633-c6218acd87e7`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:02:42,295::task::579::TaskManager.Task::(_updateState) Task=`90100eae-0bc1-426d-a352-4b4d5aff0929`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:02:42,295::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:02:42,295::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:02:42,295::task::1168::TaskManager.Task::(prepare) Task=`90100eae-0bc1-426d-a352-4b4d5aff0929`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:02:42,296::task::579::TaskManager.Task::(_updateState) Task=`90100eae-0bc1-426d-a352-4b4d5aff0929`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:02:42,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:02:42,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:02:42,296::task::974::TaskManager.Task::(_decref) Task=`90100eae-0bc1-426d-a352-4b4d5aff0929`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:42,301::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:02:42,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:02:42,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:02:42,914::task::579::TaskManager.Task::(_updateState) Task=`1faf76e5-5fb5-4f44-b21e-7f1d900bd6b6`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:02:42,914::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:02:42,915::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:02:42,915::task::1168::TaskManager.Task::(prepare) Task=`1faf76e5-5fb5-4f44-b21e-7f1d900bd6b6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:02:42,915::task::579::TaskManager.Task::(_updateState) Task=`1faf76e5-5fb5-4f44-b21e-7f1d900bd6b6`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:02:42,915::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:02:42,915::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:02:42,915::task::974::TaskManager.Task::(_decref) Task=`1faf76e5-5fb5-4f44-b21e-7f1d900bd6b6`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:02:43,042::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:02:43,059::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257416 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:02:43,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:02:43,304::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:02:43,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:02:43,308::task::579::TaskManager.Task::(_updateState) Task=`dd252d25-9690-42da-86fc-0d0ea9d4bf8f`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:02:43,308::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:02:43,309::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:02:43,309::task::1168::TaskManager.Task::(prepare) Task=`dd252d25-9690-42da-86fc-0d0ea9d4bf8f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:02:43,309::task::579::TaskManager.Task::(_updateState) Task=`dd252d25-9690-42da-86fc-0d0ea9d4bf8f`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:02:43,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:02:43,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:02:43,309::task::974::TaskManager.Task::(_decref) Task=`dd252d25-9690-42da-86fc-0d0ea9d4bf8f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:02:43,935::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:02:43,956::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000362912 s, 11.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:02:44,133::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:44,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:02:44,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:02:44,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:02:44,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:45,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:46,134::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:46,136::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:02:46,137::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:02:46,138::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:46,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:02:46,308::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:47,309::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:48,139::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:48,310::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:02:48,941::task::579::TaskManager.Task::(_updateState) Task=`74da1c4d-80ce-4b57-9004-65d8916e5170`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:02:48,942::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:02:48,942::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:02:48,942::task::1168::TaskManager.Task::(prepare) Task=`74da1c4d-80ce-4b57-9004-65d8916e5170`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:02:48,942::task::579::TaskManager.Task::(_updateState) Task=`74da1c4d-80ce-4b57-9004-65d8916e5170`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:02:48,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:02:48,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:02:48,943::task::974::TaskManager.Task::(_decref) Task=`74da1c4d-80ce-4b57-9004-65d8916e5170`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:02:48,943::task::579::TaskManager.Task::(_updateState) Task=`6b760468-b469-4833-8f23-c736f599aa11`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:02:48,943::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:02:48,943::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:02:48,943::task::1168::TaskManager.Task::(prepare) Task=`6b760468-b469-4833-8f23-c736f599aa11`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:02:48,944::task::579::TaskManager.Task::(_updateState) Task=`6b760468-b469-4833-8f23-c736f599aa11`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:02:48,944::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:02:48,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:02:48,944::task::974::TaskManager.Task::(_decref) Task=`6b760468-b469-4833-8f23-c736f599aa11`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:02:48,944::task::579::TaskManager.Task::(_updateState) Task=`5f63cb28-c830-4a4c-b001-6864f4f76be9`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:02:48,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:02:48,945::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:02:48,945::task::1168::TaskManager.Task::(prepare) Task=`5f63cb28-c830-4a4c-b001-6864f4f76be9`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:02:48,945::task::579::TaskManager.Task::(_updateState) Task=`5f63cb28-c830-4a4c-b001-6864f4f76be9`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:02:48,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:02:48,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:02:48,945::task::974::TaskManager.Task::(_decref) Task=`5f63cb28-c830-4a4c-b001-6864f4f76be9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:02:49,311::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:50,140::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:50,312::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:02:50,811::task::579::TaskManager.Task::(_updateState) Task=`b510a45d-3faf-436d-9fc2-249362b64b9d`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:02:50,812::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:02:50,812::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:02:50,812::task::1168::TaskManager.Task::(prepare) Task=`b510a45d-3faf-436d-9fc2-249362b64b9d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:02:50,812::task::579::TaskManager.Task::(_updateState) Task=`b510a45d-3faf-436d-9fc2-249362b64b9d`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:02:50,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:02:50,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:02:50,812::task::974::TaskManager.Task::(_decref) Task=`b510a45d-3faf-436d-9fc2-249362b64b9d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:02:51,142::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:51,313::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:52,143::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:52,314::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:02:52,314::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287462::DEBUG::2014-01-16 17:02:52,363::task::579::TaskManager.Task::(_updateState) Task=`7594c54e-382f-48c4-b571-c46d4c57dbf5`::moving from state init -> state preparing >Thread-287462::INFO::2014-01-16 17:02:52,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287462::INFO::2014-01-16 17:02:52,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257416', 'lastCheck': '9.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362912', 'lastCheck': '8.4', 'valid': True}} >Thread-287462::DEBUG::2014-01-16 17:02:52,364::task::1168::TaskManager.Task::(prepare) Task=`7594c54e-382f-48c4-b571-c46d4c57dbf5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000257416', 'lastCheck': '9.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362912', 'lastCheck': '8.4', 'valid': True}} >Thread-287462::DEBUG::2014-01-16 17:02:52,364::task::579::TaskManager.Task::(_updateState) Task=`7594c54e-382f-48c4-b571-c46d4c57dbf5`::moving from state preparing -> state finished >Thread-287462::DEBUG::2014-01-16 17:02:52,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287462::DEBUG::2014-01-16 17:02:52,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287462::DEBUG::2014-01-16 17:02:52,364::task::974::TaskManager.Task::(_decref) Task=`7594c54e-382f-48c4-b571-c46d4c57dbf5`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:02:53,067::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:02:53,083::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266873 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:02:53,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:02:53,961::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:02:53,982::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000250566 s, 16.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:02:54,145::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:54,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:55,317::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:02:55,792::task::579::TaskManager.Task::(_updateState) Task=`53360f1e-6fee-4ad0-834c-f6934d83b2c5`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:02:55,793::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:02:55,793::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:02:55,793::task::1168::TaskManager.Task::(prepare) Task=`53360f1e-6fee-4ad0-834c-f6934d83b2c5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:02:55,793::task::579::TaskManager.Task::(_updateState) Task=`53360f1e-6fee-4ad0-834c-f6934d83b2c5`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:02:55,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:02:55,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:02:55,794::task::974::TaskManager.Task::(_decref) Task=`53360f1e-6fee-4ad0-834c-f6934d83b2c5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:02:56,146::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:02:56,147::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:56,318::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:57,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:02:57,320::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:02:57,320::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:02:58,148::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:02:58,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:02:58,321::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:02:59,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:02:59,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:02:59,323::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:00,150::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:00,324::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:03:00,324::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:01,152::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:03:01,152::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:03:01,154::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:01,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:03:01,326::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:02,156::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:03:02,272::task::579::TaskManager.Task::(_updateState) Task=`47c91b54-3e22-4272-abea-f1e372f2077e`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:03:02,272::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:03:02,273::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:03:02,273::task::1168::TaskManager.Task::(prepare) Task=`47c91b54-3e22-4272-abea-f1e372f2077e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:03:02,273::task::579::TaskManager.Task::(_updateState) Task=`47c91b54-3e22-4272-abea-f1e372f2077e`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:03:02,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:03:02,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:03:02,273::task::974::TaskManager.Task::(_decref) Task=`47c91b54-3e22-4272-abea-f1e372f2077e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:02,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:03:03,090::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:03:03,111::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271209 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:03:03,328::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:03:03,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:03:03,989::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:03:04,008::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000276912 s, 14.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:03:04,157::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:04,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:03:04,330::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:05,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:03:05,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:03:05,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:03:05,331::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:06,158::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:06,160::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:06,332::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:03:06,333::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:03:06,333::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:07,333::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:03:07,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:03:07,425::task::579::TaskManager.Task::(_updateState) Task=`18e29d43-034a-49aa-be92-97fa0a21c689`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:03:07,426::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:03:07,426::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:03:07,426::task::1168::TaskManager.Task::(prepare) Task=`18e29d43-034a-49aa-be92-97fa0a21c689`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:03:07,427::task::579::TaskManager.Task::(_updateState) Task=`ca5d3170-7894-4f12-9d45-105970f0cb9b`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 17:03:07,427::task::579::TaskManager.Task::(_updateState) Task=`18e29d43-034a-49aa-be92-97fa0a21c689`::moving from state preparing -> state finished >Thread-251782::INFO::2014-01-16 17:03:07,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 17:03:07,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:03:07,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:03:07,428::task::974::TaskManager.Task::(_decref) Task=`18e29d43-034a-49aa-be92-97fa0a21c689`::ref 0 aborting False >Thread-251782::INFO::2014-01-16 17:03:07,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:03:07,428::task::1168::TaskManager.Task::(prepare) Task=`ca5d3170-7894-4f12-9d45-105970f0cb9b`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:03:07,429::task::579::TaskManager.Task::(_updateState) Task=`ca5d3170-7894-4f12-9d45-105970f0cb9b`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:03:07,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:03:07,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:03:07,429::task::974::TaskManager.Task::(_decref) Task=`ca5d3170-7894-4f12-9d45-105970f0cb9b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:08,161::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287468::DEBUG::2014-01-16 17:03:08,241::task::579::TaskManager.Task::(_updateState) Task=`419fe846-41e3-49d6-8d2c-4b89b13e7cff`::moving from state init -> state preparing >Thread-287468::INFO::2014-01-16 17:03:08,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287468::INFO::2014-01-16 17:03:08,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271209', 'lastCheck': '5.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276912', 'lastCheck': '4.2', 'valid': True}} >Thread-287468::DEBUG::2014-01-16 17:03:08,242::task::1168::TaskManager.Task::(prepare) Task=`419fe846-41e3-49d6-8d2c-4b89b13e7cff`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271209', 'lastCheck': '5.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276912', 'lastCheck': '4.2', 'valid': True}} >Thread-287468::DEBUG::2014-01-16 17:03:08,242::task::579::TaskManager.Task::(_updateState) Task=`419fe846-41e3-49d6-8d2c-4b89b13e7cff`::moving from state preparing -> state finished >Thread-287468::DEBUG::2014-01-16 17:03:08,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287468::DEBUG::2014-01-16 17:03:08,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287468::DEBUG::2014-01-16 17:03:08,242::task::974::TaskManager.Task::(_decref) Task=`419fe846-41e3-49d6-8d2c-4b89b13e7cff`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:08,335::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:03:08,335::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:03:08,335::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:03:08,336::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:03:08,879::task::579::TaskManager.Task::(_updateState) Task=`7526b9f9-ed12-4d21-81f9-10bce8dbbccb`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:03:08,879::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:03:08,880::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:03:08,880::task::1168::TaskManager.Task::(prepare) Task=`7526b9f9-ed12-4d21-81f9-10bce8dbbccb`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:03:08,880::task::579::TaskManager.Task::(_updateState) Task=`7526b9f9-ed12-4d21-81f9-10bce8dbbccb`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:03:08,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:03:08,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:03:08,881::task::974::TaskManager.Task::(_decref) Task=`7526b9f9-ed12-4d21-81f9-10bce8dbbccb`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:03:08,881::task::579::TaskManager.Task::(_updateState) Task=`72b49033-efe6-431c-883e-1264e664582d`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:03:08,881::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:03:08,882::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:03:08,882::task::1168::TaskManager.Task::(prepare) Task=`72b49033-efe6-431c-883e-1264e664582d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:03:08,882::task::579::TaskManager.Task::(_updateState) Task=`72b49033-efe6-431c-883e-1264e664582d`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:03:08,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:03:08,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:03:08,883::task::974::TaskManager.Task::(_decref) Task=`72b49033-efe6-431c-883e-1264e664582d`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:03:09,259::task::579::TaskManager.Task::(_updateState) Task=`73d95071-3c01-48e1-bb45-f64da5d4fe41`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:03:09,260::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:03:09,261::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:03:09,261::task::1168::TaskManager.Task::(prepare) Task=`73d95071-3c01-48e1-bb45-f64da5d4fe41`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:03:09,262::task::579::TaskManager.Task::(_updateState) Task=`73d95071-3c01-48e1-bb45-f64da5d4fe41`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:03:09,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:03:09,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:03:09,262::task::974::TaskManager.Task::(_decref) Task=`73d95071-3c01-48e1-bb45-f64da5d4fe41`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:03:09,262::task::579::TaskManager.Task::(_updateState) Task=`bbe306e2-dda8-406c-9340-8f9984142d24`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:03:09,262::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:03:09,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:03:09,263::task::1168::TaskManager.Task::(prepare) Task=`bbe306e2-dda8-406c-9340-8f9984142d24`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:03:09,263::task::579::TaskManager.Task::(_updateState) Task=`bbe306e2-dda8-406c-9340-8f9984142d24`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:03:09,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:03:09,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:03:09,263::task::974::TaskManager.Task::(_decref) Task=`bbe306e2-dda8-406c-9340-8f9984142d24`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:09,336::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 17:03:09,400::task::579::TaskManager.Task::(_updateState) Task=`1089d67f-55da-4337-af86-60261075fca7`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:03:09,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:03:09,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:03:09,401::task::1168::TaskManager.Task::(prepare) Task=`1089d67f-55da-4337-af86-60261075fca7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:03:09,401::task::579::TaskManager.Task::(_updateState) Task=`1089d67f-55da-4337-af86-60261075fca7`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:03:09,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:03:09,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:03:09,401::task::974::TaskManager.Task::(_decref) Task=`1089d67f-55da-4337-af86-60261075fca7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:10,162::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:10,337::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:03:10,337::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:03:10,337::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:03:10,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:10,338::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:03:10,338::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:03:11,163::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:11,339::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:12,165::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:12,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:03:12,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:03:12,341::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:03:13,119::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:03:13,135::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000301772 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:03:13,335::task::579::TaskManager.Task::(_updateState) Task=`a27e4ce2-a87d-4c6a-b1fe-6efe221d272c`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:03:13,335::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:03:13,336::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:03:13,336::task::1168::TaskManager.Task::(prepare) Task=`a27e4ce2-a87d-4c6a-b1fe-6efe221d272c`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:03:13,336::task::579::TaskManager.Task::(_updateState) Task=`a27e4ce2-a87d-4c6a-b1fe-6efe221d272c`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:03:13,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:03:13,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:03:13,337::task::974::TaskManager.Task::(_decref) Task=`a27e4ce2-a87d-4c6a-b1fe-6efe221d272c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:13,342::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:03:13,343::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:03:13,343::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:03:13,568::task::579::TaskManager.Task::(_updateState) Task=`c58baab5-60f0-45d2-8b67-ca8824806d9b`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:03:13,568::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:03:13,569::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:03:13,569::task::1168::TaskManager.Task::(prepare) Task=`c58baab5-60f0-45d2-8b67-ca8824806d9b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:03:13,569::task::579::TaskManager.Task::(_updateState) Task=`c58baab5-60f0-45d2-8b67-ca8824806d9b`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:03:13,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:03:13,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:03:13,570::task::974::TaskManager.Task::(_decref) Task=`c58baab5-60f0-45d2-8b67-ca8824806d9b`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:03:14,015::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:03:14,033::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213268 s, 19.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:03:14,166::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:14,345::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:03:14,345::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:03:14,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:03:14,346::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:03:14,686::task::579::TaskManager.Task::(_updateState) Task=`9f340980-6e70-42b9-b7a5-48d7a0e023e3`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:03:14,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:03:14,687::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:03:14,687::task::1168::TaskManager.Task::(prepare) Task=`9f340980-6e70-42b9-b7a5-48d7a0e023e3`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:03:14,687::task::579::TaskManager.Task::(_updateState) Task=`9f340980-6e70-42b9-b7a5-48d7a0e023e3`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:03:14,687::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:03:14,687::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:03:14,687::task::974::TaskManager.Task::(_decref) Task=`9f340980-6e70-42b9-b7a5-48d7a0e023e3`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:03:14,743::task::579::TaskManager.Task::(_updateState) Task=`fea1f638-66e9-4643-8551-d2ab31c9ca0b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:03:14,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:03:14,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:03:14,744::task::1168::TaskManager.Task::(prepare) Task=`fea1f638-66e9-4643-8551-d2ab31c9ca0b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:03:14,744::task::579::TaskManager.Task::(_updateState) Task=`fea1f638-66e9-4643-8551-d2ab31c9ca0b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:03:14,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:03:14,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:03:14,745::task::974::TaskManager.Task::(_decref) Task=`fea1f638-66e9-4643-8551-d2ab31c9ca0b`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:03:14,745::task::579::TaskManager.Task::(_updateState) Task=`6e85fa43-a369-4524-8bdf-8a2618cbce5e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:03:14,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:03:14,745::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:03:14,746::task::1168::TaskManager.Task::(prepare) Task=`6e85fa43-a369-4524-8bdf-8a2618cbce5e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:03:14,746::task::579::TaskManager.Task::(_updateState) Task=`6e85fa43-a369-4524-8bdf-8a2618cbce5e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:03:14,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:03:14,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:03:14,746::task::974::TaskManager.Task::(_decref) Task=`6e85fa43-a369-4524-8bdf-8a2618cbce5e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:15,347::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:03:15,676::task::579::TaskManager.Task::(_updateState) Task=`36939898-5aaa-4f85-af0b-76d071f9689e`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:03:15,676::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:03:15,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:03:15,676::task::1168::TaskManager.Task::(prepare) Task=`36939898-5aaa-4f85-af0b-76d071f9689e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:03:15,676::task::579::TaskManager.Task::(_updateState) Task=`36939898-5aaa-4f85-af0b-76d071f9689e`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:03:15,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:03:15,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:03:15,677::task::974::TaskManager.Task::(_decref) Task=`36939898-5aaa-4f85-af0b-76d071f9689e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:16,168::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:16,168::task::579::TaskManager.Task::(_updateState) Task=`d5d2faf7-28b4-4dc0-9c4b-5d5b219915be`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:03:16,168::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:03:16,169::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:03:16,169::task::1168::TaskManager.Task::(prepare) Task=`d5d2faf7-28b4-4dc0-9c4b-5d5b219915be`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:03:16,169::task::579::TaskManager.Task::(_updateState) Task=`d5d2faf7-28b4-4dc0-9c4b-5d5b219915be`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:03:16,169::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:03:16,169::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:03:16,169::task::974::TaskManager.Task::(_decref) Task=`d5d2faf7-28b4-4dc0-9c4b-5d5b219915be`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:16,171::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:03:16,171::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:03:16,172::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:16,174::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:16,175::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:16,348::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:03:16,349::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:03:16,875::task::579::TaskManager.Task::(_updateState) Task=`410fc79c-1b4b-459e-809c-9540d9cb6655`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:03:16,875::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:03:16,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:03:16,876::task::1168::TaskManager.Task::(prepare) Task=`410fc79c-1b4b-459e-809c-9540d9cb6655`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:03:16,876::task::579::TaskManager.Task::(_updateState) Task=`410fc79c-1b4b-459e-809c-9540d9cb6655`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:03:16,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:03:16,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:03:16,876::task::974::TaskManager.Task::(_decref) Task=`410fc79c-1b4b-459e-809c-9540d9cb6655`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:03:16,876::task::579::TaskManager.Task::(_updateState) Task=`d510650d-0b1c-4fd4-bb1c-9fcfbb28e184`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:03:16,877::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:03:16,877::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:03:16,877::task::1168::TaskManager.Task::(prepare) Task=`d510650d-0b1c-4fd4-bb1c-9fcfbb28e184`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:03:16,877::task::579::TaskManager.Task::(_updateState) Task=`d510650d-0b1c-4fd4-bb1c-9fcfbb28e184`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:03:16,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:03:16,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:03:16,877::task::974::TaskManager.Task::(_decref) Task=`d510650d-0b1c-4fd4-bb1c-9fcfbb28e184`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:03:16,878::task::579::TaskManager.Task::(_updateState) Task=`ae2b87d6-30f4-4465-8217-cbcf31bdeb16`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:03:16,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:03:16,878::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:03:16,878::task::1168::TaskManager.Task::(prepare) Task=`ae2b87d6-30f4-4465-8217-cbcf31bdeb16`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:03:16,878::task::579::TaskManager.Task::(_updateState) Task=`ae2b87d6-30f4-4465-8217-cbcf31bdeb16`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:03:16,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:03:16,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:03:16,879::task::974::TaskManager.Task::(_decref) Task=`ae2b87d6-30f4-4465-8217-cbcf31bdeb16`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:17,350::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:18,176::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:18,351::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:03:18,993::task::579::TaskManager.Task::(_updateState) Task=`2081b3a5-c3c6-4f1a-9304-847a8c0e8851`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:03:18,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:03:18,994::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:03:18,994::task::1168::TaskManager.Task::(prepare) Task=`2081b3a5-c3c6-4f1a-9304-847a8c0e8851`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:03:18,994::task::579::TaskManager.Task::(_updateState) Task=`2081b3a5-c3c6-4f1a-9304-847a8c0e8851`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:03:18,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:03:18,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:03:18,995::task::974::TaskManager.Task::(_decref) Task=`2081b3a5-c3c6-4f1a-9304-847a8c0e8851`::ref 0 aborting False >Thread-227488::DEBUG::2014-01-16 17:03:19,043::task::579::TaskManager.Task::(_updateState) Task=`b3be7f4a-32a2-42b1-91e4-7f69574d4413`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:03:19,043::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:03:19,043::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:03:19,043::task::1168::TaskManager.Task::(prepare) Task=`b3be7f4a-32a2-42b1-91e4-7f69574d4413`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:03:19,043::task::579::TaskManager.Task::(_updateState) Task=`b3be7f4a-32a2-42b1-91e4-7f69574d4413`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:03:19,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:03:19,044::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:03:19,044::task::974::TaskManager.Task::(_decref) Task=`b3be7f4a-32a2-42b1-91e4-7f69574d4413`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:19,352::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:20,177::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:20,353::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:21,178::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:21,355::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:22,180::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:22,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:03:22,357::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:03:22,403::task::579::TaskManager.Task::(_updateState) Task=`d568e6c1-2176-42c4-bc60-e982ed1283fc`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:03:22,404::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:03:22,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:03:22,404::task::1168::TaskManager.Task::(prepare) Task=`d568e6c1-2176-42c4-bc60-e982ed1283fc`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:03:22,404::task::579::TaskManager.Task::(_updateState) Task=`d568e6c1-2176-42c4-bc60-e982ed1283fc`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:03:22,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:03:22,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:03:22,405::task::974::TaskManager.Task::(_decref) Task=`d568e6c1-2176-42c4-bc60-e982ed1283fc`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:03:23,143::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:03:23,159::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000288612 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:03:23,358::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287474::DEBUG::2014-01-16 17:03:24,015::task::579::TaskManager.Task::(_updateState) Task=`429ff052-2c45-4e41-b16a-4b6d086ac449`::moving from state init -> state preparing >Thread-287474::INFO::2014-01-16 17:03:24,015::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287474::INFO::2014-01-16 17:03:24,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288612', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213268', 'lastCheck': '10.0', 'valid': True}} >Thread-287474::DEBUG::2014-01-16 17:03:24,016::task::1168::TaskManager.Task::(prepare) Task=`429ff052-2c45-4e41-b16a-4b6d086ac449`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288612', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213268', 'lastCheck': '10.0', 'valid': True}} >Thread-287474::DEBUG::2014-01-16 17:03:24,016::task::579::TaskManager.Task::(_updateState) Task=`429ff052-2c45-4e41-b16a-4b6d086ac449`::moving from state preparing -> state finished >Thread-287474::DEBUG::2014-01-16 17:03:24,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287474::DEBUG::2014-01-16 17:03:24,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287474::DEBUG::2014-01-16 17:03:24,016::task::974::TaskManager.Task::(_decref) Task=`429ff052-2c45-4e41-b16a-4b6d086ac449`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:03:24,039::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:03:24,062::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000275106 s, 14.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:03:24,181::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:24,359::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:25,360::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:26,182::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:26,183::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:26,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:03:26,625::task::579::TaskManager.Task::(_updateState) Task=`e05aa683-6864-4e2f-beb4-40014730de33`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:03:26,625::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:03:26,626::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:03:26,626::task::1168::TaskManager.Task::(prepare) Task=`e05aa683-6864-4e2f-beb4-40014730de33`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:03:26,626::task::579::TaskManager.Task::(_updateState) Task=`e05aa683-6864-4e2f-beb4-40014730de33`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:03:26,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:03:26,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:03:26,627::task::974::TaskManager.Task::(_decref) Task=`e05aa683-6864-4e2f-beb4-40014730de33`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:27,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:03:27,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:03:27,363::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:28,184::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:28,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:03:28,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:29,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:03:29,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:03:29,366::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:30,186::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:03:30,276::task::579::TaskManager.Task::(_updateState) Task=`50ce0ca8-c89e-4530-bebc-6086221f8c8f`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:03:30,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:03:30,276::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:03:30,276::task::1168::TaskManager.Task::(prepare) Task=`50ce0ca8-c89e-4530-bebc-6086221f8c8f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:03:30,277::task::579::TaskManager.Task::(_updateState) Task=`50ce0ca8-c89e-4530-bebc-6086221f8c8f`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:03:30,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:03:30,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:03:30,277::task::974::TaskManager.Task::(_decref) Task=`50ce0ca8-c89e-4530-bebc-6086221f8c8f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:30,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:03:30,367::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:31,188::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:03:31,188::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:03:31,189::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:31,368::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:03:31,368::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:32,190::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:32,369::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:03:33,167::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:03:33,183::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000255917 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:03:33,371::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:03:33,372::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:03:33,946::task::579::TaskManager.Task::(_updateState) Task=`cc6b62cd-4900-46d7-919e-d10d15b50ab9`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:03:33,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:03:33,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:03:33,948::task::1168::TaskManager.Task::(prepare) Task=`cc6b62cd-4900-46d7-919e-d10d15b50ab9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:03:33,948::task::579::TaskManager.Task::(_updateState) Task=`cc6b62cd-4900-46d7-919e-d10d15b50ab9`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:03:33,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:03:33,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:03:33,949::task::974::TaskManager.Task::(_decref) Task=`cc6b62cd-4900-46d7-919e-d10d15b50ab9`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:03:33,951::task::579::TaskManager.Task::(_updateState) Task=`0294c8c9-aac2-40a3-95d5-5f847eb94009`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:03:33,951::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:03:33,952::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:03:33,952::task::1168::TaskManager.Task::(prepare) Task=`0294c8c9-aac2-40a3-95d5-5f847eb94009`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:03:33,952::task::579::TaskManager.Task::(_updateState) Task=`0294c8c9-aac2-40a3-95d5-5f847eb94009`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:03:33,952::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:03:33,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:03:33,953::task::974::TaskManager.Task::(_decref) Task=`0294c8c9-aac2-40a3-95d5-5f847eb94009`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:03:34,069::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:03:34,086::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00028479 s, 14.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:03:34,192::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:34,373::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:03:34,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:03:34,848::task::579::TaskManager.Task::(_updateState) Task=`119bc79c-0f1c-4178-8685-4c29a86573ae`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:03:34,848::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:03:34,849::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:03:34,849::task::1168::TaskManager.Task::(prepare) Task=`119bc79c-0f1c-4178-8685-4c29a86573ae`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:03:34,849::task::579::TaskManager.Task::(_updateState) Task=`119bc79c-0f1c-4178-8685-4c29a86573ae`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:03:34,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:03:34,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:03:34,850::task::974::TaskManager.Task::(_decref) Task=`119bc79c-0f1c-4178-8685-4c29a86573ae`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:03:34,851::task::579::TaskManager.Task::(_updateState) Task=`ff260a24-63d8-417b-b81e-cdccf069cded`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:03:34,851::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:03:34,851::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:03:34,851::task::1168::TaskManager.Task::(prepare) Task=`ff260a24-63d8-417b-b81e-cdccf069cded`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:03:34,851::task::579::TaskManager.Task::(_updateState) Task=`ff260a24-63d8-417b-b81e-cdccf069cded`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:03:34,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:03:34,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:03:34,852::task::974::TaskManager.Task::(_decref) Task=`ff260a24-63d8-417b-b81e-cdccf069cded`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:35,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:03:35,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:03:35,375::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:03:35,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:36,193::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:36,194::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:36,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:03:36,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:03:36,377::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:37,378::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:03:37,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:38,195::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:38,379::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:03:38,379::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:03:38,379::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:03:38,379::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:03:39,102::task::579::TaskManager.Task::(_updateState) Task=`260858ed-8ade-4906-adb9-2edfd42c2300`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:03:39,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:03:39,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:03:39,103::task::1168::TaskManager.Task::(prepare) Task=`260858ed-8ade-4906-adb9-2edfd42c2300`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:03:39,103::task::579::TaskManager.Task::(_updateState) Task=`260858ed-8ade-4906-adb9-2edfd42c2300`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:03:39,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:03:39,103::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:03:39,103::task::974::TaskManager.Task::(_decref) Task=`260858ed-8ade-4906-adb9-2edfd42c2300`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:39,380::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287480::DEBUG::2014-01-16 17:03:39,938::task::579::TaskManager.Task::(_updateState) Task=`eb34d8a9-01e3-42f0-b3c8-ebb6350b873f`::moving from state init -> state preparing >Thread-287480::INFO::2014-01-16 17:03:39,938::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287480::INFO::2014-01-16 17:03:39,938::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255917', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028479', 'lastCheck': '5.8', 'valid': True}} >Thread-287480::DEBUG::2014-01-16 17:03:39,938::task::1168::TaskManager.Task::(prepare) Task=`eb34d8a9-01e3-42f0-b3c8-ebb6350b873f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255917', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028479', 'lastCheck': '5.8', 'valid': True}} >Thread-287480::DEBUG::2014-01-16 17:03:39,939::task::579::TaskManager.Task::(_updateState) Task=`eb34d8a9-01e3-42f0-b3c8-ebb6350b873f`::moving from state preparing -> state finished >Thread-287480::DEBUG::2014-01-16 17:03:39,939::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287480::DEBUG::2014-01-16 17:03:39,939::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287480::DEBUG::2014-01-16 17:03:39,939::task::974::TaskManager.Task::(_decref) Task=`eb34d8a9-01e3-42f0-b3c8-ebb6350b873f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:40,196::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:40,381::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:03:40,382::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:03:40,382::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:03:40,382::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:40,382::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:03:40,382::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:03:41,198::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:41,383::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:03:41,453::task::579::TaskManager.Task::(_updateState) Task=`f951e126-b5c7-4027-b62f-5a076154d42c`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:03:41,453::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:03:41,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:03:41,453::task::1168::TaskManager.Task::(prepare) Task=`f951e126-b5c7-4027-b62f-5a076154d42c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:03:41,454::task::579::TaskManager.Task::(_updateState) Task=`f951e126-b5c7-4027-b62f-5a076154d42c`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:03:41,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:03:41,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:03:41,454::task::974::TaskManager.Task::(_decref) Task=`f951e126-b5c7-4027-b62f-5a076154d42c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:42,199::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 17:03:42,352::task::579::TaskManager.Task::(_updateState) Task=`ec2429a4-1636-4977-a654-9f8dea4310b0`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:03:42,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:03:42,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:03:42,353::task::1168::TaskManager.Task::(prepare) Task=`ec2429a4-1636-4977-a654-9f8dea4310b0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:03:42,353::task::579::TaskManager.Task::(_updateState) Task=`ec2429a4-1636-4977-a654-9f8dea4310b0`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:03:42,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:03:42,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:03:42,353::task::974::TaskManager.Task::(_decref) Task=`ec2429a4-1636-4977-a654-9f8dea4310b0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:42,385::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:03:42,385::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:03:42,385::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-69607::DEBUG::2014-01-16 17:03:42,489::task::579::TaskManager.Task::(_updateState) Task=`5f820160-1c76-4f69-8245-242667e10ee4`::moving from state init -> state preparing >Thread-16398::DEBUG::2014-01-16 17:03:42,489::task::579::TaskManager.Task::(_updateState) Task=`11d4abee-4e73-4e86-b721-44af7577d96e`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:03:42,490::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-16398::INFO::2014-01-16 17:03:42,490::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-69607::INFO::2014-01-16 17:03:42,490::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-16398::INFO::2014-01-16 17:03:42,490::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-69607::DEBUG::2014-01-16 17:03:42,491::task::1168::TaskManager.Task::(prepare) Task=`5f820160-1c76-4f69-8245-242667e10ee4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-16398::DEBUG::2014-01-16 17:03:42,491::task::1168::TaskManager.Task::(prepare) Task=`11d4abee-4e73-4e86-b721-44af7577d96e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-69607::DEBUG::2014-01-16 17:03:42,491::task::579::TaskManager.Task::(_updateState) Task=`5f820160-1c76-4f69-8245-242667e10ee4`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:03:42,491::task::579::TaskManager.Task::(_updateState) Task=`11d4abee-4e73-4e86-b721-44af7577d96e`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:03:42,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:03:42,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:03:42,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:03:42,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:03:42,492::task::974::TaskManager.Task::(_decref) Task=`5f820160-1c76-4f69-8245-242667e10ee4`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:03:42,492::task::974::TaskManager.Task::(_decref) Task=`11d4abee-4e73-4e86-b721-44af7577d96e`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:03:43,080::task::579::TaskManager.Task::(_updateState) Task=`cfdc708f-54cd-43b6-9776-a3343bdedf54`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:03:43,080::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:03:43,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:03:43,081::task::1168::TaskManager.Task::(prepare) Task=`cfdc708f-54cd-43b6-9776-a3343bdedf54`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:03:43,081::task::579::TaskManager.Task::(_updateState) Task=`cfdc708f-54cd-43b6-9776-a3343bdedf54`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:03:43,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:03:43,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:03:43,081::task::974::TaskManager.Task::(_decref) Task=`cfdc708f-54cd-43b6-9776-a3343bdedf54`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:03:43,191::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:03:43,207::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000269184 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:03:43,386::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:03:43,386::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:03:43,386::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:03:43,466::task::579::TaskManager.Task::(_updateState) Task=`35d3649b-c43c-423c-a185-391c3f0dc6b1`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:03:43,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:03:43,467::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:03:43,467::task::1168::TaskManager.Task::(prepare) Task=`35d3649b-c43c-423c-a185-391c3f0dc6b1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:03:43,467::task::579::TaskManager.Task::(_updateState) Task=`35d3649b-c43c-423c-a185-391c3f0dc6b1`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:03:43,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:03:43,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:03:43,468::task::974::TaskManager.Task::(_decref) Task=`35d3649b-c43c-423c-a185-391c3f0dc6b1`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:03:44,091::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:03:44,108::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000305394 s, 13.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:03:44,201::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:44,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:03:44,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:03:44,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:03:44,388::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:45,389::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:46,202::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:46,204::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:03:46,204::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:03:46,205::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:46,390::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:03:46,391::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:47,392::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:48,207::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:48,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:03:49,230::task::579::TaskManager.Task::(_updateState) Task=`542d4f50-20d9-4c85-8fb3-f21737842e71`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:03:49,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:03:49,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:03:49,231::task::1168::TaskManager.Task::(prepare) Task=`542d4f50-20d9-4c85-8fb3-f21737842e71`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:03:49,231::task::579::TaskManager.Task::(_updateState) Task=`542d4f50-20d9-4c85-8fb3-f21737842e71`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:03:49,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:03:49,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:03:49,231::task::974::TaskManager.Task::(_decref) Task=`542d4f50-20d9-4c85-8fb3-f21737842e71`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:03:49,232::task::579::TaskManager.Task::(_updateState) Task=`bcbea009-f4d5-46a4-9e50-5edf1e5d3a69`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:03:49,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:03:49,232::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:03:49,232::task::1168::TaskManager.Task::(prepare) Task=`bcbea009-f4d5-46a4-9e50-5edf1e5d3a69`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:03:49,232::task::579::TaskManager.Task::(_updateState) Task=`bcbea009-f4d5-46a4-9e50-5edf1e5d3a69`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:03:49,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:03:49,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:03:49,233::task::974::TaskManager.Task::(_decref) Task=`bcbea009-f4d5-46a4-9e50-5edf1e5d3a69`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:03:49,233::task::579::TaskManager.Task::(_updateState) Task=`05534544-3129-4684-8413-117c1712dfa4`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:03:49,234::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:03:49,234::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:03:49,234::task::1168::TaskManager.Task::(prepare) Task=`05534544-3129-4684-8413-117c1712dfa4`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:03:49,235::task::579::TaskManager.Task::(_updateState) Task=`05534544-3129-4684-8413-117c1712dfa4`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:03:49,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:03:49,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:03:49,235::task::974::TaskManager.Task::(_decref) Task=`05534544-3129-4684-8413-117c1712dfa4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:03:49,394::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:50,208::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:50,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:03:50,987::task::579::TaskManager.Task::(_updateState) Task=`30349b44-b938-4233-b446-88751c854209`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:03:50,987::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:03:50,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:03:50,988::task::1168::TaskManager.Task::(prepare) Task=`30349b44-b938-4233-b446-88751c854209`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:03:50,988::task::579::TaskManager.Task::(_updateState) Task=`30349b44-b938-4233-b446-88751c854209`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:03:50,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:03:50,988::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:03:50,989::task::974::TaskManager.Task::(_decref) Task=`30349b44-b938-4233-b446-88751c854209`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:51,210::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:51,397::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:52,211::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:52,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:03:52,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:03:53,214::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:03:53,230::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000315393 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:03:53,400::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:03:54,114::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:03:54,131::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000332804 s, 12.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:03:54,213::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:54,401::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:55,402::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287486::DEBUG::2014-01-16 17:03:55,919::task::579::TaskManager.Task::(_updateState) Task=`2042f8c1-a770-4a8e-b86d-82173c4309f1`::moving from state init -> state preparing >Thread-287486::INFO::2014-01-16 17:03:55,919::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287486::INFO::2014-01-16 17:03:55,920::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000315393', 'lastCheck': '2.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332804', 'lastCheck': '1.8', 'valid': True}} >Thread-287486::DEBUG::2014-01-16 17:03:55,920::task::1168::TaskManager.Task::(prepare) Task=`2042f8c1-a770-4a8e-b86d-82173c4309f1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000315393', 'lastCheck': '2.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332804', 'lastCheck': '1.8', 'valid': True}} >Thread-287486::DEBUG::2014-01-16 17:03:55,920::task::579::TaskManager.Task::(_updateState) Task=`2042f8c1-a770-4a8e-b86d-82173c4309f1`::moving from state preparing -> state finished >Thread-287486::DEBUG::2014-01-16 17:03:55,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287486::DEBUG::2014-01-16 17:03:55,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287486::DEBUG::2014-01-16 17:03:55,921::task::974::TaskManager.Task::(_decref) Task=`2042f8c1-a770-4a8e-b86d-82173c4309f1`::ref 0 aborting False >Thread-221160::DEBUG::2014-01-16 17:03:55,978::task::579::TaskManager.Task::(_updateState) Task=`a799f73c-e290-409e-9cad-21836ff86970`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:03:55,978::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:03:55,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:03:55,979::task::1168::TaskManager.Task::(prepare) Task=`a799f73c-e290-409e-9cad-21836ff86970`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:03:55,979::task::579::TaskManager.Task::(_updateState) Task=`a799f73c-e290-409e-9cad-21836ff86970`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:03:55,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:03:55,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:03:55,979::task::974::TaskManager.Task::(_decref) Task=`a799f73c-e290-409e-9cad-21836ff86970`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:03:56,214::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:03:56,215::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:56,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:57,404::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:03:57,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:03:57,405::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:03:58,216::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:03:58,406::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:03:58,407::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:03:59,408::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:03:59,408::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:03:59,408::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:00,218::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:00,409::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:04:00,409::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:01,220::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:04:01,220::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:04:01,222::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:01,411::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:04:01,411::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:02,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:02,412::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:04:02,449::task::579::TaskManager.Task::(_updateState) Task=`db2a807f-dec5-49d3-a96f-167203b85455`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:04:02,450::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:04:02,450::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:04:02,450::task::1168::TaskManager.Task::(prepare) Task=`db2a807f-dec5-49d3-a96f-167203b85455`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:04:02,450::task::579::TaskManager.Task::(_updateState) Task=`db2a807f-dec5-49d3-a96f-167203b85455`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:04:02,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:04:02,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:04:02,451::task::974::TaskManager.Task::(_decref) Task=`db2a807f-dec5-49d3-a96f-167203b85455`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:04:03,237::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:04:03,254::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000287577 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:04:03,414::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:04:03,414::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:04:04,136::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:04:04,153::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000286661 s, 14.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:04:04,224::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:04,415::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:04:04,416::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:05,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:04:05,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:04:05,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:04:05,418::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:06,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:06,227::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:06,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:04:06,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:04:06,419::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:07,419::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:04:07,420::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 17:04:07,522::task::579::TaskManager.Task::(_updateState) Task=`68a5b7ff-9433-49db-86fd-7faa49ddbdca`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:04:07,522::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 17:04:07,523::task::579::TaskManager.Task::(_updateState) Task=`0d168d38-658f-44d0-bc33-7bf4585a4ffc`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:04:07,523::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 17:04:07,524::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:04:07,524::task::1168::TaskManager.Task::(prepare) Task=`68a5b7ff-9433-49db-86fd-7faa49ddbdca`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 17:04:07,524::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:04:07,524::task::579::TaskManager.Task::(_updateState) Task=`68a5b7ff-9433-49db-86fd-7faa49ddbdca`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:04:07,525::task::1168::TaskManager.Task::(prepare) Task=`0d168d38-658f-44d0-bc33-7bf4585a4ffc`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:04:07,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:04:07,525::task::579::TaskManager.Task::(_updateState) Task=`0d168d38-658f-44d0-bc33-7bf4585a4ffc`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:04:07,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:04:07,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:04:07,526::task::974::TaskManager.Task::(_decref) Task=`68a5b7ff-9433-49db-86fd-7faa49ddbdca`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:04:07,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:04:07,526::task::974::TaskManager.Task::(_decref) Task=`0d168d38-658f-44d0-bc33-7bf4585a4ffc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:08,228::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:08,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:04:08,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:04:08,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:04:08,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:04:09,111::task::579::TaskManager.Task::(_updateState) Task=`42eac46c-b89b-4a0b-b728-d4fb45a50332`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:04:09,112::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:04:09,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:04:09,112::task::1168::TaskManager.Task::(prepare) Task=`42eac46c-b89b-4a0b-b728-d4fb45a50332`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:04:09,112::task::579::TaskManager.Task::(_updateState) Task=`42eac46c-b89b-4a0b-b728-d4fb45a50332`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:04:09,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:04:09,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:04:09,113::task::974::TaskManager.Task::(_decref) Task=`42eac46c-b89b-4a0b-b728-d4fb45a50332`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:04:09,113::task::579::TaskManager.Task::(_updateState) Task=`5169faa9-505d-4b4b-a116-cd87089f8797`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:04:09,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:04:09,113::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:04:09,113::task::1168::TaskManager.Task::(prepare) Task=`5169faa9-505d-4b4b-a116-cd87089f8797`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:04:09,114::task::579::TaskManager.Task::(_updateState) Task=`5169faa9-505d-4b4b-a116-cd87089f8797`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:04:09,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:04:09,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:04:09,114::task::974::TaskManager.Task::(_decref) Task=`5169faa9-505d-4b4b-a116-cd87089f8797`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:04:09,352::task::579::TaskManager.Task::(_updateState) Task=`3c8ba1be-2060-4732-9fc1-f9441ce3b500`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:04:09,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:04:09,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:04:09,353::task::1168::TaskManager.Task::(prepare) Task=`3c8ba1be-2060-4732-9fc1-f9441ce3b500`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:04:09,353::task::579::TaskManager.Task::(_updateState) Task=`3c8ba1be-2060-4732-9fc1-f9441ce3b500`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:04:09,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:04:09,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:04:09,354::task::974::TaskManager.Task::(_decref) Task=`3c8ba1be-2060-4732-9fc1-f9441ce3b500`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:04:09,354::task::579::TaskManager.Task::(_updateState) Task=`016be2f4-aacd-4fb0-a7f2-33334f921a46`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:04:09,354::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:04:09,355::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:04:09,355::task::1168::TaskManager.Task::(prepare) Task=`016be2f4-aacd-4fb0-a7f2-33334f921a46`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:04:09,355::task::579::TaskManager.Task::(_updateState) Task=`016be2f4-aacd-4fb0-a7f2-33334f921a46`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:04:09,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:04:09,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:04:09,355::task::974::TaskManager.Task::(_decref) Task=`016be2f4-aacd-4fb0-a7f2-33334f921a46`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:09,422::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 17:04:09,565::task::579::TaskManager.Task::(_updateState) Task=`5fd5e9f3-19c4-4ee8-be7a-6954ebcf1859`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:04:09,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:04:09,565::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:04:09,565::task::1168::TaskManager.Task::(prepare) Task=`5fd5e9f3-19c4-4ee8-be7a-6954ebcf1859`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:04:09,566::task::579::TaskManager.Task::(_updateState) Task=`5fd5e9f3-19c4-4ee8-be7a-6954ebcf1859`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:04:09,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:04:09,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:04:09,566::task::974::TaskManager.Task::(_decref) Task=`5fd5e9f3-19c4-4ee8-be7a-6954ebcf1859`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:10,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:10,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:04:10,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:04:10,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:04:10,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:10,424::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:04:10,425::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:04:11,231::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:11,426::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287492::DEBUG::2014-01-16 17:04:11,929::task::579::TaskManager.Task::(_updateState) Task=`3a58ebb2-ced7-4f9e-9d81-a3bccc85489d`::moving from state init -> state preparing >Thread-287492::INFO::2014-01-16 17:04:11,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287492::INFO::2014-01-16 17:04:11,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287577', 'lastCheck': '8.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286661', 'lastCheck': '7.8', 'valid': True}} >Thread-287492::DEBUG::2014-01-16 17:04:11,930::task::1168::TaskManager.Task::(prepare) Task=`3a58ebb2-ced7-4f9e-9d81-a3bccc85489d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287577', 'lastCheck': '8.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286661', 'lastCheck': '7.8', 'valid': True}} >Thread-287492::DEBUG::2014-01-16 17:04:11,930::task::579::TaskManager.Task::(_updateState) Task=`3a58ebb2-ced7-4f9e-9d81-a3bccc85489d`::moving from state preparing -> state finished >Thread-287492::DEBUG::2014-01-16 17:04:11,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287492::DEBUG::2014-01-16 17:04:11,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287492::DEBUG::2014-01-16 17:04:11,930::task::974::TaskManager.Task::(_decref) Task=`3a58ebb2-ced7-4f9e-9d81-a3bccc85489d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:12,232::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:12,427::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:04:12,427::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:04:12,427::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:04:13,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:04:13,278::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291547 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:04:13,429::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:04:13,429::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:04:13,430::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:04:13,475::task::579::TaskManager.Task::(_updateState) Task=`ab62303b-00fc-40df-95ed-fe0b83ba2389`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:04:13,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:04:13,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:04:13,476::task::1168::TaskManager.Task::(prepare) Task=`ab62303b-00fc-40df-95ed-fe0b83ba2389`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:04:13,476::task::579::TaskManager.Task::(_updateState) Task=`ab62303b-00fc-40df-95ed-fe0b83ba2389`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:04:13,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:04:13,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:04:13,476::task::974::TaskManager.Task::(_decref) Task=`ab62303b-00fc-40df-95ed-fe0b83ba2389`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:04:13,731::task::579::TaskManager.Task::(_updateState) Task=`11f76298-ac12-46fe-9ea1-27e6ee456a1b`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:04:13,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:04:13,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:04:13,732::task::1168::TaskManager.Task::(prepare) Task=`11f76298-ac12-46fe-9ea1-27e6ee456a1b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:04:13,732::task::579::TaskManager.Task::(_updateState) Task=`11f76298-ac12-46fe-9ea1-27e6ee456a1b`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:04:13,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:04:13,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:04:13,732::task::974::TaskManager.Task::(_decref) Task=`11f76298-ac12-46fe-9ea1-27e6ee456a1b`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:04:14,159::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:04:14,176::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000259843 s, 15.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:04:14,234::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:14,431::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:04:14,431::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:04:14,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:04:14,432::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:04:14,854::task::579::TaskManager.Task::(_updateState) Task=`b3d47bef-bb6b-42d1-abc4-e6d27b800dc5`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:04:14,854::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:04:14,855::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:04:14,855::task::1168::TaskManager.Task::(prepare) Task=`b3d47bef-bb6b-42d1-abc4-e6d27b800dc5`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:04:14,855::task::579::TaskManager.Task::(_updateState) Task=`b3d47bef-bb6b-42d1-abc4-e6d27b800dc5`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:04:14,855::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:04:14,855::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:04:14,855::task::974::TaskManager.Task::(_decref) Task=`b3d47bef-bb6b-42d1-abc4-e6d27b800dc5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:04:14,964::task::579::TaskManager.Task::(_updateState) Task=`05840827-443e-4192-aa3c-74ad8c4440a2`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:04:14,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:04:14,965::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:04:14,965::task::1168::TaskManager.Task::(prepare) Task=`05840827-443e-4192-aa3c-74ad8c4440a2`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:04:14,965::task::579::TaskManager.Task::(_updateState) Task=`05840827-443e-4192-aa3c-74ad8c4440a2`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:04:14,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:04:14,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:04:14,966::task::974::TaskManager.Task::(_decref) Task=`05840827-443e-4192-aa3c-74ad8c4440a2`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:04:14,966::task::579::TaskManager.Task::(_updateState) Task=`4499bf48-1436-47b6-8d9e-42160e76092b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:04:14,966::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:04:14,967::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:04:14,967::task::1168::TaskManager.Task::(prepare) Task=`4499bf48-1436-47b6-8d9e-42160e76092b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:04:14,967::task::579::TaskManager.Task::(_updateState) Task=`4499bf48-1436-47b6-8d9e-42160e76092b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:04:14,967::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:04:14,967::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:04:14,967::task::974::TaskManager.Task::(_decref) Task=`4499bf48-1436-47b6-8d9e-42160e76092b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:15,433::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:04:15,848::task::579::TaskManager.Task::(_updateState) Task=`0539fc3e-71a0-41b1-971e-e40f834d62cc`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:04:15,848::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:04:15,849::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:04:15,849::task::1168::TaskManager.Task::(prepare) Task=`0539fc3e-71a0-41b1-971e-e40f834d62cc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:04:15,849::task::579::TaskManager.Task::(_updateState) Task=`0539fc3e-71a0-41b1-971e-e40f834d62cc`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:04:15,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:04:15,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:04:15,849::task::974::TaskManager.Task::(_decref) Task=`0539fc3e-71a0-41b1-971e-e40f834d62cc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:16,235::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:16,236::task::579::TaskManager.Task::(_updateState) Task=`9428feb8-b761-4a3b-b96f-830a873c3934`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:04:16,236::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:04:16,236::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:04:16,236::task::1168::TaskManager.Task::(prepare) Task=`9428feb8-b761-4a3b-b96f-830a873c3934`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:04:16,237::task::579::TaskManager.Task::(_updateState) Task=`9428feb8-b761-4a3b-b96f-830a873c3934`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:04:16,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:04:16,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:04:16,237::task::974::TaskManager.Task::(_decref) Task=`9428feb8-b761-4a3b-b96f-830a873c3934`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:16,239::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:04:16,239::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:04:16,240::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:16,242::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:16,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:16,434::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:04:16,435::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:17,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:04:17,464::task::579::TaskManager.Task::(_updateState) Task=`89e87123-e997-4907-8bb0-ca2d360d165a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:04:17,465::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:04:17,465::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:04:17,465::task::1168::TaskManager.Task::(prepare) Task=`89e87123-e997-4907-8bb0-ca2d360d165a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:04:17,465::task::579::TaskManager.Task::(_updateState) Task=`89e87123-e997-4907-8bb0-ca2d360d165a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:04:17,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:04:17,466::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:04:17,466::task::974::TaskManager.Task::(_decref) Task=`89e87123-e997-4907-8bb0-ca2d360d165a`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:04:17,466::task::579::TaskManager.Task::(_updateState) Task=`2bc81c9a-5e4c-4883-889d-17c7fce80211`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:04:17,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:04:17,467::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:04:17,467::task::1168::TaskManager.Task::(prepare) Task=`2bc81c9a-5e4c-4883-889d-17c7fce80211`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:04:17,467::task::579::TaskManager.Task::(_updateState) Task=`2bc81c9a-5e4c-4883-889d-17c7fce80211`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:04:17,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:04:17,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:04:17,467::task::974::TaskManager.Task::(_decref) Task=`2bc81c9a-5e4c-4883-889d-17c7fce80211`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:04:17,467::task::579::TaskManager.Task::(_updateState) Task=`1aaa2285-cc59-421d-9193-0e15ba636862`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:04:17,468::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:04:17,468::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:04:17,468::task::1168::TaskManager.Task::(prepare) Task=`1aaa2285-cc59-421d-9193-0e15ba636862`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:04:17,468::task::579::TaskManager.Task::(_updateState) Task=`1aaa2285-cc59-421d-9193-0e15ba636862`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:04:17,468::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:04:17,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:04:17,468::task::974::TaskManager.Task::(_decref) Task=`1aaa2285-cc59-421d-9193-0e15ba636862`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:18,244::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:18,437::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:04:19,074::task::579::TaskManager.Task::(_updateState) Task=`97de47a8-926b-4a33-955c-70234ed31e55`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:04:19,075::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:04:19,076::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:04:19,076::task::1168::TaskManager.Task::(prepare) Task=`97de47a8-926b-4a33-955c-70234ed31e55`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:04:19,076::task::579::TaskManager.Task::(_updateState) Task=`97de47a8-926b-4a33-955c-70234ed31e55`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:04:19,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:04:19,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:04:19,076::task::974::TaskManager.Task::(_decref) Task=`97de47a8-926b-4a33-955c-70234ed31e55`::ref 0 aborting False >Thread-227488::DEBUG::2014-01-16 17:04:19,213::task::579::TaskManager.Task::(_updateState) Task=`902e4538-aa77-4256-9ccd-6c3780c59916`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:04:19,213::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:04:19,214::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:04:19,214::task::1168::TaskManager.Task::(prepare) Task=`902e4538-aa77-4256-9ccd-6c3780c59916`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:04:19,214::task::579::TaskManager.Task::(_updateState) Task=`902e4538-aa77-4256-9ccd-6c3780c59916`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:04:19,214::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:04:19,214::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:04:19,214::task::974::TaskManager.Task::(_decref) Task=`902e4538-aa77-4256-9ccd-6c3780c59916`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:19,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:20,245::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:20,439::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:21,246::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:21,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:22,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:22,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:04:22,441::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:04:22,578::task::579::TaskManager.Task::(_updateState) Task=`785f18cb-bb51-4422-b512-135aba012ee9`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:04:22,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:04:22,578::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:04:22,579::task::1168::TaskManager.Task::(prepare) Task=`785f18cb-bb51-4422-b512-135aba012ee9`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:04:22,579::task::579::TaskManager.Task::(_updateState) Task=`785f18cb-bb51-4422-b512-135aba012ee9`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:04:22,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:04:22,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:04:22,579::task::974::TaskManager.Task::(_decref) Task=`785f18cb-bb51-4422-b512-135aba012ee9`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:04:23,288::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:04:23,309::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000470084 s, 776 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:04:23,443::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:04:24,181::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:04:24,198::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000269308 s, 15.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:04:24,250::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:24,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:25,445::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:26,251::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:26,252::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:26,446::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:04:26,692::task::579::TaskManager.Task::(_updateState) Task=`15f89171-50b4-4610-a755-6e458008b498`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:04:26,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:04:26,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:04:26,693::task::1168::TaskManager.Task::(prepare) Task=`15f89171-50b4-4610-a755-6e458008b498`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:04:26,694::task::579::TaskManager.Task::(_updateState) Task=`15f89171-50b4-4610-a755-6e458008b498`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:04:26,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:04:26,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:04:26,694::task::974::TaskManager.Task::(_decref) Task=`15f89171-50b4-4610-a755-6e458008b498`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:27,448::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:04:27,448::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:04:27,448::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287498::DEBUG::2014-01-16 17:04:27,846::task::579::TaskManager.Task::(_updateState) Task=`7aa8cf3f-bdb6-4165-8e9d-395a9bb80301`::moving from state init -> state preparing >Thread-287498::INFO::2014-01-16 17:04:27,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287498::INFO::2014-01-16 17:04:27,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000470084', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269308', 'lastCheck': '3.6', 'valid': True}} >Thread-287498::DEBUG::2014-01-16 17:04:27,846::task::1168::TaskManager.Task::(prepare) Task=`7aa8cf3f-bdb6-4165-8e9d-395a9bb80301`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000470084', 'lastCheck': '4.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269308', 'lastCheck': '3.6', 'valid': True}} >Thread-287498::DEBUG::2014-01-16 17:04:27,847::task::579::TaskManager.Task::(_updateState) Task=`7aa8cf3f-bdb6-4165-8e9d-395a9bb80301`::moving from state preparing -> state finished >Thread-287498::DEBUG::2014-01-16 17:04:27,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287498::DEBUG::2014-01-16 17:04:27,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287498::DEBUG::2014-01-16 17:04:27,847::task::974::TaskManager.Task::(_decref) Task=`7aa8cf3f-bdb6-4165-8e9d-395a9bb80301`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:28,253::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:28,449::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:04:28,450::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:29,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:04:29,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:04:29,451::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:30,261::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:04:30,448::task::579::TaskManager.Task::(_updateState) Task=`8ffb3e9b-17d7-4db0-bddd-e94391872ee0`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:04:30,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:04:30,449::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:04:30,449::task::1168::TaskManager.Task::(prepare) Task=`8ffb3e9b-17d7-4db0-bddd-e94391872ee0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:04:30,449::task::579::TaskManager.Task::(_updateState) Task=`8ffb3e9b-17d7-4db0-bddd-e94391872ee0`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:04:30,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:04:30,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:04:30,449::task::974::TaskManager.Task::(_decref) Task=`8ffb3e9b-17d7-4db0-bddd-e94391872ee0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:30,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:04:30,452::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:31,264::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:04:31,264::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:04:31,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:31,454::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:04:31,454::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:32,267::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:32,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:04:33,316::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:04:33,333::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000317916 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:04:33,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:04:33,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:04:34,151::task::579::TaskManager.Task::(_updateState) Task=`d7dc7d52-f57e-426e-94f3-69b199b9f40a`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:04:34,151::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:04:34,152::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::DEBUG::2014-01-16 17:04:34,153::task::579::TaskManager.Task::(_updateState) Task=`06265da4-704d-4fe8-a66c-7b305704687f`::moving from state init -> state preparing >Thread-3175::DEBUG::2014-01-16 17:04:34,154::task::1168::TaskManager.Task::(prepare) Task=`d7dc7d52-f57e-426e-94f3-69b199b9f40a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::INFO::2014-01-16 17:04:34,156::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-3175::DEBUG::2014-01-16 17:04:34,156::task::579::TaskManager.Task::(_updateState) Task=`d7dc7d52-f57e-426e-94f3-69b199b9f40a`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:04:34,158::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::INFO::2014-01-16 17:04:34,159::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 17:04:34,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:04:34,161::task::1168::TaskManager.Task::(prepare) Task=`06265da4-704d-4fe8-a66c-7b305704687f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 17:04:34,161::task::974::TaskManager.Task::(_decref) Task=`d7dc7d52-f57e-426e-94f3-69b199b9f40a`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:04:34,163::task::579::TaskManager.Task::(_updateState) Task=`06265da4-704d-4fe8-a66c-7b305704687f`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:04:34,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:04:34,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:04:34,164::task::974::TaskManager.Task::(_decref) Task=`06265da4-704d-4fe8-a66c-7b305704687f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:04:34,205::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:04:34,225::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000223428 s, 18.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:04:34,268::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:34,457::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:04:34,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:04:35,242::task::579::TaskManager.Task::(_updateState) Task=`64b47b95-b7ab-42f3-ae02-6232ca1b7952`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:04:35,242::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:04:35,243::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:04:35,243::task::1168::TaskManager.Task::(prepare) Task=`64b47b95-b7ab-42f3-ae02-6232ca1b7952`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:04:35,243::task::579::TaskManager.Task::(_updateState) Task=`64b47b95-b7ab-42f3-ae02-6232ca1b7952`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:04:35,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:04:35,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:04:35,244::task::974::TaskManager.Task::(_decref) Task=`64b47b95-b7ab-42f3-ae02-6232ca1b7952`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:04:35,244::task::579::TaskManager.Task::(_updateState) Task=`1defa7d8-48a0-4ca0-a556-38bcfb676969`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:04:35,244::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:04:35,244::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:04:35,245::task::1168::TaskManager.Task::(prepare) Task=`1defa7d8-48a0-4ca0-a556-38bcfb676969`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:04:35,245::task::579::TaskManager.Task::(_updateState) Task=`1defa7d8-48a0-4ca0-a556-38bcfb676969`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:04:35,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:04:35,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:04:35,245::task::974::TaskManager.Task::(_decref) Task=`1defa7d8-48a0-4ca0-a556-38bcfb676969`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:35,458::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:04:35,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:04:35,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:04:35,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:36,270::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:36,271::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:36,460::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:04:36,460::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:04:36,460::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:37,460::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:04:37,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:38,272::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:38,462::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:04:38,462::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:04:38,462::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:04:38,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:04:39,278::task::579::TaskManager.Task::(_updateState) Task=`adb5b2ab-e654-48ad-8bb6-00c52c95829d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:04:39,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:04:39,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:04:39,279::task::1168::TaskManager.Task::(prepare) Task=`adb5b2ab-e654-48ad-8bb6-00c52c95829d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:04:39,279::task::579::TaskManager.Task::(_updateState) Task=`adb5b2ab-e654-48ad-8bb6-00c52c95829d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:04:39,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:04:39,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:04:39,279::task::974::TaskManager.Task::(_decref) Task=`adb5b2ab-e654-48ad-8bb6-00c52c95829d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:39,464::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:40,273::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:40,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:04:40,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:04:40,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:04:40,465::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:40,465::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:04:40,466::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:04:41,274::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:41,468::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:04:41,623::task::579::TaskManager.Task::(_updateState) Task=`e8f5d656-24c7-425c-ae37-275485b1d8f9`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:04:41,624::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:04:41,624::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:04:41,624::task::1168::TaskManager.Task::(prepare) Task=`e8f5d656-24c7-425c-ae37-275485b1d8f9`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:04:41,624::task::579::TaskManager.Task::(_updateState) Task=`e8f5d656-24c7-425c-ae37-275485b1d8f9`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:04:41,624::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:04:41,624::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:04:41,625::task::974::TaskManager.Task::(_decref) Task=`e8f5d656-24c7-425c-ae37-275485b1d8f9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:42,275::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:42,469::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:04:42,469::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:04:42,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:04:42,531::task::579::TaskManager.Task::(_updateState) Task=`bcd9f726-23e0-4541-b010-351b0da774b1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:04:42,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:04:42,531::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:04:42,532::task::1168::TaskManager.Task::(prepare) Task=`bcd9f726-23e0-4541-b010-351b0da774b1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:04:42,532::task::579::TaskManager.Task::(_updateState) Task=`bcd9f726-23e0-4541-b010-351b0da774b1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:04:42,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:04:42,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:04:42,532::task::974::TaskManager.Task::(_decref) Task=`bcd9f726-23e0-4541-b010-351b0da774b1`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:04:42,684::task::579::TaskManager.Task::(_updateState) Task=`1135a855-cd69-4aad-8e40-3601a96fc14b`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:04:42,685::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:04:42,685::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:04:42,685::task::1168::TaskManager.Task::(prepare) Task=`1135a855-cd69-4aad-8e40-3601a96fc14b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:04:42,685::task::579::TaskManager.Task::(_updateState) Task=`1135a855-cd69-4aad-8e40-3601a96fc14b`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:04:42,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:04:42,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:04:42,686::task::974::TaskManager.Task::(_decref) Task=`1135a855-cd69-4aad-8e40-3601a96fc14b`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:04:42,687::task::579::TaskManager.Task::(_updateState) Task=`af3d8b5b-580d-440b-8ade-35c32f683019`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:04:42,688::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:04:42,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:04:42,688::task::1168::TaskManager.Task::(prepare) Task=`af3d8b5b-580d-440b-8ade-35c32f683019`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:04:42,688::task::579::TaskManager.Task::(_updateState) Task=`af3d8b5b-580d-440b-8ade-35c32f683019`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:04:42,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:04:42,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:04:42,689::task::974::TaskManager.Task::(_decref) Task=`af3d8b5b-580d-440b-8ade-35c32f683019`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:04:43,249::task::579::TaskManager.Task::(_updateState) Task=`887a0fe8-b35f-4d49-9379-04001d47f72d`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:04:43,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:04:43,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:04:43,249::task::1168::TaskManager.Task::(prepare) Task=`887a0fe8-b35f-4d49-9379-04001d47f72d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:04:43,249::task::579::TaskManager.Task::(_updateState) Task=`887a0fe8-b35f-4d49-9379-04001d47f72d`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:04:43,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:04:43,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:04:43,250::task::974::TaskManager.Task::(_decref) Task=`887a0fe8-b35f-4d49-9379-04001d47f72d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:04:43,341::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:04:43,357::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279001 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:04:43,471::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:04:43,471::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:04:43,471::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287504::DEBUG::2014-01-16 17:04:43,591::task::579::TaskManager.Task::(_updateState) Task=`c022dd63-bed6-4d17-a94f-1dd0dfaf9a44`::moving from state init -> state preparing >Thread-287504::INFO::2014-01-16 17:04:43,591::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287504::INFO::2014-01-16 17:04:43,591::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279001', 'lastCheck': '0.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223428', 'lastCheck': '9.4', 'valid': True}} >Thread-287504::DEBUG::2014-01-16 17:04:43,592::task::1168::TaskManager.Task::(prepare) Task=`c022dd63-bed6-4d17-a94f-1dd0dfaf9a44`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000279001', 'lastCheck': '0.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223428', 'lastCheck': '9.4', 'valid': True}} >Thread-287504::DEBUG::2014-01-16 17:04:43,592::task::579::TaskManager.Task::(_updateState) Task=`c022dd63-bed6-4d17-a94f-1dd0dfaf9a44`::moving from state preparing -> state finished >Thread-287504::DEBUG::2014-01-16 17:04:43,592::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287504::DEBUG::2014-01-16 17:04:43,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287504::DEBUG::2014-01-16 17:04:43,592::task::974::TaskManager.Task::(_decref) Task=`c022dd63-bed6-4d17-a94f-1dd0dfaf9a44`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:04:43,635::task::579::TaskManager.Task::(_updateState) Task=`9aaf5961-33fa-43e0-a929-180dd49d6220`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:04:43,635::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:04:43,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:04:43,636::task::1168::TaskManager.Task::(prepare) Task=`9aaf5961-33fa-43e0-a929-180dd49d6220`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:04:43,636::task::579::TaskManager.Task::(_updateState) Task=`9aaf5961-33fa-43e0-a929-180dd49d6220`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:04:43,636::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:04:43,636::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:04:43,636::task::974::TaskManager.Task::(_decref) Task=`9aaf5961-33fa-43e0-a929-180dd49d6220`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:04:44,231::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:04:44,250::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000215842 s, 19.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:04:44,277::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:44,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:04:44,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:04:44,473::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:04:44,473::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:45,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:46,278::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:46,280::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:04:46,280::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:04:46,281::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:46,476::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:04:46,476::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:47,477::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:48,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:48,478::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:49,479::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:04:49,508::task::579::TaskManager.Task::(_updateState) Task=`6092b57a-7781-4af3-9aa1-9f440bd5244d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:04:49,508::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:04:49,509::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:04:49,509::task::1168::TaskManager.Task::(prepare) Task=`6092b57a-7781-4af3-9aa1-9f440bd5244d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:04:49,509::task::579::TaskManager.Task::(_updateState) Task=`6092b57a-7781-4af3-9aa1-9f440bd5244d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:04:49,509::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:04:49,509::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:04:49,509::task::974::TaskManager.Task::(_decref) Task=`6092b57a-7781-4af3-9aa1-9f440bd5244d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:04:49,510::task::579::TaskManager.Task::(_updateState) Task=`cc831850-679f-4706-bd0d-bf0dfb0ec7bc`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:04:49,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:04:49,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:04:49,510::task::1168::TaskManager.Task::(prepare) Task=`cc831850-679f-4706-bd0d-bf0dfb0ec7bc`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:04:49,510::task::579::TaskManager.Task::(_updateState) Task=`cc831850-679f-4706-bd0d-bf0dfb0ec7bc`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:04:49,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:04:49,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:04:49,511::task::974::TaskManager.Task::(_decref) Task=`cc831850-679f-4706-bd0d-bf0dfb0ec7bc`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:04:49,511::task::579::TaskManager.Task::(_updateState) Task=`72b15037-8c35-4be2-8823-1db2213d02f3`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:04:49,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:04:49,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:04:49,511::task::1168::TaskManager.Task::(prepare) Task=`72b15037-8c35-4be2-8823-1db2213d02f3`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:04:49,511::task::579::TaskManager.Task::(_updateState) Task=`72b15037-8c35-4be2-8823-1db2213d02f3`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:04:49,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:04:49,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:04:49,512::task::974::TaskManager.Task::(_decref) Task=`72b15037-8c35-4be2-8823-1db2213d02f3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:50,283::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:50,480::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:04:51,152::task::579::TaskManager.Task::(_updateState) Task=`994f0736-a5bd-450f-8876-0de4b1aeca98`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:04:51,152::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:04:51,153::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:04:51,153::task::1168::TaskManager.Task::(prepare) Task=`994f0736-a5bd-450f-8876-0de4b1aeca98`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:04:51,153::task::579::TaskManager.Task::(_updateState) Task=`994f0736-a5bd-450f-8876-0de4b1aeca98`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:04:51,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:04:51,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:04:51,153::task::974::TaskManager.Task::(_decref) Task=`994f0736-a5bd-450f-8876-0de4b1aeca98`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:51,285::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:51,481::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:52,286::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:52,482::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:04:52,483::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:04:53,364::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:04:53,381::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000322281 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:04:53,484::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:04:54,257::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:04:54,274::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000209778 s, 19.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:04:54,288::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:54,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:55,486::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:04:56,166::task::579::TaskManager.Task::(_updateState) Task=`1d3eb97c-c914-4697-95e1-2160aabca1c7`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:04:56,167::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:04:56,167::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:04:56,168::task::1168::TaskManager.Task::(prepare) Task=`1d3eb97c-c914-4697-95e1-2160aabca1c7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:04:56,168::task::579::TaskManager.Task::(_updateState) Task=`1d3eb97c-c914-4697-95e1-2160aabca1c7`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:04:56,168::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:04:56,168::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:04:56,168::task::974::TaskManager.Task::(_decref) Task=`1d3eb97c-c914-4697-95e1-2160aabca1c7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:04:56,289::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:04:56,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:56,488::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:04:57,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:04:57,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:04:57,489::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:04:58,291::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:04:58,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:04:58,491::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287510::DEBUG::2014-01-16 17:04:59,355::task::579::TaskManager.Task::(_updateState) Task=`cfcaefad-d543-46a4-85fb-5b3b4d0328a2`::moving from state init -> state preparing >Thread-287510::INFO::2014-01-16 17:04:59,355::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287510::INFO::2014-01-16 17:04:59,355::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322281', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000209778', 'lastCheck': '5.1', 'valid': True}} >Thread-287510::DEBUG::2014-01-16 17:04:59,355::task::1168::TaskManager.Task::(prepare) Task=`cfcaefad-d543-46a4-85fb-5b3b4d0328a2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322281', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000209778', 'lastCheck': '5.1', 'valid': True}} >Thread-287510::DEBUG::2014-01-16 17:04:59,356::task::579::TaskManager.Task::(_updateState) Task=`cfcaefad-d543-46a4-85fb-5b3b4d0328a2`::moving from state preparing -> state finished >Thread-287510::DEBUG::2014-01-16 17:04:59,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287510::DEBUG::2014-01-16 17:04:59,356::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287510::DEBUG::2014-01-16 17:04:59,356::task::974::TaskManager.Task::(_decref) Task=`cfcaefad-d543-46a4-85fb-5b3b4d0328a2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:04:59,491::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:04:59,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:04:59,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:00,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:00,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:05:00,493::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:01,294::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:05:01,295::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:05:01,296::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:01,494::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:05:01,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:02,297::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:02,496::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:05:02,622::task::579::TaskManager.Task::(_updateState) Task=`5f9180a4-8c84-499f-b7ad-2485619f5763`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:05:02,622::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:05:02,623::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:05:02,623::task::1168::TaskManager.Task::(prepare) Task=`5f9180a4-8c84-499f-b7ad-2485619f5763`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:05:02,623::task::579::TaskManager.Task::(_updateState) Task=`5f9180a4-8c84-499f-b7ad-2485619f5763`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:05:02,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:05:02,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:05:02,623::task::974::TaskManager.Task::(_decref) Task=`5f9180a4-8c84-499f-b7ad-2485619f5763`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:05:03,390::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:05:03,406::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291819 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:03,497::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:05:03,498::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:05:04,288::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:05:04,307::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:05:04,319::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235004 s, 17.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:04,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:05:04,499::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:05,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:05:05,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:05:05,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:05:05,501::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:06,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:06,314::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:06,502::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:05:06,503::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:05:06,503::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:07,504::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:05:07,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 17:05:07,631::task::579::TaskManager.Task::(_updateState) Task=`f210c999-e3cd-489f-ab95-3d5fa54689ca`::moving from state init -> state preparing >Thread-53040::DEBUG::2014-01-16 17:05:07,631::task::579::TaskManager.Task::(_updateState) Task=`e257cb60-d47d-4808-af51-b69be02c0f32`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:05:07,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 17:05:07,632::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 17:05:07,633::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 17:05:07,633::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:05:07,633::task::1168::TaskManager.Task::(prepare) Task=`f210c999-e3cd-489f-ab95-3d5fa54689ca`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:05:07,634::task::1168::TaskManager.Task::(prepare) Task=`e257cb60-d47d-4808-af51-b69be02c0f32`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:05:07,634::task::579::TaskManager.Task::(_updateState) Task=`f210c999-e3cd-489f-ab95-3d5fa54689ca`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:05:07,634::task::579::TaskManager.Task::(_updateState) Task=`e257cb60-d47d-4808-af51-b69be02c0f32`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:05:07,634::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:05:07,634::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:05:07,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:05:07,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:05:07,635::task::974::TaskManager.Task::(_decref) Task=`f210c999-e3cd-489f-ab95-3d5fa54689ca`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:05:07,635::task::974::TaskManager.Task::(_decref) Task=`e257cb60-d47d-4808-af51-b69be02c0f32`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:08,315::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:08,505::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:05:08,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:05:08,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:05:08,506::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:05:09,340::task::579::TaskManager.Task::(_updateState) Task=`36347a3b-cdaf-46da-9d6d-2852660ac8b9`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:05:09,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:05:09,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:05:09,341::task::1168::TaskManager.Task::(prepare) Task=`36347a3b-cdaf-46da-9d6d-2852660ac8b9`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:05:09,341::task::579::TaskManager.Task::(_updateState) Task=`36347a3b-cdaf-46da-9d6d-2852660ac8b9`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:05:09,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:05:09,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:05:09,341::task::974::TaskManager.Task::(_decref) Task=`36347a3b-cdaf-46da-9d6d-2852660ac8b9`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:05:09,342::task::579::TaskManager.Task::(_updateState) Task=`b15840c4-1141-4cb8-9ead-ff61bef694df`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:05:09,342::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:05:09,342::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:05:09,342::task::1168::TaskManager.Task::(prepare) Task=`b15840c4-1141-4cb8-9ead-ff61bef694df`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:05:09,342::task::579::TaskManager.Task::(_updateState) Task=`b15840c4-1141-4cb8-9ead-ff61bef694df`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:05:09,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:05:09,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:05:09,343::task::974::TaskManager.Task::(_decref) Task=`b15840c4-1141-4cb8-9ead-ff61bef694df`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:05:09,445::task::579::TaskManager.Task::(_updateState) Task=`5f6f94dc-fea2-4653-8287-c316467ac40b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:05:09,445::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:05:09,446::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:05:09,446::task::1168::TaskManager.Task::(prepare) Task=`5f6f94dc-fea2-4653-8287-c316467ac40b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:05:09,446::task::579::TaskManager.Task::(_updateState) Task=`5f6f94dc-fea2-4653-8287-c316467ac40b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:05:09,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:05:09,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:05:09,447::task::974::TaskManager.Task::(_decref) Task=`5f6f94dc-fea2-4653-8287-c316467ac40b`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:05:09,447::task::579::TaskManager.Task::(_updateState) Task=`0a5f724f-111c-46d3-8b47-3274b5f954a1`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:05:09,447::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:05:09,447::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:05:09,447::task::1168::TaskManager.Task::(prepare) Task=`0a5f724f-111c-46d3-8b47-3274b5f954a1`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:05:09,448::task::579::TaskManager.Task::(_updateState) Task=`0a5f724f-111c-46d3-8b47-3274b5f954a1`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:05:09,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:05:09,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:05:09,448::task::974::TaskManager.Task::(_decref) Task=`0a5f724f-111c-46d3-8b47-3274b5f954a1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:09,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 17:05:09,731::task::579::TaskManager.Task::(_updateState) Task=`de065620-3e8c-456a-8368-24bbb9cc0dce`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:05:09,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:05:09,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:05:09,732::task::1168::TaskManager.Task::(prepare) Task=`de065620-3e8c-456a-8368-24bbb9cc0dce`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:05:09,732::task::579::TaskManager.Task::(_updateState) Task=`de065620-3e8c-456a-8368-24bbb9cc0dce`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:05:09,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:05:09,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:05:09,732::task::974::TaskManager.Task::(_decref) Task=`de065620-3e8c-456a-8368-24bbb9cc0dce`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:10,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:10,508::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:05:10,508::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:05:10,509::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:05:10,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:10,509::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:05:10,510::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:05:11,318::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:11,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:12,319::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:12,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:05:12,513::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:05:12,513::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:05:13,415::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:05:13,431::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000333688 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:13,514::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:05:13,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:05:13,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:05:13,621::task::579::TaskManager.Task::(_updateState) Task=`633ff9f6-c069-47d0-bc07-e82d92bc7e9b`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:05:13,622::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:05:13,622::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:05:13,622::task::1168::TaskManager.Task::(prepare) Task=`633ff9f6-c069-47d0-bc07-e82d92bc7e9b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:05:13,622::task::579::TaskManager.Task::(_updateState) Task=`633ff9f6-c069-47d0-bc07-e82d92bc7e9b`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:05:13,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:05:13,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:05:13,623::task::974::TaskManager.Task::(_decref) Task=`633ff9f6-c069-47d0-bc07-e82d92bc7e9b`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:05:13,903::task::579::TaskManager.Task::(_updateState) Task=`44780f42-1514-4ada-bfe0-574071ddc76c`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:05:13,903::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:05:13,904::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:05:13,904::task::1168::TaskManager.Task::(prepare) Task=`44780f42-1514-4ada-bfe0-574071ddc76c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:05:13,904::task::579::TaskManager.Task::(_updateState) Task=`44780f42-1514-4ada-bfe0-574071ddc76c`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:05:13,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:05:13,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:05:13,904::task::974::TaskManager.Task::(_decref) Task=`44780f42-1514-4ada-bfe0-574071ddc76c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:14,321::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:05:14,324::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:05:14,324::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:05:14,324::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:05:14,325::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:05:14,327::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:14,352::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00026614 s, 7.7 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:05:14,354::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00026614 s, 7.7 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:05:14,354::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:05:14,354::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:05:14,354::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:05:14,355::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:05:14,355::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:05:14,355::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:05:14,356::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:05:14,356::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:05:14,356::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:05:14,515::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:05:14,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:05:14,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:05:14,517::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:05:14,580::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:05:14,584::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:05:14,584::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:05:14,586::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:05:14,586::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:05:14,586::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 17:05:14,587::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:14,752::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:05:14,756::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:14,777::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213006 s, 19.2 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:05:15,028::task::579::TaskManager.Task::(_updateState) Task=`313e44a0-c57e-4e06-99dd-d3027314c570`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:05:15,029::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:05:15,029::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:05:15,029::task::1168::TaskManager.Task::(prepare) Task=`313e44a0-c57e-4e06-99dd-d3027314c570`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:05:15,030::task::579::TaskManager.Task::(_updateState) Task=`313e44a0-c57e-4e06-99dd-d3027314c570`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:05:15,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:05:15,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:05:15,030::task::974::TaskManager.Task::(_decref) Task=`313e44a0-c57e-4e06-99dd-d3027314c570`::ref 0 aborting False >Thread-287516::DEBUG::2014-01-16 17:05:15,127::task::579::TaskManager.Task::(_updateState) Task=`0afb150c-70e3-44b1-9ec5-3d8a158acc9f`::moving from state init -> state preparing >Thread-287516::INFO::2014-01-16 17:05:15,127::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287516::INFO::2014-01-16 17:05:15,128::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333688', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213006', 'lastCheck': '0.3', 'valid': True}} >Thread-287516::DEBUG::2014-01-16 17:05:15,128::task::1168::TaskManager.Task::(prepare) Task=`0afb150c-70e3-44b1-9ec5-3d8a158acc9f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333688', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213006', 'lastCheck': '0.3', 'valid': True}} >Thread-287516::DEBUG::2014-01-16 17:05:15,128::task::579::TaskManager.Task::(_updateState) Task=`0afb150c-70e3-44b1-9ec5-3d8a158acc9f`::moving from state preparing -> state finished >Thread-287516::DEBUG::2014-01-16 17:05:15,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287516::DEBUG::2014-01-16 17:05:15,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287516::DEBUG::2014-01-16 17:05:15,128::task::974::TaskManager.Task::(_decref) Task=`0afb150c-70e3-44b1-9ec5-3d8a158acc9f`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:05:15,197::task::579::TaskManager.Task::(_updateState) Task=`0e60e868-e1a0-4f69-a442-29104d3df296`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:05:15,199::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:05:15,202::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:05:15,204::task::1168::TaskManager.Task::(prepare) Task=`0e60e868-e1a0-4f69-a442-29104d3df296`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:05:15,204::task::579::TaskManager.Task::(_updateState) Task=`0e60e868-e1a0-4f69-a442-29104d3df296`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:05:15,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:05:15,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:05:15,205::task::974::TaskManager.Task::(_decref) Task=`0e60e868-e1a0-4f69-a442-29104d3df296`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:05:15,205::task::579::TaskManager.Task::(_updateState) Task=`82b6494c-2c6d-4365-b88d-112b6e641c46`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:05:15,207::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:05:15,210::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:05:15,211::task::1168::TaskManager.Task::(prepare) Task=`82b6494c-2c6d-4365-b88d-112b6e641c46`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:05:15,213::task::579::TaskManager.Task::(_updateState) Task=`82b6494c-2c6d-4365-b88d-112b6e641c46`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:05:15,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:05:15,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:05:15,217::task::974::TaskManager.Task::(_decref) Task=`82b6494c-2c6d-4365-b88d-112b6e641c46`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:15,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:05:16,024::task::579::TaskManager.Task::(_updateState) Task=`a8761441-dfef-407c-aca2-e67365b92640`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:05:16,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:05:16,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:05:16,025::task::1168::TaskManager.Task::(prepare) Task=`a8761441-dfef-407c-aca2-e67365b92640`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:05:16,025::task::579::TaskManager.Task::(_updateState) Task=`a8761441-dfef-407c-aca2-e67365b92640`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:05:16,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:05:16,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:05:16,026::task::974::TaskManager.Task::(_decref) Task=`a8761441-dfef-407c-aca2-e67365b92640`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:16,322::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:16,323::task::579::TaskManager.Task::(_updateState) Task=`9691b444-7903-4848-988f-449e04a2e295`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:05:16,323::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:05:16,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:05:16,324::task::1168::TaskManager.Task::(prepare) Task=`9691b444-7903-4848-988f-449e04a2e295`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:05:16,324::task::579::TaskManager.Task::(_updateState) Task=`9691b444-7903-4848-988f-449e04a2e295`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:05:16,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:05:16,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:05:16,325::task::974::TaskManager.Task::(_decref) Task=`9691b444-7903-4848-988f-449e04a2e295`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:16,327::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:05:16,327::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:05:16,330::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:16,331::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:16,332::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:16,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:05:16,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:17,521::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:05:18,062::task::579::TaskManager.Task::(_updateState) Task=`ba77d0e5-13ba-4641-8124-34aabb9d4726`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:05:18,062::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:05:18,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:05:18,063::task::1168::TaskManager.Task::(prepare) Task=`ba77d0e5-13ba-4641-8124-34aabb9d4726`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:05:18,063::task::579::TaskManager.Task::(_updateState) Task=`ba77d0e5-13ba-4641-8124-34aabb9d4726`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:05:18,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:05:18,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:05:18,063::task::974::TaskManager.Task::(_decref) Task=`ba77d0e5-13ba-4641-8124-34aabb9d4726`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:05:18,064::task::579::TaskManager.Task::(_updateState) Task=`3620bbd2-00f7-430a-a338-9044e73059dc`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:05:18,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:05:18,064::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:05:18,064::task::1168::TaskManager.Task::(prepare) Task=`3620bbd2-00f7-430a-a338-9044e73059dc`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:05:18,065::task::579::TaskManager.Task::(_updateState) Task=`3620bbd2-00f7-430a-a338-9044e73059dc`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:05:18,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:05:18,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:05:18,065::task::974::TaskManager.Task::(_decref) Task=`3620bbd2-00f7-430a-a338-9044e73059dc`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:05:18,065::task::579::TaskManager.Task::(_updateState) Task=`ea00792b-44e4-45e1-b361-736c7d9b46a4`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:05:18,066::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:05:18,066::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:05:18,066::task::1168::TaskManager.Task::(prepare) Task=`ea00792b-44e4-45e1-b361-736c7d9b46a4`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:05:18,066::task::579::TaskManager.Task::(_updateState) Task=`ea00792b-44e4-45e1-b361-736c7d9b46a4`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:05:18,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:05:18,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:05:18,066::task::974::TaskManager.Task::(_decref) Task=`ea00792b-44e4-45e1-b361-736c7d9b46a4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:18,334::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:18,521::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:05:19,161::task::579::TaskManager.Task::(_updateState) Task=`f2e94224-ba69-4cec-b666-c59173452492`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:05:19,162::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:05:19,163::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:05:19,163::task::1168::TaskManager.Task::(prepare) Task=`f2e94224-ba69-4cec-b666-c59173452492`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:05:19,163::task::579::TaskManager.Task::(_updateState) Task=`f2e94224-ba69-4cec-b666-c59173452492`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:05:19,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:05:19,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:05:19,164::task::974::TaskManager.Task::(_decref) Task=`f2e94224-ba69-4cec-b666-c59173452492`::ref 0 aborting False >Thread-227488::DEBUG::2014-01-16 17:05:19,388::task::579::TaskManager.Task::(_updateState) Task=`02eefbfe-1b78-462b-9df6-695f3bdaf1f6`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:05:19,389::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:05:19,389::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:05:19,389::task::1168::TaskManager.Task::(prepare) Task=`02eefbfe-1b78-462b-9df6-695f3bdaf1f6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:05:19,389::task::579::TaskManager.Task::(_updateState) Task=`02eefbfe-1b78-462b-9df6-695f3bdaf1f6`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:05:19,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:05:19,390::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:05:19,390::task::974::TaskManager.Task::(_decref) Task=`02eefbfe-1b78-462b-9df6-695f3bdaf1f6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:19,523::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:20,335::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:20,524::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:21,336::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:21,525::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:22,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:22,527::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:05:22,527::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:05:22,744::task::579::TaskManager.Task::(_updateState) Task=`295dc454-ff69-4924-95c7-cf1daebe7fa5`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:05:22,744::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:05:22,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:05:22,745::task::1168::TaskManager.Task::(prepare) Task=`295dc454-ff69-4924-95c7-cf1daebe7fa5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:05:22,745::task::579::TaskManager.Task::(_updateState) Task=`295dc454-ff69-4924-95c7-cf1daebe7fa5`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:05:22,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:05:22,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:05:22,745::task::974::TaskManager.Task::(_decref) Task=`295dc454-ff69-4924-95c7-cf1daebe7fa5`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:05:23,442::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:05:23,458::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281859 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:23,529::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:24,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:24,530::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:05:24,786::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:24,805::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000277464 s, 14.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:25,531::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:26,340::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:26,341::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:26,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:05:26,778::task::579::TaskManager.Task::(_updateState) Task=`1dedc55f-2ead-46b0-bf6a-5a7aa9dd76b7`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:05:26,778::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:05:26,779::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:05:26,780::task::1168::TaskManager.Task::(prepare) Task=`1dedc55f-2ead-46b0-bf6a-5a7aa9dd76b7`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:05:26,780::task::579::TaskManager.Task::(_updateState) Task=`1dedc55f-2ead-46b0-bf6a-5a7aa9dd76b7`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:05:26,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:05:26,780::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:05:26,780::task::974::TaskManager.Task::(_decref) Task=`1dedc55f-2ead-46b0-bf6a-5a7aa9dd76b7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:27,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:05:27,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:05:27,533::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:28,342::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:28,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:05:28,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:29,536::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:05:29,536::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:05:29,536::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:30,344::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:30,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:05:30,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:05:30,643::task::579::TaskManager.Task::(_updateState) Task=`4b1b7895-d01c-4e6f-b579-449ed4c6846b`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:05:30,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:05:30,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:05:30,644::task::1168::TaskManager.Task::(prepare) Task=`4b1b7895-d01c-4e6f-b579-449ed4c6846b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:05:30,644::task::579::TaskManager.Task::(_updateState) Task=`4b1b7895-d01c-4e6f-b579-449ed4c6846b`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:05:30,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:05:30,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:05:30,644::task::974::TaskManager.Task::(_decref) Task=`4b1b7895-d01c-4e6f-b579-449ed4c6846b`::ref 0 aborting False >Thread-287522::DEBUG::2014-01-16 17:05:30,980::task::579::TaskManager.Task::(_updateState) Task=`009794fb-6d30-433d-82a3-864091b9c7b7`::moving from state init -> state preparing >Thread-287522::INFO::2014-01-16 17:05:30,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287522::INFO::2014-01-16 17:05:30,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281859', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277464', 'lastCheck': '6.2', 'valid': True}} >Thread-287522::DEBUG::2014-01-16 17:05:30,980::task::1168::TaskManager.Task::(prepare) Task=`009794fb-6d30-433d-82a3-864091b9c7b7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281859', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277464', 'lastCheck': '6.2', 'valid': True}} >Thread-287522::DEBUG::2014-01-16 17:05:30,980::task::579::TaskManager.Task::(_updateState) Task=`009794fb-6d30-433d-82a3-864091b9c7b7`::moving from state preparing -> state finished >Thread-287522::DEBUG::2014-01-16 17:05:30,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287522::DEBUG::2014-01-16 17:05:30,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287522::DEBUG::2014-01-16 17:05:30,981::task::974::TaskManager.Task::(_decref) Task=`009794fb-6d30-433d-82a3-864091b9c7b7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:31,346::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:05:31,346::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:05:31,353::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:31,539::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:05:31,540::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:32,354::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:32,540::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:05:33,466::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:05:33,482::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291546 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:33,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:05:33,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:34,356::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:05:34,407::task::579::TaskManager.Task::(_updateState) Task=`b3d44948-959e-49de-8f93-ca0b4c2e9200`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:05:34,407::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:05:34,408::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:05:34,408::task::1168::TaskManager.Task::(prepare) Task=`b3d44948-959e-49de-8f93-ca0b4c2e9200`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:05:34,408::task::579::TaskManager.Task::(_updateState) Task=`b3d44948-959e-49de-8f93-ca0b4c2e9200`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:05:34,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:05:34,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:05:34,409::task::579::TaskManager.Task::(_updateState) Task=`a64e579a-06f6-4a87-99e7-05ec4b2e4f65`::moving from state init -> state preparing >Thread-3175::DEBUG::2014-01-16 17:05:34,410::task::974::TaskManager.Task::(_decref) Task=`b3d44948-959e-49de-8f93-ca0b4c2e9200`::ref 0 aborting False >Thread-59295::INFO::2014-01-16 17:05:34,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:05:34,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:05:34,412::task::1168::TaskManager.Task::(prepare) Task=`a64e579a-06f6-4a87-99e7-05ec4b2e4f65`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:05:34,412::task::579::TaskManager.Task::(_updateState) Task=`a64e579a-06f6-4a87-99e7-05ec4b2e4f65`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:05:34,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:05:34,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:05:34,412::task::974::TaskManager.Task::(_decref) Task=`a64e579a-06f6-4a87-99e7-05ec4b2e4f65`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:34,542::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:05:34,542::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:05:34,812::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:34,833::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000280467 s, 14.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:35,543::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:05:35,543::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:05:35,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:05:35,544::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:05:35,616::task::579::TaskManager.Task::(_updateState) Task=`b009c29a-1cba-413e-acc6-3be3c90afe0b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:05:35,616::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:05:35,616::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:05:35,617::task::1168::TaskManager.Task::(prepare) Task=`b009c29a-1cba-413e-acc6-3be3c90afe0b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:05:35,617::task::579::TaskManager.Task::(_updateState) Task=`b009c29a-1cba-413e-acc6-3be3c90afe0b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:05:35,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:05:35,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:05:35,617::task::974::TaskManager.Task::(_decref) Task=`b009c29a-1cba-413e-acc6-3be3c90afe0b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:05:35,618::task::579::TaskManager.Task::(_updateState) Task=`43d0ed6e-92de-4b01-922d-610e79629175`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:05:35,618::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:05:35,618::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:05:35,618::task::1168::TaskManager.Task::(prepare) Task=`43d0ed6e-92de-4b01-922d-610e79629175`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:05:35,618::task::579::TaskManager.Task::(_updateState) Task=`43d0ed6e-92de-4b01-922d-610e79629175`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:05:35,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:05:35,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:05:35,619::task::974::TaskManager.Task::(_decref) Task=`43d0ed6e-92de-4b01-922d-610e79629175`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:36,357::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:36,358::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:36,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:05:36,545::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:05:36,545::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:37,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:05:37,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:38,359::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:38,547::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:05:38,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:05:38,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:05:38,548::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:05:39,457::task::579::TaskManager.Task::(_updateState) Task=`62073855-ac05-4213-a442-3e32534c9e8c`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:05:39,457::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:05:39,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:05:39,458::task::1168::TaskManager.Task::(prepare) Task=`62073855-ac05-4213-a442-3e32534c9e8c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:05:39,458::task::579::TaskManager.Task::(_updateState) Task=`62073855-ac05-4213-a442-3e32534c9e8c`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:05:39,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:05:39,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:05:39,459::task::974::TaskManager.Task::(_decref) Task=`62073855-ac05-4213-a442-3e32534c9e8c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:39,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:40,360::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:40,550::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:05:40,550::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:05:40,551::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:05:40,551::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:40,551::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:05:40,552::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:05:41,362::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:41,554::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:05:41,788::task::579::TaskManager.Task::(_updateState) Task=`eb9fc6a1-900f-4fad-aa71-0e51a7f9ab89`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:05:41,789::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:05:41,789::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:05:41,789::task::1168::TaskManager.Task::(prepare) Task=`eb9fc6a1-900f-4fad-aa71-0e51a7f9ab89`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:05:41,789::task::579::TaskManager.Task::(_updateState) Task=`eb9fc6a1-900f-4fad-aa71-0e51a7f9ab89`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:05:41,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:05:41,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:05:41,790::task::974::TaskManager.Task::(_decref) Task=`eb9fc6a1-900f-4fad-aa71-0e51a7f9ab89`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:42,363::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:42,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:05:42,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:05:42,555::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:05:42,711::task::579::TaskManager.Task::(_updateState) Task=`f91a899e-28c0-4fdc-a6d7-3398d1cdfb9f`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:05:42,712::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:05:42,712::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:05:42,712::task::1168::TaskManager.Task::(prepare) Task=`f91a899e-28c0-4fdc-a6d7-3398d1cdfb9f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:05:42,712::task::579::TaskManager.Task::(_updateState) Task=`f91a899e-28c0-4fdc-a6d7-3398d1cdfb9f`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:05:42,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:05:42,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:05:42,713::task::974::TaskManager.Task::(_decref) Task=`f91a899e-28c0-4fdc-a6d7-3398d1cdfb9f`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:05:42,864::task::579::TaskManager.Task::(_updateState) Task=`1c9e5983-16ce-4a68-907c-c55b562e91e0`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:05:42,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:05:42,864::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:05:42,864::task::1168::TaskManager.Task::(prepare) Task=`1c9e5983-16ce-4a68-907c-c55b562e91e0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:05:42,864::task::579::TaskManager.Task::(_updateState) Task=`1c9e5983-16ce-4a68-907c-c55b562e91e0`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:05:42,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:05:42,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:05:42,865::task::974::TaskManager.Task::(_decref) Task=`1c9e5983-16ce-4a68-907c-c55b562e91e0`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:05:42,869::task::579::TaskManager.Task::(_updateState) Task=`51e01270-8f14-4c47-a6a9-692c4824c601`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:05:42,870::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:05:42,870::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:05:42,870::task::1168::TaskManager.Task::(prepare) Task=`51e01270-8f14-4c47-a6a9-692c4824c601`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:05:42,871::task::579::TaskManager.Task::(_updateState) Task=`51e01270-8f14-4c47-a6a9-692c4824c601`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:05:42,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:05:42,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:05:42,871::task::974::TaskManager.Task::(_decref) Task=`51e01270-8f14-4c47-a6a9-692c4824c601`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:05:43,421::task::579::TaskManager.Task::(_updateState) Task=`46607fd7-b451-4dcc-a4d3-9f3d14abbda5`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:05:43,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:05:43,421::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:05:43,422::task::1168::TaskManager.Task::(prepare) Task=`46607fd7-b451-4dcc-a4d3-9f3d14abbda5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:05:43,422::task::579::TaskManager.Task::(_updateState) Task=`46607fd7-b451-4dcc-a4d3-9f3d14abbda5`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:05:43,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:05:43,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:05:43,422::task::974::TaskManager.Task::(_decref) Task=`46607fd7-b451-4dcc-a4d3-9f3d14abbda5`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:05:43,490::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:05:43,507::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291955 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:43,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:05:43,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:05:43,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:05:43,807::task::579::TaskManager.Task::(_updateState) Task=`336ed562-422b-4b9a-9432-c55527ef32b5`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:05:43,807::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:05:43,807::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:05:43,808::task::1168::TaskManager.Task::(prepare) Task=`336ed562-422b-4b9a-9432-c55527ef32b5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:05:43,808::task::579::TaskManager.Task::(_updateState) Task=`336ed562-422b-4b9a-9432-c55527ef32b5`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:05:43,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:05:43,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:05:43,808::task::974::TaskManager.Task::(_decref) Task=`336ed562-422b-4b9a-9432-c55527ef32b5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:44,364::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:44,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:05:44,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:05:44,558::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:05:44,559::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:05:44,839::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:44,857::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268888 s, 15.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:45,560::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:46,366::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:46,369::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:05:46,369::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:05:46,370::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:46,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:05:46,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287528::DEBUG::2014-01-16 17:05:46,862::task::579::TaskManager.Task::(_updateState) Task=`738c55f8-2fc0-44e3-885c-4a29065d0dd6`::moving from state init -> state preparing >Thread-287528::INFO::2014-01-16 17:05:46,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287528::INFO::2014-01-16 17:05:46,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291955', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268888', 'lastCheck': '2.0', 'valid': True}} >Thread-287528::DEBUG::2014-01-16 17:05:46,863::task::1168::TaskManager.Task::(prepare) Task=`738c55f8-2fc0-44e3-885c-4a29065d0dd6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291955', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268888', 'lastCheck': '2.0', 'valid': True}} >Thread-287528::DEBUG::2014-01-16 17:05:46,863::task::579::TaskManager.Task::(_updateState) Task=`738c55f8-2fc0-44e3-885c-4a29065d0dd6`::moving from state preparing -> state finished >Thread-287528::DEBUG::2014-01-16 17:05:46,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287528::DEBUG::2014-01-16 17:05:46,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287528::DEBUG::2014-01-16 17:05:46,863::task::974::TaskManager.Task::(_decref) Task=`738c55f8-2fc0-44e3-885c-4a29065d0dd6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:05:47,562::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:48,372::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:48,569::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:49,570::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:05:49,785::task::579::TaskManager.Task::(_updateState) Task=`f81b6fad-cc61-44a3-8f4d-6b1513eeb976`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:05:49,786::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:05:49,786::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:05:49,786::task::1168::TaskManager.Task::(prepare) Task=`f81b6fad-cc61-44a3-8f4d-6b1513eeb976`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:05:49,786::task::579::TaskManager.Task::(_updateState) Task=`f81b6fad-cc61-44a3-8f4d-6b1513eeb976`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:05:49,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:05:49,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:05:49,787::task::974::TaskManager.Task::(_decref) Task=`f81b6fad-cc61-44a3-8f4d-6b1513eeb976`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:05:49,787::task::579::TaskManager.Task::(_updateState) Task=`0d898816-cb5f-4bed-b7ea-f873b265606e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:05:49,787::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:05:49,788::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:05:49,788::task::1168::TaskManager.Task::(prepare) Task=`0d898816-cb5f-4bed-b7ea-f873b265606e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:05:49,788::task::579::TaskManager.Task::(_updateState) Task=`0d898816-cb5f-4bed-b7ea-f873b265606e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:05:49,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:05:49,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:05:49,788::task::974::TaskManager.Task::(_decref) Task=`0d898816-cb5f-4bed-b7ea-f873b265606e`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:05:49,789::task::579::TaskManager.Task::(_updateState) Task=`d9a04675-92d4-4158-bbb6-8f97710d6705`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:05:49,789::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:05:49,789::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:05:49,789::task::1168::TaskManager.Task::(prepare) Task=`d9a04675-92d4-4158-bbb6-8f97710d6705`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:05:49,789::task::579::TaskManager.Task::(_updateState) Task=`d9a04675-92d4-4158-bbb6-8f97710d6705`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:05:49,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:05:49,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:05:49,790::task::974::TaskManager.Task::(_decref) Task=`d9a04675-92d4-4158-bbb6-8f97710d6705`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:50,373::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:50,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:05:51,321::task::579::TaskManager.Task::(_updateState) Task=`41d71d53-44a8-430d-9798-3483bac576eb`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:05:51,321::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:05:51,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:05:51,321::task::1168::TaskManager.Task::(prepare) Task=`41d71d53-44a8-430d-9798-3483bac576eb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:05:51,322::task::579::TaskManager.Task::(_updateState) Task=`41d71d53-44a8-430d-9798-3483bac576eb`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:05:51,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:05:51,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:05:51,322::task::974::TaskManager.Task::(_decref) Task=`41d71d53-44a8-430d-9798-3483bac576eb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:51,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:51,572::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:52,376::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:52,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:05:52,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:05:53,514::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:05:53,530::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000268744 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:53,575::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:54,377::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:54,576::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:05:54,864::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:05:54,887::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000455503 s, 9.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:05:55,578::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:05:56,356::task::579::TaskManager.Task::(_updateState) Task=`d64a2054-8729-4c84-a78b-b9f6b66d8f03`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:05:56,356::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:05:56,357::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:05:56,357::task::1168::TaskManager.Task::(prepare) Task=`d64a2054-8729-4c84-a78b-b9f6b66d8f03`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:05:56,357::task::579::TaskManager.Task::(_updateState) Task=`d64a2054-8729-4c84-a78b-b9f6b66d8f03`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:05:56,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:05:56,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:05:56,357::task::974::TaskManager.Task::(_decref) Task=`d64a2054-8729-4c84-a78b-b9f6b66d8f03`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:05:56,379::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:05:56,380::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:56,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:57,579::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:05:57,580::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:05:57,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:05:58,381::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:05:58,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:05:58,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:05:59,582::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:05:59,582::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:05:59,583::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:00,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:00,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:06:00,584::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:01,384::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:06:01,385::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:06:01,386::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:01,585::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:06:01,585::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:02,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:02,586::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287534::DEBUG::2014-01-16 17:06:02,774::task::579::TaskManager.Task::(_updateState) Task=`68dfece1-6760-4024-b5b1-4bbf8eb3458c`::moving from state init -> state preparing >Thread-287534::INFO::2014-01-16 17:06:02,774::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287534::INFO::2014-01-16 17:06:02,775::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268744', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455503', 'lastCheck': '7.9', 'valid': True}} >Thread-287534::DEBUG::2014-01-16 17:06:02,775::task::1168::TaskManager.Task::(prepare) Task=`68dfece1-6760-4024-b5b1-4bbf8eb3458c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268744', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455503', 'lastCheck': '7.9', 'valid': True}} >Thread-287534::DEBUG::2014-01-16 17:06:02,775::task::579::TaskManager.Task::(_updateState) Task=`68dfece1-6760-4024-b5b1-4bbf8eb3458c`::moving from state preparing -> state finished >Thread-287534::DEBUG::2014-01-16 17:06:02,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287534::DEBUG::2014-01-16 17:06:02,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287534::DEBUG::2014-01-16 17:06:02,775::task::974::TaskManager.Task::(_decref) Task=`68dfece1-6760-4024-b5b1-4bbf8eb3458c`::ref 0 aborting False >Thread-84941::DEBUG::2014-01-16 17:06:02,790::task::579::TaskManager.Task::(_updateState) Task=`d6bbaf9d-268a-45ee-927b-2573fc365f03`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:06:02,790::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:06:02,791::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:06:02,791::task::1168::TaskManager.Task::(prepare) Task=`d6bbaf9d-268a-45ee-927b-2573fc365f03`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:06:02,791::task::579::TaskManager.Task::(_updateState) Task=`d6bbaf9d-268a-45ee-927b-2573fc365f03`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:06:02,791::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:06:02,791::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:06:02,791::task::974::TaskManager.Task::(_decref) Task=`d6bbaf9d-268a-45ee-927b-2573fc365f03`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:06:03,537::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:06:03,555::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000331247 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:03,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:06:03,588::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:04,389::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:04,589::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:06:04,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:06:04,895::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:06:04,913::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000318851 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:05,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:06:05,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:06:05,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:06:05,591::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:06,390::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:06,391::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:06,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:06:06,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:06:06,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:07,593::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:06:07,593::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:06:07,718::task::579::TaskManager.Task::(_updateState) Task=`65288f21-f9d0-4213-8c12-e041438461f0`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:06:07,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::DEBUG::2014-01-16 17:06:07,719::task::579::TaskManager.Task::(_updateState) Task=`855d7aca-3b29-4aeb-9143-c11630efb0d0`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:06:07,720::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 17:06:07,721::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 17:06:07,721::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:06:07,721::task::1168::TaskManager.Task::(prepare) Task=`65288f21-f9d0-4213-8c12-e041438461f0`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:06:07,721::task::1168::TaskManager.Task::(prepare) Task=`855d7aca-3b29-4aeb-9143-c11630efb0d0`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:06:07,722::task::579::TaskManager.Task::(_updateState) Task=`65288f21-f9d0-4213-8c12-e041438461f0`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:06:07,722::task::579::TaskManager.Task::(_updateState) Task=`855d7aca-3b29-4aeb-9143-c11630efb0d0`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:06:07,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:06:07,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:06:07,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:06:07,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:06:07,723::task::974::TaskManager.Task::(_decref) Task=`65288f21-f9d0-4213-8c12-e041438461f0`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:06:07,723::task::974::TaskManager.Task::(_decref) Task=`855d7aca-3b29-4aeb-9143-c11630efb0d0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:08,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:08,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:06:08,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:06:08,594::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:06:08,595::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:06:09,554::task::579::TaskManager.Task::(_updateState) Task=`b4605ec6-7281-4f19-9753-6e4e357f8b05`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:06:09,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:06:09,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:06:09,556::task::1168::TaskManager.Task::(prepare) Task=`b4605ec6-7281-4f19-9753-6e4e357f8b05`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:06:09,556::task::579::TaskManager.Task::(_updateState) Task=`b4605ec6-7281-4f19-9753-6e4e357f8b05`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:06:09,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:06:09,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:06:09,557::task::974::TaskManager.Task::(_decref) Task=`b4605ec6-7281-4f19-9753-6e4e357f8b05`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:06:09,557::task::579::TaskManager.Task::(_updateState) Task=`502dec63-4e64-4322-82c4-e6d4a48281e2`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:06:09,557::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:06:09,557::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:06:09,557::task::1168::TaskManager.Task::(prepare) Task=`502dec63-4e64-4322-82c4-e6d4a48281e2`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:06:09,558::task::579::TaskManager.Task::(_updateState) Task=`502dec63-4e64-4322-82c4-e6d4a48281e2`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:06:09,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:06:09,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:06:09,558::task::974::TaskManager.Task::(_decref) Task=`502dec63-4e64-4322-82c4-e6d4a48281e2`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:06:09,593::task::579::TaskManager.Task::(_updateState) Task=`37d13e75-db42-4c3a-9e0a-83fa7c2441e3`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:06:09,594::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:06:09,594::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:06:09,594::task::1168::TaskManager.Task::(prepare) Task=`37d13e75-db42-4c3a-9e0a-83fa7c2441e3`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:06:09,594::task::579::TaskManager.Task::(_updateState) Task=`37d13e75-db42-4c3a-9e0a-83fa7c2441e3`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:06:09,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:06:09,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:06:09,595::task::974::TaskManager.Task::(_decref) Task=`37d13e75-db42-4c3a-9e0a-83fa7c2441e3`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:06:09,595::task::579::TaskManager.Task::(_updateState) Task=`88618e3f-4c7f-4a48-a859-ec0ee48dc488`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:06:09,595::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:06:09,595::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >VM Channels Listener::DEBUG::2014-01-16 17:06:09,596::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:06:09,596::task::1168::TaskManager.Task::(prepare) Task=`88618e3f-4c7f-4a48-a859-ec0ee48dc488`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:06:09,596::task::579::TaskManager.Task::(_updateState) Task=`88618e3f-4c7f-4a48-a859-ec0ee48dc488`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:06:09,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:06:09,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:06:09,597::task::974::TaskManager.Task::(_decref) Task=`88618e3f-4c7f-4a48-a859-ec0ee48dc488`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:06:09,922::task::579::TaskManager.Task::(_updateState) Task=`2ab6acad-b4ef-4b9d-9253-1a324baed6ac`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:06:09,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:06:09,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:06:09,923::task::1168::TaskManager.Task::(prepare) Task=`2ab6acad-b4ef-4b9d-9253-1a324baed6ac`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:06:09,923::task::579::TaskManager.Task::(_updateState) Task=`2ab6acad-b4ef-4b9d-9253-1a324baed6ac`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:06:09,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:06:09,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:06:09,923::task::974::TaskManager.Task::(_decref) Task=`2ab6acad-b4ef-4b9d-9253-1a324baed6ac`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:10,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:10,597::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:06:10,597::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:06:10,598::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:06:10,598::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:10,598::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:06:10,599::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:06:11,395::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:11,599::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:12,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:12,600::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:06:12,601::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:06:12,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:13,557::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:06:13,561::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:06:13,562::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:06:13,567::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:06:13,568::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:06:13,568::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:06:13,568::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 17:06:13,573::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:06:13,590::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251213 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:13,602::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:06:13,602::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:06:13,602::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:06:13,773::task::579::TaskManager.Task::(_updateState) Task=`ad894b7f-4350-4339-a377-1799bf94737f`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:06:13,773::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:06:13,774::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:06:13,774::task::1168::TaskManager.Task::(prepare) Task=`ad894b7f-4350-4339-a377-1799bf94737f`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:06:13,774::task::579::TaskManager.Task::(_updateState) Task=`ad894b7f-4350-4339-a377-1799bf94737f`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:06:13,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:06:13,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:06:13,774::task::974::TaskManager.Task::(_decref) Task=`ad894b7f-4350-4339-a377-1799bf94737f`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:06:14,080::task::579::TaskManager.Task::(_updateState) Task=`c3a4fd75-9365-42b4-84e0-4664c65d779e`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:06:14,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:06:14,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:06:14,081::task::1168::TaskManager.Task::(prepare) Task=`c3a4fd75-9365-42b4-84e0-4664c65d779e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:06:14,081::task::579::TaskManager.Task::(_updateState) Task=`c3a4fd75-9365-42b4-84e0-4664c65d779e`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:06:14,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:06:14,082::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:06:14,082::task::974::TaskManager.Task::(_decref) Task=`c3a4fd75-9365-42b4-84e0-4664c65d779e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:14,399::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:14,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:06:14,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:06:14,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:06:14,604::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:06:14,918::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:06:14,935::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000259857 s, 15.8 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:06:15,212::task::579::TaskManager.Task::(_updateState) Task=`459b000d-5084-4249-b738-21daa086b775`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:06:15,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:06:15,212::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:06:15,213::task::1168::TaskManager.Task::(prepare) Task=`459b000d-5084-4249-b738-21daa086b775`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:06:15,213::task::579::TaskManager.Task::(_updateState) Task=`459b000d-5084-4249-b738-21daa086b775`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:06:15,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:06:15,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:06:15,213::task::974::TaskManager.Task::(_decref) Task=`459b000d-5084-4249-b738-21daa086b775`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:06:15,443::task::579::TaskManager.Task::(_updateState) Task=`c0b08fcf-ec35-4858-b908-762c71512c6d`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:06:15,444::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:06:15,444::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:06:15,444::task::1168::TaskManager.Task::(prepare) Task=`c0b08fcf-ec35-4858-b908-762c71512c6d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:06:15,444::task::579::TaskManager.Task::(_updateState) Task=`c0b08fcf-ec35-4858-b908-762c71512c6d`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:06:15,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:06:15,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:06:15,445::task::974::TaskManager.Task::(_decref) Task=`c0b08fcf-ec35-4858-b908-762c71512c6d`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:06:15,445::task::579::TaskManager.Task::(_updateState) Task=`49231e9a-fd8f-4fcf-a30e-dd8f7c6a8b17`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:06:15,445::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:06:15,446::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:06:15,446::task::1168::TaskManager.Task::(prepare) Task=`49231e9a-fd8f-4fcf-a30e-dd8f7c6a8b17`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:06:15,446::task::579::TaskManager.Task::(_updateState) Task=`49231e9a-fd8f-4fcf-a30e-dd8f7c6a8b17`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:06:15,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:06:15,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:06:15,446::task::974::TaskManager.Task::(_decref) Task=`49231e9a-fd8f-4fcf-a30e-dd8f7c6a8b17`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:15,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:06:16,198::task::579::TaskManager.Task::(_updateState) Task=`88648a57-b2bf-476b-a872-1fe2260304bd`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:06:16,199::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:06:16,199::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:06:16,199::task::1168::TaskManager.Task::(prepare) Task=`88648a57-b2bf-476b-a872-1fe2260304bd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:06:16,199::task::579::TaskManager.Task::(_updateState) Task=`88648a57-b2bf-476b-a872-1fe2260304bd`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:06:16,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:06:16,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:06:16,200::task::974::TaskManager.Task::(_decref) Task=`88648a57-b2bf-476b-a872-1fe2260304bd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:16,400::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:16,401::task::579::TaskManager.Task::(_updateState) Task=`b411a834-df4f-4353-99c0-834878b3ecba`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:06:16,401::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:06:16,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:06:16,402::task::1168::TaskManager.Task::(prepare) Task=`b411a834-df4f-4353-99c0-834878b3ecba`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:06:16,402::task::579::TaskManager.Task::(_updateState) Task=`b411a834-df4f-4353-99c0-834878b3ecba`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:06:16,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:06:16,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:06:16,402::task::974::TaskManager.Task::(_decref) Task=`b411a834-df4f-4353-99c0-834878b3ecba`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:16,404::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:06:16,404::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:06:16,406::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:16,407::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:16,408::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:16,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:06:16,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:17,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:18,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287541::DEBUG::2014-01-16 17:06:18,490::task::579::TaskManager.Task::(_updateState) Task=`13a5dd1f-e7cf-45db-92f7-e272ce4f36c2`::moving from state init -> state preparing >Thread-287541::INFO::2014-01-16 17:06:18,490::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287541::INFO::2014-01-16 17:06:18,490::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251213', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259857', 'lastCheck': '3.6', 'valid': True}} >Thread-287541::DEBUG::2014-01-16 17:06:18,490::task::1168::TaskManager.Task::(prepare) Task=`13a5dd1f-e7cf-45db-92f7-e272ce4f36c2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251213', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259857', 'lastCheck': '3.6', 'valid': True}} >Thread-287541::DEBUG::2014-01-16 17:06:18,490::task::579::TaskManager.Task::(_updateState) Task=`13a5dd1f-e7cf-45db-92f7-e272ce4f36c2`::moving from state preparing -> state finished >Thread-287541::DEBUG::2014-01-16 17:06:18,490::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287541::DEBUG::2014-01-16 17:06:18,491::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287541::DEBUG::2014-01-16 17:06:18,491::task::974::TaskManager.Task::(_decref) Task=`13a5dd1f-e7cf-45db-92f7-e272ce4f36c2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:18,609::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:06:18,640::task::579::TaskManager.Task::(_updateState) Task=`a8b4c1e1-70f3-40e6-b581-9598b8cd3433`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:06:18,640::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:06:18,640::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:06:18,640::task::1168::TaskManager.Task::(prepare) Task=`a8b4c1e1-70f3-40e6-b581-9598b8cd3433`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:06:18,641::task::579::TaskManager.Task::(_updateState) Task=`a8b4c1e1-70f3-40e6-b581-9598b8cd3433`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:06:18,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:06:18,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:06:18,641::task::974::TaskManager.Task::(_decref) Task=`a8b4c1e1-70f3-40e6-b581-9598b8cd3433`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:06:18,641::task::579::TaskManager.Task::(_updateState) Task=`f2102089-9818-4702-a87d-f77cd4dbc70d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:06:18,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:06:18,642::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:06:18,642::task::1168::TaskManager.Task::(prepare) Task=`f2102089-9818-4702-a87d-f77cd4dbc70d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:06:18,642::task::579::TaskManager.Task::(_updateState) Task=`f2102089-9818-4702-a87d-f77cd4dbc70d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:06:18,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:06:18,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:06:18,642::task::974::TaskManager.Task::(_decref) Task=`f2102089-9818-4702-a87d-f77cd4dbc70d`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:06:18,642::task::579::TaskManager.Task::(_updateState) Task=`9dcaface-c761-47e5-a835-602579a3c8d9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:06:18,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:06:18,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:06:18,643::task::1168::TaskManager.Task::(prepare) Task=`9dcaface-c761-47e5-a835-602579a3c8d9`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:06:18,643::task::579::TaskManager.Task::(_updateState) Task=`9dcaface-c761-47e5-a835-602579a3c8d9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:06:18,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:06:18,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:06:18,643::task::974::TaskManager.Task::(_decref) Task=`9dcaface-c761-47e5-a835-602579a3c8d9`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:06:19,246::task::579::TaskManager.Task::(_updateState) Task=`b20a33e6-ad48-4873-be31-2831e80d99f2`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:06:19,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:06:19,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:06:19,247::task::1168::TaskManager.Task::(prepare) Task=`b20a33e6-ad48-4873-be31-2831e80d99f2`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:06:19,247::task::579::TaskManager.Task::(_updateState) Task=`b20a33e6-ad48-4873-be31-2831e80d99f2`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:06:19,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:06:19,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:06:19,247::task::974::TaskManager.Task::(_decref) Task=`b20a33e6-ad48-4873-be31-2831e80d99f2`::ref 0 aborting False >Thread-227488::DEBUG::2014-01-16 17:06:19,558::task::579::TaskManager.Task::(_updateState) Task=`d87615ce-6323-4b13-a75b-89972f52ea36`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:06:19,559::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:06:19,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:06:19,559::task::1168::TaskManager.Task::(prepare) Task=`d87615ce-6323-4b13-a75b-89972f52ea36`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:06:19,559::task::579::TaskManager.Task::(_updateState) Task=`d87615ce-6323-4b13-a75b-89972f52ea36`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:06:19,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:06:19,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:06:19,560::task::974::TaskManager.Task::(_decref) Task=`d87615ce-6323-4b13-a75b-89972f52ea36`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:19,610::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:20,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:20,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:21,412::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:21,612::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:22,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:22,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:06:22,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:06:22,911::task::579::TaskManager.Task::(_updateState) Task=`d96743e6-fba2-45c2-bfcf-028975d5043d`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:06:22,912::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:06:22,912::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:06:22,912::task::1168::TaskManager.Task::(prepare) Task=`d96743e6-fba2-45c2-bfcf-028975d5043d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:06:22,912::task::579::TaskManager.Task::(_updateState) Task=`d96743e6-fba2-45c2-bfcf-028975d5043d`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:06:22,912::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:06:22,912::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:06:22,913::task::974::TaskManager.Task::(_decref) Task=`d96743e6-fba2-45c2-bfcf-028975d5043d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:06:23,598::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:06:23,616::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:23,616::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000246764 s, 1.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:06:24,415::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:24,619::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:06:24,942::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:06:24,960::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000193203 s, 21.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:25,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:26,417::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:26,418::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:26,621::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:06:26,858::task::579::TaskManager.Task::(_updateState) Task=`2d455cd6-f467-4e4f-bace-998332b18e74`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:06:26,858::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:06:26,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:06:26,859::task::1168::TaskManager.Task::(prepare) Task=`2d455cd6-f467-4e4f-bace-998332b18e74`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:06:26,859::task::579::TaskManager.Task::(_updateState) Task=`2d455cd6-f467-4e4f-bace-998332b18e74`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:06:26,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:06:26,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:06:26,860::task::974::TaskManager.Task::(_decref) Task=`2d455cd6-f467-4e4f-bace-998332b18e74`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:27,623::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:06:27,623::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:06:27,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:28,419::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:28,624::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:06:28,624::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:29,625::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:06:29,625::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:06:29,625::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:30,421::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:30,626::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:06:30,627::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:06:30,817::task::579::TaskManager.Task::(_updateState) Task=`de7bcd74-2b55-4211-ba28-b5035e1a91cc`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:06:30,817::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:06:30,817::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:06:30,818::task::1168::TaskManager.Task::(prepare) Task=`de7bcd74-2b55-4211-ba28-b5035e1a91cc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:06:30,818::task::579::TaskManager.Task::(_updateState) Task=`de7bcd74-2b55-4211-ba28-b5035e1a91cc`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:06:30,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:06:30,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:06:30,818::task::974::TaskManager.Task::(_decref) Task=`de7bcd74-2b55-4211-ba28-b5035e1a91cc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:31,423::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:06:31,423::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:06:31,424::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:31,627::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:06:31,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:32,426::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:32,629::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:33,626::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:06:33,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:06:33,643::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:33,645::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002698 s, 1.4 MB/s\n'; <rc> = 0 >Thread-287547::DEBUG::2014-01-16 17:06:34,275::task::579::TaskManager.Task::(_updateState) Task=`bccac0e3-7db1-4d33-af69-1d80339946d3`::moving from state init -> state preparing >Thread-287547::INFO::2014-01-16 17:06:34,275::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287547::INFO::2014-01-16 17:06:34,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002698', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000193203', 'lastCheck': '9.3', 'valid': True}} >Thread-287547::DEBUG::2014-01-16 17:06:34,276::task::1168::TaskManager.Task::(prepare) Task=`bccac0e3-7db1-4d33-af69-1d80339946d3`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0002698', 'lastCheck': '0.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000193203', 'lastCheck': '9.3', 'valid': True}} >Thread-287547::DEBUG::2014-01-16 17:06:34,276::task::579::TaskManager.Task::(_updateState) Task=`bccac0e3-7db1-4d33-af69-1d80339946d3`::moving from state preparing -> state finished >Thread-287547::DEBUG::2014-01-16 17:06:34,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287547::DEBUG::2014-01-16 17:06:34,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287547::DEBUG::2014-01-16 17:06:34,277::task::974::TaskManager.Task::(_decref) Task=`bccac0e3-7db1-4d33-af69-1d80339946d3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:34,427::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:06:34,576::task::579::TaskManager.Task::(_updateState) Task=`b749efc6-8d86-4816-9703-1a8519e42a30`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:06:34,577::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:06:34,577::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:06:34,577::task::1168::TaskManager.Task::(prepare) Task=`b749efc6-8d86-4816-9703-1a8519e42a30`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:06:34,577::task::579::TaskManager.Task::(_updateState) Task=`b749efc6-8d86-4816-9703-1a8519e42a30`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:06:34,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:06:34,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:06:34,578::task::974::TaskManager.Task::(_decref) Task=`b749efc6-8d86-4816-9703-1a8519e42a30`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:06:34,593::task::579::TaskManager.Task::(_updateState) Task=`b384c37e-daff-42b2-a40f-ec05e64742ec`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:06:34,594::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:06:34,594::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:06:34,594::task::1168::TaskManager.Task::(prepare) Task=`b384c37e-daff-42b2-a40f-ec05e64742ec`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:06:34,595::task::579::TaskManager.Task::(_updateState) Task=`b384c37e-daff-42b2-a40f-ec05e64742ec`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:06:34,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:06:34,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:06:34,595::task::974::TaskManager.Task::(_decref) Task=`b384c37e-daff-42b2-a40f-ec05e64742ec`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:34,645::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:06:34,645::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:06:34,969::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:06:34,990::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235479 s, 17.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:35,646::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:06:35,646::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:06:35,646::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:06:35,646::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:06:35,993::task::579::TaskManager.Task::(_updateState) Task=`fad25dd4-eca3-417e-9bd7-359ce56d97d2`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:06:35,993::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:06:35,993::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:06:35,994::task::1168::TaskManager.Task::(prepare) Task=`fad25dd4-eca3-417e-9bd7-359ce56d97d2`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:06:35,994::task::579::TaskManager.Task::(_updateState) Task=`fad25dd4-eca3-417e-9bd7-359ce56d97d2`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:06:35,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:06:35,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:06:35,994::task::974::TaskManager.Task::(_decref) Task=`fad25dd4-eca3-417e-9bd7-359ce56d97d2`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:06:35,994::task::579::TaskManager.Task::(_updateState) Task=`f0bd5b7d-1de0-4f35-9dfa-98abae433ca0`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:06:35,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:06:35,995::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:06:35,995::task::1168::TaskManager.Task::(prepare) Task=`f0bd5b7d-1de0-4f35-9dfa-98abae433ca0`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:06:35,995::task::579::TaskManager.Task::(_updateState) Task=`f0bd5b7d-1de0-4f35-9dfa-98abae433ca0`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:06:35,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:06:35,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:06:35,995::task::974::TaskManager.Task::(_decref) Task=`f0bd5b7d-1de0-4f35-9dfa-98abae433ca0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:36,429::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:36,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:36,647::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:06:36,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:06:36,648::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:37,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:06:37,650::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:38,431::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:38,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:06:38,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:06:38,651::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:06:38,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:39,652::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:06:39,658::task::579::TaskManager.Task::(_updateState) Task=`8809fac6-d21b-436f-a518-a4718e7119ec`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:06:39,658::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:06:39,659::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:06:39,659::task::1168::TaskManager.Task::(prepare) Task=`8809fac6-d21b-436f-a518-a4718e7119ec`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:06:39,659::task::579::TaskManager.Task::(_updateState) Task=`8809fac6-d21b-436f-a518-a4718e7119ec`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:06:39,659::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:06:39,659::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:06:39,659::task::974::TaskManager.Task::(_decref) Task=`8809fac6-d21b-436f-a518-a4718e7119ec`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:40,432::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:40,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:06:40,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:06:40,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:06:40,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:40,654::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:06:40,654::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:06:41,434::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:41,655::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:06:41,956::task::579::TaskManager.Task::(_updateState) Task=`3d3b13f7-405a-4e86-9fdb-baab7ae1c639`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:06:41,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:06:41,957::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:06:41,957::task::1168::TaskManager.Task::(prepare) Task=`3d3b13f7-405a-4e86-9fdb-baab7ae1c639`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:06:41,957::task::579::TaskManager.Task::(_updateState) Task=`3d3b13f7-405a-4e86-9fdb-baab7ae1c639`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:06:41,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:06:41,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:06:41,957::task::974::TaskManager.Task::(_decref) Task=`3d3b13f7-405a-4e86-9fdb-baab7ae1c639`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:42,435::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:42,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:06:42,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:06:42,657::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:06:42,871::task::579::TaskManager.Task::(_updateState) Task=`06a5d921-753e-401a-96b3-ae3278b68f0b`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:06:42,872::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:06:42,872::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:06:42,872::task::1168::TaskManager.Task::(prepare) Task=`06a5d921-753e-401a-96b3-ae3278b68f0b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:06:42,872::task::579::TaskManager.Task::(_updateState) Task=`06a5d921-753e-401a-96b3-ae3278b68f0b`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:06:42,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:06:42,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:06:42,873::task::974::TaskManager.Task::(_decref) Task=`06a5d921-753e-401a-96b3-ae3278b68f0b`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:06:43,039::task::579::TaskManager.Task::(_updateState) Task=`780cfdff-22bd-4e0e-86bf-36a6357b472b`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:06:43,039::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:06:43,040::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:06:43,040::task::1168::TaskManager.Task::(prepare) Task=`780cfdff-22bd-4e0e-86bf-36a6357b472b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:06:43,040::task::579::TaskManager.Task::(_updateState) Task=`780cfdff-22bd-4e0e-86bf-36a6357b472b`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:06:43,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:06:43,040::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:06:43,041::task::974::TaskManager.Task::(_decref) Task=`780cfdff-22bd-4e0e-86bf-36a6357b472b`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:06:43,047::task::579::TaskManager.Task::(_updateState) Task=`9ed171f4-a272-4b18-9906-35fff6466a95`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:06:43,048::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:06:43,048::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:06:43,048::task::1168::TaskManager.Task::(prepare) Task=`9ed171f4-a272-4b18-9906-35fff6466a95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:06:43,048::task::579::TaskManager.Task::(_updateState) Task=`9ed171f4-a272-4b18-9906-35fff6466a95`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:06:43,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:06:43,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:06:43,049::task::974::TaskManager.Task::(_decref) Task=`9ed171f4-a272-4b18-9906-35fff6466a95`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:06:43,579::task::579::TaskManager.Task::(_updateState) Task=`5e577061-55fe-467c-9e4f-6b8fcd1d98d7`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:06:43,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:06:43,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:06:43,580::task::1168::TaskManager.Task::(prepare) Task=`5e577061-55fe-467c-9e4f-6b8fcd1d98d7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:06:43,581::task::579::TaskManager.Task::(_updateState) Task=`5e577061-55fe-467c-9e4f-6b8fcd1d98d7`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:06:43,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:06:43,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:06:43,581::task::974::TaskManager.Task::(_decref) Task=`5e577061-55fe-467c-9e4f-6b8fcd1d98d7`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:06:43,654::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:06:43,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:06:43,669::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:06:43,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:43,672::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000259561 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:06:43,972::task::579::TaskManager.Task::(_updateState) Task=`b7970a7e-0fbe-4139-a065-25419f562481`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:06:43,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:06:43,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:06:43,973::task::1168::TaskManager.Task::(prepare) Task=`b7970a7e-0fbe-4139-a065-25419f562481`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:06:43,973::task::579::TaskManager.Task::(_updateState) Task=`b7970a7e-0fbe-4139-a065-25419f562481`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:06:43,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:06:43,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:06:43,973::task::974::TaskManager.Task::(_decref) Task=`b7970a7e-0fbe-4139-a065-25419f562481`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:44,436::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:44,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:06:44,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:06:44,673::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:06:44,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:06:44,997::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:06:45,014::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022754 s, 18.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:45,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:46,438::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:46,439::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:06:46,440::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:06:46,441::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:46,675::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:06:46,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:47,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:48,442::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:48,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:49,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:06:50,070::task::579::TaskManager.Task::(_updateState) Task=`79a9d980-2cac-4a56-b381-853889722286`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:06:50,070::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:06:50,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:06:50,071::task::1168::TaskManager.Task::(prepare) Task=`79a9d980-2cac-4a56-b381-853889722286`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:06:50,071::task::579::TaskManager.Task::(_updateState) Task=`79a9d980-2cac-4a56-b381-853889722286`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:06:50,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:06:50,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:06:50,071::task::974::TaskManager.Task::(_decref) Task=`79a9d980-2cac-4a56-b381-853889722286`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:06:50,071::task::579::TaskManager.Task::(_updateState) Task=`1ccc9773-10e6-4a95-9016-f5e8f02b586d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:06:50,072::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:06:50,072::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:06:50,072::task::1168::TaskManager.Task::(prepare) Task=`1ccc9773-10e6-4a95-9016-f5e8f02b586d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:06:50,072::task::579::TaskManager.Task::(_updateState) Task=`1ccc9773-10e6-4a95-9016-f5e8f02b586d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:06:50,072::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:06:50,072::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:06:50,073::task::974::TaskManager.Task::(_decref) Task=`1ccc9773-10e6-4a95-9016-f5e8f02b586d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:06:50,073::task::579::TaskManager.Task::(_updateState) Task=`acce612d-56cf-43f9-9ced-9c22033b5b6c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:06:50,073::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:06:50,073::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:06:50,073::task::1168::TaskManager.Task::(prepare) Task=`acce612d-56cf-43f9-9ced-9c22033b5b6c`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:06:50,074::task::579::TaskManager.Task::(_updateState) Task=`acce612d-56cf-43f9-9ced-9c22033b5b6c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:06:50,074::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:06:50,074::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:06:50,074::task::974::TaskManager.Task::(_decref) Task=`acce612d-56cf-43f9-9ced-9c22033b5b6c`::ref 0 aborting False >Thread-287553::DEBUG::2014-01-16 17:06:50,126::task::579::TaskManager.Task::(_updateState) Task=`5a5a0328-64d5-4823-8fed-1ba6761492c7`::moving from state init -> state preparing >Thread-287553::INFO::2014-01-16 17:06:50,126::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287553::INFO::2014-01-16 17:06:50,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259561', 'lastCheck': '6.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022754', 'lastCheck': '5.1', 'valid': True}} >Thread-287553::DEBUG::2014-01-16 17:06:50,127::task::1168::TaskManager.Task::(prepare) Task=`5a5a0328-64d5-4823-8fed-1ba6761492c7`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259561', 'lastCheck': '6.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022754', 'lastCheck': '5.1', 'valid': True}} >Thread-287553::DEBUG::2014-01-16 17:06:50,127::task::579::TaskManager.Task::(_updateState) Task=`5a5a0328-64d5-4823-8fed-1ba6761492c7`::moving from state preparing -> state finished >Thread-287553::DEBUG::2014-01-16 17:06:50,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287553::DEBUG::2014-01-16 17:06:50,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287553::DEBUG::2014-01-16 17:06:50,127::task::974::TaskManager.Task::(_decref) Task=`5a5a0328-64d5-4823-8fed-1ba6761492c7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:06:50,444::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:50,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:51,445::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:06:51,488::task::579::TaskManager.Task::(_updateState) Task=`6850ba4f-8be7-490d-997e-3a4831443249`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:06:51,488::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:06:51,488::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:06:51,489::task::1168::TaskManager.Task::(prepare) Task=`6850ba4f-8be7-490d-997e-3a4831443249`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:06:51,489::task::579::TaskManager.Task::(_updateState) Task=`6850ba4f-8be7-490d-997e-3a4831443249`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:06:51,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:06:51,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:06:51,489::task::974::TaskManager.Task::(_decref) Task=`6850ba4f-8be7-490d-997e-3a4831443249`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:51,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:52,446::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:52,681::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:06:52,681::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:53,679::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:06:53,697::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:06:53,699::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00027429 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:06:54,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:54,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:06:55,020::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:06:55,039::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000270721 s, 15.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:06:55,700::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:56,450::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:06:56,451::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 17:06:56,544::task::579::TaskManager.Task::(_updateState) Task=`bc574472-015d-4f24-a22a-28f7a81f974c`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:06:56,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:06:56,545::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:06:56,545::task::1168::TaskManager.Task::(prepare) Task=`bc574472-015d-4f24-a22a-28f7a81f974c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:06:56,545::task::579::TaskManager.Task::(_updateState) Task=`bc574472-015d-4f24-a22a-28f7a81f974c`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:06:56,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:06:56,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:06:56,546::task::974::TaskManager.Task::(_decref) Task=`bc574472-015d-4f24-a22a-28f7a81f974c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:06:56,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:57,702::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:06:57,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:06:57,703::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:06:58,453::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:06:58,704::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:06:58,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:06:59,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:06:59,706::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:06:59,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:00,454::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:00,706::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:07:00,706::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:01,457::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:07:01,458::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:07:01,459::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:01,707::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:07:01,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:02,460::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:02,709::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:07:02,954::task::579::TaskManager.Task::(_updateState) Task=`8b0475e1-0cb5-4083-802c-bda12b80a491`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:07:02,954::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:07:02,955::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:07:02,955::task::1168::TaskManager.Task::(prepare) Task=`8b0475e1-0cb5-4083-802c-bda12b80a491`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:07:02,955::task::579::TaskManager.Task::(_updateState) Task=`8b0475e1-0cb5-4083-802c-bda12b80a491`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:07:02,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:07:02,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:07:02,955::task::974::TaskManager.Task::(_decref) Task=`8b0475e1-0cb5-4083-802c-bda12b80a491`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:07:03,706::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:07:03,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:07:03,722::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:03,724::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000329681 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:07:04,461::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:04,724::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:07:04,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:07:05,045::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:07:05,063::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000220146 s, 18.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:07:05,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:07:05,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:07:05,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:07:05,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287559::DEBUG::2014-01-16 17:07:06,044::task::579::TaskManager.Task::(_updateState) Task=`e7ea6910-0277-4487-b625-41ae74c5918e`::moving from state init -> state preparing >Thread-287559::INFO::2014-01-16 17:07:06,044::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287559::INFO::2014-01-16 17:07:06,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000329681', 'lastCheck': '2.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000220146', 'lastCheck': '1.0', 'valid': True}} >Thread-287559::DEBUG::2014-01-16 17:07:06,045::task::1168::TaskManager.Task::(prepare) Task=`e7ea6910-0277-4487-b625-41ae74c5918e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000329681', 'lastCheck': '2.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000220146', 'lastCheck': '1.0', 'valid': True}} >Thread-287559::DEBUG::2014-01-16 17:07:06,045::task::579::TaskManager.Task::(_updateState) Task=`e7ea6910-0277-4487-b625-41ae74c5918e`::moving from state preparing -> state finished >Thread-287559::DEBUG::2014-01-16 17:07:06,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287559::DEBUG::2014-01-16 17:07:06,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287559::DEBUG::2014-01-16 17:07:06,046::task::974::TaskManager.Task::(_decref) Task=`e7ea6910-0277-4487-b625-41ae74c5918e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:06,463::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:06,464::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:06,727::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:07:06,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:07:06,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:07,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:07:07,729::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::DEBUG::2014-01-16 17:07:07,816::task::579::TaskManager.Task::(_updateState) Task=`6e553731-b752-4a52-999c-c58050eca023`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:07:07,816::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 17:07:07,817::task::579::TaskManager.Task::(_updateState) Task=`a251e771-3a6d-4832-9a2e-a9e214ffb785`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:07:07,817::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 17:07:07,817::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:07:07,818::task::1168::TaskManager.Task::(prepare) Task=`6e553731-b752-4a52-999c-c58050eca023`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::INFO::2014-01-16 17:07:07,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:07:07,818::task::579::TaskManager.Task::(_updateState) Task=`6e553731-b752-4a52-999c-c58050eca023`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:07:07,818::task::1168::TaskManager.Task::(prepare) Task=`a251e771-3a6d-4832-9a2e-a9e214ffb785`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:07:07,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:07:07,818::task::579::TaskManager.Task::(_updateState) Task=`a251e771-3a6d-4832-9a2e-a9e214ffb785`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:07:07,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:07:07,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:07:07,819::task::974::TaskManager.Task::(_decref) Task=`6e553731-b752-4a52-999c-c58050eca023`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:07:07,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:07:07,819::task::974::TaskManager.Task::(_decref) Task=`a251e771-3a6d-4832-9a2e-a9e214ffb785`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:08,465::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:08,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:07:08,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:07:08,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:07:08,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:07:09,662::task::579::TaskManager.Task::(_updateState) Task=`9805b69f-4a5a-4900-8f2b-646924ba0f59`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:07:09,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:07:09,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:07:09,663::task::1168::TaskManager.Task::(prepare) Task=`9805b69f-4a5a-4900-8f2b-646924ba0f59`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:07:09,663::task::579::TaskManager.Task::(_updateState) Task=`9805b69f-4a5a-4900-8f2b-646924ba0f59`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:07:09,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:07:09,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:07:09,663::task::974::TaskManager.Task::(_decref) Task=`9805b69f-4a5a-4900-8f2b-646924ba0f59`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:07:09,663::task::579::TaskManager.Task::(_updateState) Task=`848cb52c-2e40-47c9-beac-6287db7a1a21`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:07:09,664::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:07:09,664::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:07:09,664::task::1168::TaskManager.Task::(prepare) Task=`848cb52c-2e40-47c9-beac-6287db7a1a21`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:07:09,664::task::579::TaskManager.Task::(_updateState) Task=`848cb52c-2e40-47c9-beac-6287db7a1a21`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:07:09,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:07:09,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:07:09,665::task::974::TaskManager.Task::(_decref) Task=`848cb52c-2e40-47c9-beac-6287db7a1a21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:09,732::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:07:09,822::task::579::TaskManager.Task::(_updateState) Task=`e9885227-7546-4f15-9533-eaf6581a05f1`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:07:09,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:07:09,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:07:09,823::task::1168::TaskManager.Task::(prepare) Task=`e9885227-7546-4f15-9533-eaf6581a05f1`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:07:09,823::task::579::TaskManager.Task::(_updateState) Task=`e9885227-7546-4f15-9533-eaf6581a05f1`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:07:09,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:07:09,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:07:09,824::task::974::TaskManager.Task::(_decref) Task=`e9885227-7546-4f15-9533-eaf6581a05f1`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:07:09,824::task::579::TaskManager.Task::(_updateState) Task=`ad42f117-63d2-4de5-8578-bd45184983c4`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:07:09,824::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:07:09,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:07:09,824::task::1168::TaskManager.Task::(prepare) Task=`ad42f117-63d2-4de5-8578-bd45184983c4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:07:09,825::task::579::TaskManager.Task::(_updateState) Task=`ad42f117-63d2-4de5-8578-bd45184983c4`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:07:09,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:07:09,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:07:09,825::task::974::TaskManager.Task::(_decref) Task=`ad42f117-63d2-4de5-8578-bd45184983c4`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:07:10,102::task::579::TaskManager.Task::(_updateState) Task=`8fc02245-530b-433a-a6c9-4634bd6b5fdd`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:07:10,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:07:10,102::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:07:10,103::task::1168::TaskManager.Task::(prepare) Task=`8fc02245-530b-433a-a6c9-4634bd6b5fdd`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:07:10,103::task::579::TaskManager.Task::(_updateState) Task=`8fc02245-530b-433a-a6c9-4634bd6b5fdd`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:07:10,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:07:10,103::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:07:10,103::task::974::TaskManager.Task::(_decref) Task=`8fc02245-530b-433a-a6c9-4634bd6b5fdd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:10,466::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:10,733::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:07:10,733::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:07:10,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:07:10,734::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:10,734::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:07:10,734::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:07:11,468::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:11,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:12,469::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:12,737::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:07:12,737::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:07:12,737::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:13,732::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:07:13,747::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:07:13,748::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:07:13,749::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:13,751::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000309177 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:07:13,917::task::579::TaskManager.Task::(_updateState) Task=`5d35bc98-5331-43bd-b8f6-7a2ba8ea5e2b`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:07:13,917::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:07:13,918::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:07:13,918::task::1168::TaskManager.Task::(prepare) Task=`5d35bc98-5331-43bd-b8f6-7a2ba8ea5e2b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:07:13,918::task::579::TaskManager.Task::(_updateState) Task=`5d35bc98-5331-43bd-b8f6-7a2ba8ea5e2b`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:07:13,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:07:13,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:07:13,919::task::974::TaskManager.Task::(_decref) Task=`5d35bc98-5331-43bd-b8f6-7a2ba8ea5e2b`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:07:14,250::task::579::TaskManager.Task::(_updateState) Task=`e8a1db99-8632-42b5-bdb4-4631ea603a45`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:07:14,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:07:14,250::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:07:14,251::task::1168::TaskManager.Task::(prepare) Task=`e8a1db99-8632-42b5-bdb4-4631ea603a45`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:07:14,251::task::579::TaskManager.Task::(_updateState) Task=`e8a1db99-8632-42b5-bdb4-4631ea603a45`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:07:14,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:07:14,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:07:14,252::task::974::TaskManager.Task::(_decref) Task=`e8a1db99-8632-42b5-bdb4-4631ea603a45`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:14,470::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:14,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:07:14,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:07:14,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:07:14,752::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:07:15,069::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:07:15,087::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000353505 s, 11.6 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:07:15,380::task::579::TaskManager.Task::(_updateState) Task=`d69264bb-3179-4bcb-a79e-4b0b0aa2d8a0`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:07:15,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:07:15,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:07:15,381::task::1168::TaskManager.Task::(prepare) Task=`d69264bb-3179-4bcb-a79e-4b0b0aa2d8a0`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:07:15,381::task::579::TaskManager.Task::(_updateState) Task=`d69264bb-3179-4bcb-a79e-4b0b0aa2d8a0`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:07:15,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:07:15,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:07:15,382::task::974::TaskManager.Task::(_decref) Task=`d69264bb-3179-4bcb-a79e-4b0b0aa2d8a0`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:07:15,668::task::579::TaskManager.Task::(_updateState) Task=`a764b813-5a15-4e19-ac67-081ef0acb146`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:07:15,669::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:07:15,669::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:07:15,669::task::1168::TaskManager.Task::(prepare) Task=`a764b813-5a15-4e19-ac67-081ef0acb146`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:07:15,669::task::579::TaskManager.Task::(_updateState) Task=`a764b813-5a15-4e19-ac67-081ef0acb146`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:07:15,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:07:15,670::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:07:15,670::task::974::TaskManager.Task::(_decref) Task=`a764b813-5a15-4e19-ac67-081ef0acb146`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:07:15,670::task::579::TaskManager.Task::(_updateState) Task=`84b2a2c2-f5d0-4686-85e3-352b09207619`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:07:15,670::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:07:15,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:07:15,671::task::1168::TaskManager.Task::(prepare) Task=`84b2a2c2-f5d0-4686-85e3-352b09207619`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:07:15,671::task::579::TaskManager.Task::(_updateState) Task=`84b2a2c2-f5d0-4686-85e3-352b09207619`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:07:15,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:07:15,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:07:15,671::task::974::TaskManager.Task::(_decref) Task=`84b2a2c2-f5d0-4686-85e3-352b09207619`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:15,753::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:07:16,367::task::579::TaskManager.Task::(_updateState) Task=`65855638-4d9f-4270-8892-d1571a568e1f`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:07:16,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:07:16,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:07:16,368::task::1168::TaskManager.Task::(prepare) Task=`65855638-4d9f-4270-8892-d1571a568e1f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:07:16,368::task::579::TaskManager.Task::(_updateState) Task=`65855638-4d9f-4270-8892-d1571a568e1f`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:07:16,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:07:16,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:07:16,369::task::974::TaskManager.Task::(_decref) Task=`65855638-4d9f-4270-8892-d1571a568e1f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:16,472::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:16,472::task::579::TaskManager.Task::(_updateState) Task=`5b766e8e-6d59-49b4-babe-2ac73be32390`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:07:16,472::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:07:16,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:07:16,473::task::1168::TaskManager.Task::(prepare) Task=`5b766e8e-6d59-49b4-babe-2ac73be32390`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:07:16,473::task::579::TaskManager.Task::(_updateState) Task=`5b766e8e-6d59-49b4-babe-2ac73be32390`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:07:16,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:07:16,473::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:07:16,474::task::974::TaskManager.Task::(_decref) Task=`5b766e8e-6d59-49b4-babe-2ac73be32390`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:16,476::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:07:16,476::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:07:16,477::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:16,479::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:16,480::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:16,754::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:07:16,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:17,755::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:18,481::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:18,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:07:19,236::task::579::TaskManager.Task::(_updateState) Task=`97d5fed7-bf85-4a74-b8b7-4fdb31de6284`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:07:19,237::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:07:19,237::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:07:19,237::task::1168::TaskManager.Task::(prepare) Task=`97d5fed7-bf85-4a74-b8b7-4fdb31de6284`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:07:19,237::task::579::TaskManager.Task::(_updateState) Task=`97d5fed7-bf85-4a74-b8b7-4fdb31de6284`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:07:19,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:07:19,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:07:19,237::task::974::TaskManager.Task::(_decref) Task=`97d5fed7-bf85-4a74-b8b7-4fdb31de6284`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:07:19,238::task::579::TaskManager.Task::(_updateState) Task=`1fa0b4c3-7153-4bad-8dc3-1c857b288cbc`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:07:19,238::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:07:19,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:07:19,238::task::1168::TaskManager.Task::(prepare) Task=`1fa0b4c3-7153-4bad-8dc3-1c857b288cbc`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:07:19,238::task::579::TaskManager.Task::(_updateState) Task=`1fa0b4c3-7153-4bad-8dc3-1c857b288cbc`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:07:19,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:07:19,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:07:19,239::task::974::TaskManager.Task::(_decref) Task=`1fa0b4c3-7153-4bad-8dc3-1c857b288cbc`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:07:19,239::task::579::TaskManager.Task::(_updateState) Task=`747408e6-1f3e-4c9f-8614-089cfa65492a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:07:19,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:07:19,239::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:07:19,240::task::1168::TaskManager.Task::(prepare) Task=`747408e6-1f3e-4c9f-8614-089cfa65492a`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:07:19,240::task::579::TaskManager.Task::(_updateState) Task=`747408e6-1f3e-4c9f-8614-089cfa65492a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:07:19,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:07:19,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:07:19,240::task::974::TaskManager.Task::(_decref) Task=`747408e6-1f3e-4c9f-8614-089cfa65492a`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:07:19,336::task::579::TaskManager.Task::(_updateState) Task=`f52d40bd-f529-48a7-9017-6eae8566096f`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:07:19,336::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:07:19,337::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:07:19,337::task::1168::TaskManager.Task::(prepare) Task=`f52d40bd-f529-48a7-9017-6eae8566096f`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:07:19,337::task::579::TaskManager.Task::(_updateState) Task=`f52d40bd-f529-48a7-9017-6eae8566096f`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:07:19,337::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:07:19,337::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:07:19,338::task::974::TaskManager.Task::(_decref) Task=`f52d40bd-f529-48a7-9017-6eae8566096f`::ref 0 aborting False >Thread-227488::DEBUG::2014-01-16 17:07:19,732::task::579::TaskManager.Task::(_updateState) Task=`0fe88f32-2320-4845-b770-66d1322af659`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:07:19,733::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:07:19,733::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:07:19,733::task::1168::TaskManager.Task::(prepare) Task=`0fe88f32-2320-4845-b770-66d1322af659`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:07:19,733::task::579::TaskManager.Task::(_updateState) Task=`0fe88f32-2320-4845-b770-66d1322af659`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:07:19,733::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:07:19,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:07:19,734::task::974::TaskManager.Task::(_decref) Task=`0fe88f32-2320-4845-b770-66d1322af659`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:19,757::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:20,482::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:20,758::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:21,483::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:21,759::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287565::DEBUG::2014-01-16 17:07:21,898::task::579::TaskManager.Task::(_updateState) Task=`333d2c15-0ec7-4a50-8503-392accbc76f2`::moving from state init -> state preparing >Thread-287565::INFO::2014-01-16 17:07:21,898::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287565::INFO::2014-01-16 17:07:21,898::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309177', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353505', 'lastCheck': '6.8', 'valid': True}} >Thread-287565::DEBUG::2014-01-16 17:07:21,898::task::1168::TaskManager.Task::(prepare) Task=`333d2c15-0ec7-4a50-8503-392accbc76f2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000309177', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353505', 'lastCheck': '6.8', 'valid': True}} >Thread-287565::DEBUG::2014-01-16 17:07:21,898::task::579::TaskManager.Task::(_updateState) Task=`333d2c15-0ec7-4a50-8503-392accbc76f2`::moving from state preparing -> state finished >Thread-287565::DEBUG::2014-01-16 17:07:21,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287565::DEBUG::2014-01-16 17:07:21,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287565::DEBUG::2014-01-16 17:07:21,899::task::974::TaskManager.Task::(_decref) Task=`333d2c15-0ec7-4a50-8503-392accbc76f2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:22,484::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:22,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:07:22,760::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:07:23,110::task::579::TaskManager.Task::(_updateState) Task=`607fd88c-d43d-458f-8710-a408e7703107`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:07:23,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:07:23,111::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:07:23,111::task::1168::TaskManager.Task::(prepare) Task=`607fd88c-d43d-458f-8710-a408e7703107`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:07:23,111::task::579::TaskManager.Task::(_updateState) Task=`607fd88c-d43d-458f-8710-a408e7703107`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:07:23,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:07:23,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:07:23,111::task::974::TaskManager.Task::(_decref) Task=`607fd88c-d43d-458f-8710-a408e7703107`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:23,762::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:23,763::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:07:23,783::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000254855 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:07:24,486::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:24,764::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:07:25,096::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:07:25,117::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024488 s, 16.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:07:25,766::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:26,487::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:26,489::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:26,767::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:07:26,921::task::579::TaskManager.Task::(_updateState) Task=`3228d75e-9d24-42de-80a7-23e02dc35be4`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:07:26,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:07:26,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:07:26,923::task::1168::TaskManager.Task::(prepare) Task=`3228d75e-9d24-42de-80a7-23e02dc35be4`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:07:26,923::task::579::TaskManager.Task::(_updateState) Task=`3228d75e-9d24-42de-80a7-23e02dc35be4`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:07:26,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:07:26,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:07:26,923::task::974::TaskManager.Task::(_decref) Task=`3228d75e-9d24-42de-80a7-23e02dc35be4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:27,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:07:27,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:07:27,768::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:28,490::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:28,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:07:28,770::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:29,770::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:07:29,771::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:07:29,771::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:30,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:30,772::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:07:30,773::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:07:30,992::task::579::TaskManager.Task::(_updateState) Task=`3756d78b-bc30-475e-8af1-47640c941937`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:07:30,992::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:07:30,992::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:07:30,993::task::1168::TaskManager.Task::(prepare) Task=`3756d78b-bc30-475e-8af1-47640c941937`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:07:30,993::task::579::TaskManager.Task::(_updateState) Task=`3756d78b-bc30-475e-8af1-47640c941937`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:07:30,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:07:30,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:07:30,993::task::974::TaskManager.Task::(_decref) Task=`3756d78b-bc30-475e-8af1-47640c941937`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:31,493::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:07:31,493::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:07:31,495::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:31,774::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:07:31,774::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:32,497::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:32,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:33,777::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:07:33,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:33,790::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:07:33,806::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000303886 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:07:34,498::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:07:34,765::task::579::TaskManager.Task::(_updateState) Task=`a2090a8a-c88c-4948-9e8d-a7edf0e5e0e5`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:07:34,765::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:07:34,765::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:07:34,765::task::1168::TaskManager.Task::(prepare) Task=`a2090a8a-c88c-4948-9e8d-a7edf0e5e0e5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:07:34,766::task::579::TaskManager.Task::(_updateState) Task=`a2090a8a-c88c-4948-9e8d-a7edf0e5e0e5`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:07:34,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:07:34,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:07:34,766::task::974::TaskManager.Task::(_decref) Task=`a2090a8a-c88c-4948-9e8d-a7edf0e5e0e5`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:07:34,775::task::579::TaskManager.Task::(_updateState) Task=`a42c4752-b67f-4de4-a594-9f855d28c7a7`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:07:34,775::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:07:34,775::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:07:34,775::task::1168::TaskManager.Task::(prepare) Task=`a42c4752-b67f-4de4-a594-9f855d28c7a7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:07:34,776::task::579::TaskManager.Task::(_updateState) Task=`a42c4752-b67f-4de4-a594-9f855d28c7a7`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:07:34,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:07:34,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:07:34,776::task::974::TaskManager.Task::(_decref) Task=`a42c4752-b67f-4de4-a594-9f855d28c7a7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:34,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:07:34,778::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:07:35,125::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:07:35,142::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000197438 s, 20.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:07:35,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:07:35,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:07:35,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:07:35,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:07:36,367::task::579::TaskManager.Task::(_updateState) Task=`a7ddf8bf-6405-4660-87b4-206e865a89f0`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:07:36,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:07:36,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:07:36,368::task::1168::TaskManager.Task::(prepare) Task=`a7ddf8bf-6405-4660-87b4-206e865a89f0`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:07:36,368::task::579::TaskManager.Task::(_updateState) Task=`a7ddf8bf-6405-4660-87b4-206e865a89f0`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:07:36,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:07:36,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:07:36,369::task::974::TaskManager.Task::(_decref) Task=`a7ddf8bf-6405-4660-87b4-206e865a89f0`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:07:36,369::task::579::TaskManager.Task::(_updateState) Task=`63d558cf-5993-4336-ae25-10f0d34e3815`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:07:36,369::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:07:36,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:07:36,370::task::1168::TaskManager.Task::(prepare) Task=`63d558cf-5993-4336-ae25-10f0d34e3815`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:07:36,370::task::579::TaskManager.Task::(_updateState) Task=`63d558cf-5993-4336-ae25-10f0d34e3815`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:07:36,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:07:36,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:07:36,370::task::974::TaskManager.Task::(_decref) Task=`63d558cf-5993-4336-ae25-10f0d34e3815`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:36,499::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:36,500::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:36,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:07:36,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:07:36,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287571::DEBUG::2014-01-16 17:07:37,662::task::579::TaskManager.Task::(_updateState) Task=`bc19b145-a8d3-41d6-9052-f49c37ff1a3d`::moving from state init -> state preparing >Thread-287571::INFO::2014-01-16 17:07:37,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287571::INFO::2014-01-16 17:07:37,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303886', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000197438', 'lastCheck': '2.5', 'valid': True}} >Thread-287571::DEBUG::2014-01-16 17:07:37,663::task::1168::TaskManager.Task::(prepare) Task=`bc19b145-a8d3-41d6-9052-f49c37ff1a3d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303886', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000197438', 'lastCheck': '2.5', 'valid': True}} >Thread-287571::DEBUG::2014-01-16 17:07:37,663::task::579::TaskManager.Task::(_updateState) Task=`bc19b145-a8d3-41d6-9052-f49c37ff1a3d`::moving from state preparing -> state finished >Thread-287571::DEBUG::2014-01-16 17:07:37,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287571::DEBUG::2014-01-16 17:07:37,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287571::DEBUG::2014-01-16 17:07:37,663::task::974::TaskManager.Task::(_decref) Task=`bc19b145-a8d3-41d6-9052-f49c37ff1a3d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:37,782::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:07:37,782::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:38,501::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:38,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:07:38,784::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:07:38,784::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:07:38,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:39,785::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:07:39,834::task::579::TaskManager.Task::(_updateState) Task=`aa0a9218-22ce-4a2a-95fa-638a7b9e8929`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:07:39,834::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:07:39,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:07:39,834::task::1168::TaskManager.Task::(prepare) Task=`aa0a9218-22ce-4a2a-95fa-638a7b9e8929`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:07:39,834::task::579::TaskManager.Task::(_updateState) Task=`aa0a9218-22ce-4a2a-95fa-638a7b9e8929`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:07:39,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:07:39,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:07:39,835::task::974::TaskManager.Task::(_decref) Task=`aa0a9218-22ce-4a2a-95fa-638a7b9e8929`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:40,502::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:40,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:07:40,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:07:40,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:07:40,786::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:40,786::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:07:40,788::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:07:41,504::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:41,789::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:07:42,132::task::579::TaskManager.Task::(_updateState) Task=`835aaa44-a9de-402d-9f7c-ea9950e56007`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:07:42,133::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:07:42,133::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:07:42,133::task::1168::TaskManager.Task::(prepare) Task=`835aaa44-a9de-402d-9f7c-ea9950e56007`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:07:42,133::task::579::TaskManager.Task::(_updateState) Task=`835aaa44-a9de-402d-9f7c-ea9950e56007`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:07:42,133::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:07:42,133::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:07:42,134::task::974::TaskManager.Task::(_decref) Task=`835aaa44-a9de-402d-9f7c-ea9950e56007`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:42,505::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:42,790::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:07:42,790::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:07:42,790::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:07:43,034::task::579::TaskManager.Task::(_updateState) Task=`4e37665a-a1f5-470f-810c-f53eb9adbc3d`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:07:43,034::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:07:43,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:07:43,034::task::1168::TaskManager.Task::(prepare) Task=`4e37665a-a1f5-470f-810c-f53eb9adbc3d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:07:43,034::task::579::TaskManager.Task::(_updateState) Task=`4e37665a-a1f5-470f-810c-f53eb9adbc3d`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:07:43,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:07:43,035::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:07:43,035::task::974::TaskManager.Task::(_decref) Task=`4e37665a-a1f5-470f-810c-f53eb9adbc3d`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:07:43,208::task::579::TaskManager.Task::(_updateState) Task=`0b5817dc-16de-44a7-8daa-4bfd991a5224`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:07:43,208::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:07:43,209::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:07:43,209::task::1168::TaskManager.Task::(prepare) Task=`0b5817dc-16de-44a7-8daa-4bfd991a5224`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:07:43,209::task::579::TaskManager.Task::(_updateState) Task=`0b5817dc-16de-44a7-8daa-4bfd991a5224`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:07:43,209::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:07:43,209::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:07:43,209::task::974::TaskManager.Task::(_decref) Task=`0b5817dc-16de-44a7-8daa-4bfd991a5224`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:07:43,228::task::579::TaskManager.Task::(_updateState) Task=`d5e92f33-4aed-4c0b-8781-5528d105a040`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:07:43,228::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:07:43,228::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:07:43,228::task::1168::TaskManager.Task::(prepare) Task=`d5e92f33-4aed-4c0b-8781-5528d105a040`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:07:43,229::task::579::TaskManager.Task::(_updateState) Task=`d5e92f33-4aed-4c0b-8781-5528d105a040`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:07:43,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:07:43,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:07:43,229::task::974::TaskManager.Task::(_decref) Task=`d5e92f33-4aed-4c0b-8781-5528d105a040`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:07:43,751::task::579::TaskManager.Task::(_updateState) Task=`486c48a9-baa4-44a7-9796-564ec5dea67b`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:07:43,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:07:43,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:07:43,751::task::1168::TaskManager.Task::(prepare) Task=`486c48a9-baa4-44a7-9796-564ec5dea67b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:07:43,752::task::579::TaskManager.Task::(_updateState) Task=`486c48a9-baa4-44a7-9796-564ec5dea67b`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:07:43,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:07:43,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:07:43,752::task::974::TaskManager.Task::(_decref) Task=`486c48a9-baa4-44a7-9796-564ec5dea67b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:43,792::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:07:43,792::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:07:43,792::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:43,814::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:07:43,831::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286512 s, 1.3 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:07:44,147::task::579::TaskManager.Task::(_updateState) Task=`74566fb9-faa4-461a-8e3d-f3629a981817`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:07:44,148::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:07:44,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:07:44,148::task::1168::TaskManager.Task::(prepare) Task=`74566fb9-faa4-461a-8e3d-f3629a981817`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:07:44,148::task::579::TaskManager.Task::(_updateState) Task=`74566fb9-faa4-461a-8e3d-f3629a981817`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:07:44,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:07:44,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:07:44,149::task::974::TaskManager.Task::(_decref) Task=`74566fb9-faa4-461a-8e3d-f3629a981817`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:44,506::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:44,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:07:44,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:07:44,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:07:44,793::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:07:45,148::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:07:45,164::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000227915 s, 18.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:07:45,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:46,508::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:46,510::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:07:46,510::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:07:46,512::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:46,796::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:07:46,797::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:47,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:48,520::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:48,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:49,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:07:50,365::task::579::TaskManager.Task::(_updateState) Task=`7c4e219d-8c34-4103-98be-8cecca4e3668`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:07:50,366::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:07:50,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:07:50,366::task::1168::TaskManager.Task::(prepare) Task=`7c4e219d-8c34-4103-98be-8cecca4e3668`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:07:50,366::task::579::TaskManager.Task::(_updateState) Task=`7c4e219d-8c34-4103-98be-8cecca4e3668`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:07:50,367::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:07:50,367::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:07:50,367::task::974::TaskManager.Task::(_decref) Task=`7c4e219d-8c34-4103-98be-8cecca4e3668`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:07:50,367::task::579::TaskManager.Task::(_updateState) Task=`6164010a-c0c4-42f2-a9b5-cd1817fd5175`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:07:50,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:07:50,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:07:50,368::task::1168::TaskManager.Task::(prepare) Task=`6164010a-c0c4-42f2-a9b5-cd1817fd5175`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:07:50,368::task::579::TaskManager.Task::(_updateState) Task=`6164010a-c0c4-42f2-a9b5-cd1817fd5175`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:07:50,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:07:50,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:07:50,368::task::974::TaskManager.Task::(_decref) Task=`6164010a-c0c4-42f2-a9b5-cd1817fd5175`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:07:50,369::task::579::TaskManager.Task::(_updateState) Task=`4125b74c-d714-4bb9-a1e7-518cf9729646`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:07:50,369::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:07:50,369::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:07:50,369::task::1168::TaskManager.Task::(prepare) Task=`4125b74c-d714-4bb9-a1e7-518cf9729646`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:07:50,369::task::579::TaskManager.Task::(_updateState) Task=`4125b74c-d714-4bb9-a1e7-518cf9729646`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:07:50,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:07:50,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:07:50,370::task::974::TaskManager.Task::(_decref) Task=`4125b74c-d714-4bb9-a1e7-518cf9729646`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:07:50,521::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:50,801::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:51,522::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:07:51,661::task::579::TaskManager.Task::(_updateState) Task=`e0937fdc-c2d8-45b4-96b8-f445d08cfa1d`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:07:51,661::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:07:51,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:07:51,662::task::1168::TaskManager.Task::(prepare) Task=`e0937fdc-c2d8-45b4-96b8-f445d08cfa1d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:07:51,662::task::579::TaskManager.Task::(_updateState) Task=`e0937fdc-c2d8-45b4-96b8-f445d08cfa1d`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:07:51,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:07:51,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:07:51,662::task::974::TaskManager.Task::(_decref) Task=`e0937fdc-c2d8-45b4-96b8-f445d08cfa1d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:51,802::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:52,523::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:52,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:07:52,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287577::DEBUG::2014-01-16 17:07:53,397::task::579::TaskManager.Task::(_updateState) Task=`a6a01782-3a57-40ec-a22e-63abedf1ff6f`::moving from state init -> state preparing >Thread-287577::INFO::2014-01-16 17:07:53,397::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287577::INFO::2014-01-16 17:07:53,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286512', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000227915', 'lastCheck': '8.2', 'valid': True}} >Thread-287577::DEBUG::2014-01-16 17:07:53,398::task::1168::TaskManager.Task::(prepare) Task=`a6a01782-3a57-40ec-a22e-63abedf1ff6f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286512', 'lastCheck': '9.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000227915', 'lastCheck': '8.2', 'valid': True}} >Thread-287577::DEBUG::2014-01-16 17:07:53,398::task::579::TaskManager.Task::(_updateState) Task=`a6a01782-3a57-40ec-a22e-63abedf1ff6f`::moving from state preparing -> state finished >Thread-287577::DEBUG::2014-01-16 17:07:53,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287577::DEBUG::2014-01-16 17:07:53,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287577::DEBUG::2014-01-16 17:07:53,398::task::974::TaskManager.Task::(_decref) Task=`a6a01782-3a57-40ec-a22e-63abedf1ff6f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:53,805::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:07:53,839::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:07:53,855::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275268 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:07:54,525::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:54,806::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:07:55,170::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:07:55,186::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000256315 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:07:55,807::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:56,527::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:07:56,528::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 17:07:56,737::task::579::TaskManager.Task::(_updateState) Task=`aa930d2b-b97b-4657-bb6e-b25205339cec`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:07:56,737::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:07:56,738::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:07:56,738::task::1168::TaskManager.Task::(prepare) Task=`aa930d2b-b97b-4657-bb6e-b25205339cec`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:07:56,738::task::579::TaskManager.Task::(_updateState) Task=`aa930d2b-b97b-4657-bb6e-b25205339cec`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:07:56,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:07:56,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:07:56,738::task::974::TaskManager.Task::(_decref) Task=`aa930d2b-b97b-4657-bb6e-b25205339cec`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:07:56,808::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:57,810::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:07:57,810::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:07:57,810::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:07:58,530::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:07:58,812::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:07:58,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:07:59,813::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:07:59,814::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:07:59,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:00,531::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:00,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:08:00,815::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:01,532::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:08:01,533::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:08:01,534::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:01,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:08:01,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:02,535::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:02,817::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:08:03,119::task::579::TaskManager.Task::(_updateState) Task=`0a0778e5-12bf-4528-9c13-92d7bc7ded54`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:08:03,120::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:08:03,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:08:03,120::task::1168::TaskManager.Task::(prepare) Task=`0a0778e5-12bf-4528-9c13-92d7bc7ded54`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:08:03,120::task::579::TaskManager.Task::(_updateState) Task=`0a0778e5-12bf-4528-9c13-92d7bc7ded54`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:08:03,120::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:08:03,120::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:08:03,121::task::974::TaskManager.Task::(_decref) Task=`0a0778e5-12bf-4528-9c13-92d7bc7ded54`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:03,818::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:08:03,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:08:03,862::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:08:03,879::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000372424 s, 980 kB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:08:04,536::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:04,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:08:04,821::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:08:05,192::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:08:05,209::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000246663 s, 16.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:08:05,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:08:05,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:08:05,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:08:05,823::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:06,538::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:06,539::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:06,824::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:08:06,824::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:08:06,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:07,826::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:08:07,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:08:07,928::task::579::TaskManager.Task::(_updateState) Task=`ea0d15d5-9b5e-47f7-8b09-ad0750a8438e`::moving from state init -> state preparing >Thread-251782::DEBUG::2014-01-16 17:08:07,929::task::579::TaskManager.Task::(_updateState) Task=`1cd83664-5292-4ac2-ad3e-b62f07a9e345`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:08:07,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-251782::INFO::2014-01-16 17:08:07,930::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::INFO::2014-01-16 17:08:07,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 17:08:07,931::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:08:07,932::task::1168::TaskManager.Task::(prepare) Task=`ea0d15d5-9b5e-47f7-8b09-ad0750a8438e`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:08:07,932::task::1168::TaskManager.Task::(prepare) Task=`1cd83664-5292-4ac2-ad3e-b62f07a9e345`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:08:07,932::task::579::TaskManager.Task::(_updateState) Task=`ea0d15d5-9b5e-47f7-8b09-ad0750a8438e`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:08:07,933::task::579::TaskManager.Task::(_updateState) Task=`1cd83664-5292-4ac2-ad3e-b62f07a9e345`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:08:07,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:08:07,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:08:07,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:08:07,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:08:07,934::task::974::TaskManager.Task::(_decref) Task=`ea0d15d5-9b5e-47f7-8b09-ad0750a8438e`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:08:07,935::task::974::TaskManager.Task::(_decref) Task=`1cd83664-5292-4ac2-ad3e-b62f07a9e345`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:08,540::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:08,827::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:08:08,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:08:08,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:08:08,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287583::DEBUG::2014-01-16 17:08:09,566::task::579::TaskManager.Task::(_updateState) Task=`e8365c98-17d1-40fe-aedf-d3343ed61367`::moving from state init -> state preparing >Thread-287583::INFO::2014-01-16 17:08:09,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287583::INFO::2014-01-16 17:08:09,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372424', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246663', 'lastCheck': '4.4', 'valid': True}} >Thread-287583::DEBUG::2014-01-16 17:08:09,567::task::1168::TaskManager.Task::(prepare) Task=`e8365c98-17d1-40fe-aedf-d3343ed61367`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372424', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246663', 'lastCheck': '4.4', 'valid': True}} >Thread-287583::DEBUG::2014-01-16 17:08:09,567::task::579::TaskManager.Task::(_updateState) Task=`e8365c98-17d1-40fe-aedf-d3343ed61367`::moving from state preparing -> state finished >Thread-287583::DEBUG::2014-01-16 17:08:09,567::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287583::DEBUG::2014-01-16 17:08:09,567::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287583::DEBUG::2014-01-16 17:08:09,568::task::974::TaskManager.Task::(_decref) Task=`e8365c98-17d1-40fe-aedf-d3343ed61367`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:08:09,753::task::579::TaskManager.Task::(_updateState) Task=`9cd27051-2c34-4f66-999b-83f8a94f6138`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:08:09,753::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:08:09,754::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:08:09,754::task::1168::TaskManager.Task::(prepare) Task=`9cd27051-2c34-4f66-999b-83f8a94f6138`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:08:09,754::task::579::TaskManager.Task::(_updateState) Task=`9cd27051-2c34-4f66-999b-83f8a94f6138`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:08:09,754::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:08:09,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:08:09,755::task::974::TaskManager.Task::(_decref) Task=`9cd27051-2c34-4f66-999b-83f8a94f6138`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:08:09,755::task::579::TaskManager.Task::(_updateState) Task=`2dbe9f5b-6fb5-4ef8-8457-fe60cfc1c792`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:08:09,755::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:08:09,755::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:08:09,755::task::1168::TaskManager.Task::(prepare) Task=`2dbe9f5b-6fb5-4ef8-8457-fe60cfc1c792`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:08:09,756::task::579::TaskManager.Task::(_updateState) Task=`2dbe9f5b-6fb5-4ef8-8457-fe60cfc1c792`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:08:09,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:08:09,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:08:09,756::task::974::TaskManager.Task::(_decref) Task=`2dbe9f5b-6fb5-4ef8-8457-fe60cfc1c792`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:09,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:08:10,060::task::579::TaskManager.Task::(_updateState) Task=`647f55b0-cffa-43b7-9802-5493ebec2ff8`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:08:10,061::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:08:10,061::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:08:10,061::task::1168::TaskManager.Task::(prepare) Task=`647f55b0-cffa-43b7-9802-5493ebec2ff8`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:08:10,062::task::579::TaskManager.Task::(_updateState) Task=`647f55b0-cffa-43b7-9802-5493ebec2ff8`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:08:10,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:08:10,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:08:10,062::task::974::TaskManager.Task::(_decref) Task=`647f55b0-cffa-43b7-9802-5493ebec2ff8`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:08:10,062::task::579::TaskManager.Task::(_updateState) Task=`ed6055b3-68c8-43a4-8ecb-6f6d4f275c2c`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:08:10,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:08:10,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:08:10,063::task::1168::TaskManager.Task::(prepare) Task=`ed6055b3-68c8-43a4-8ecb-6f6d4f275c2c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:08:10,063::task::579::TaskManager.Task::(_updateState) Task=`ed6055b3-68c8-43a4-8ecb-6f6d4f275c2c`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:08:10,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:08:10,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:08:10,063::task::974::TaskManager.Task::(_decref) Task=`ed6055b3-68c8-43a4-8ecb-6f6d4f275c2c`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:08:10,273::task::579::TaskManager.Task::(_updateState) Task=`a043f286-907e-4071-b8f0-98bf03338f30`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:08:10,274::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:08:10,274::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:08:10,274::task::1168::TaskManager.Task::(prepare) Task=`a043f286-907e-4071-b8f0-98bf03338f30`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:08:10,274::task::579::TaskManager.Task::(_updateState) Task=`a043f286-907e-4071-b8f0-98bf03338f30`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:08:10,274::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:08:10,274::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:08:10,275::task::974::TaskManager.Task::(_decref) Task=`a043f286-907e-4071-b8f0-98bf03338f30`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:10,541::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:10,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:08:10,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:08:10,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:08:10,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:10,831::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:08:10,832::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:08:11,542::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:11,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:12,543::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:12,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:08:12,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:08:12,835::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:13,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:08:13,836::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:08:13,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:08:13,887::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:08:13,904::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000383808 s, 951 kB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:08:14,060::task::579::TaskManager.Task::(_updateState) Task=`f9d1ff6d-4ee1-4267-a85c-441368561e4b`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:08:14,060::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:08:14,061::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:08:14,061::task::1168::TaskManager.Task::(prepare) Task=`f9d1ff6d-4ee1-4267-a85c-441368561e4b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:08:14,061::task::579::TaskManager.Task::(_updateState) Task=`f9d1ff6d-4ee1-4267-a85c-441368561e4b`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:08:14,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:08:14,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:08:14,062::task::974::TaskManager.Task::(_decref) Task=`f9d1ff6d-4ee1-4267-a85c-441368561e4b`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:08:14,423::task::579::TaskManager.Task::(_updateState) Task=`88c4b771-ec6f-48f8-b382-b7ae4851d50c`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:08:14,423::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:08:14,423::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:08:14,424::task::1168::TaskManager.Task::(prepare) Task=`88c4b771-ec6f-48f8-b382-b7ae4851d50c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:08:14,424::task::579::TaskManager.Task::(_updateState) Task=`88c4b771-ec6f-48f8-b382-b7ae4851d50c`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:08:14,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:08:14,424::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:08:14,424::task::974::TaskManager.Task::(_decref) Task=`88c4b771-ec6f-48f8-b382-b7ae4851d50c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:14,545::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:14,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:08:14,838::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:08:14,838::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:08:14,838::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:08:15,215::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:08:15,231::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000253979 s, 16.1 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:08:15,552::task::579::TaskManager.Task::(_updateState) Task=`2afb15fd-e5e4-49a0-96b1-eebd86c36f2e`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:08:15,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:08:15,553::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:08:15,553::task::1168::TaskManager.Task::(prepare) Task=`2afb15fd-e5e4-49a0-96b1-eebd86c36f2e`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:08:15,553::task::579::TaskManager.Task::(_updateState) Task=`2afb15fd-e5e4-49a0-96b1-eebd86c36f2e`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:08:15,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:08:15,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:08:15,553::task::974::TaskManager.Task::(_decref) Task=`2afb15fd-e5e4-49a0-96b1-eebd86c36f2e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:15,839::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:08:15,889::task::579::TaskManager.Task::(_updateState) Task=`c395eb84-1554-4450-aa65-ede8add64d40`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:08:15,889::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:08:15,890::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:08:15,890::task::1168::TaskManager.Task::(prepare) Task=`c395eb84-1554-4450-aa65-ede8add64d40`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:08:15,890::task::579::TaskManager.Task::(_updateState) Task=`c395eb84-1554-4450-aa65-ede8add64d40`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:08:15,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:08:15,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:08:15,890::task::974::TaskManager.Task::(_decref) Task=`c395eb84-1554-4450-aa65-ede8add64d40`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:08:15,891::task::579::TaskManager.Task::(_updateState) Task=`57fe0c48-1d03-48dd-a035-df14160ee37c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:08:15,892::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:08:15,892::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:08:15,892::task::1168::TaskManager.Task::(prepare) Task=`57fe0c48-1d03-48dd-a035-df14160ee37c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:08:15,892::task::579::TaskManager.Task::(_updateState) Task=`57fe0c48-1d03-48dd-a035-df14160ee37c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:08:15,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:08:15,892::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:08:15,893::task::974::TaskManager.Task::(_decref) Task=`57fe0c48-1d03-48dd-a035-df14160ee37c`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 17:08:16,541::task::579::TaskManager.Task::(_updateState) Task=`9fffe072-a465-4b25-b6d3-f1f31bf7f6c0`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:08:16,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:08:16,542::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:08:16,542::task::1168::TaskManager.Task::(prepare) Task=`9fffe072-a465-4b25-b6d3-f1f31bf7f6c0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:08:16,542::task::579::TaskManager.Task::(_updateState) Task=`9fffe072-a465-4b25-b6d3-f1f31bf7f6c0`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:08:16,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:08:16,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:08:16,542::task::974::TaskManager.Task::(_decref) Task=`9fffe072-a465-4b25-b6d3-f1f31bf7f6c0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:16,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:16,548::task::579::TaskManager.Task::(_updateState) Task=`d1677d0a-b98a-4a25-acaa-e96ca0969c8c`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:08:16,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:08:16,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:08:16,549::task::1168::TaskManager.Task::(prepare) Task=`d1677d0a-b98a-4a25-acaa-e96ca0969c8c`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:08:16,549::task::579::TaskManager.Task::(_updateState) Task=`d1677d0a-b98a-4a25-acaa-e96ca0969c8c`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:08:16,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:08:16,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:08:16,550::task::974::TaskManager.Task::(_decref) Task=`d1677d0a-b98a-4a25-acaa-e96ca0969c8c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:16,553::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:08:16,553::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:08:16,555::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:16,557::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:16,558::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:16,840::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:08:16,841::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:17,841::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:18,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:18,843::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:08:19,414::task::579::TaskManager.Task::(_updateState) Task=`b25721a2-cf47-473a-97f3-efc8aea88476`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:08:19,414::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:08:19,415::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:08:19,415::task::1168::TaskManager.Task::(prepare) Task=`b25721a2-cf47-473a-97f3-efc8aea88476`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:08:19,416::task::579::TaskManager.Task::(_updateState) Task=`b25721a2-cf47-473a-97f3-efc8aea88476`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:08:19,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:08:19,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:08:19,416::task::974::TaskManager.Task::(_decref) Task=`b25721a2-cf47-473a-97f3-efc8aea88476`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:08:19,801::task::579::TaskManager.Task::(_updateState) Task=`951c0751-86c7-4a05-afb6-6e20f2eb1cdf`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:08:19,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:08:19,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:08:19,802::task::1168::TaskManager.Task::(prepare) Task=`951c0751-86c7-4a05-afb6-6e20f2eb1cdf`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:08:19,802::task::579::TaskManager.Task::(_updateState) Task=`951c0751-86c7-4a05-afb6-6e20f2eb1cdf`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:08:19,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:08:19,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:08:19,802::task::974::TaskManager.Task::(_decref) Task=`951c0751-86c7-4a05-afb6-6e20f2eb1cdf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:08:19,802::task::579::TaskManager.Task::(_updateState) Task=`49d21133-2bf1-47e0-b4b1-f3370c3dc2e3`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:08:19,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:08:19,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:08:19,803::task::1168::TaskManager.Task::(prepare) Task=`49d21133-2bf1-47e0-b4b1-f3370c3dc2e3`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:08:19,803::task::579::TaskManager.Task::(_updateState) Task=`49d21133-2bf1-47e0-b4b1-f3370c3dc2e3`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:08:19,803::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:08:19,803::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:08:19,803::task::974::TaskManager.Task::(_decref) Task=`49d21133-2bf1-47e0-b4b1-f3370c3dc2e3`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:08:19,804::task::579::TaskManager.Task::(_updateState) Task=`a6c16938-a911-4808-b254-36a5bdf3b8de`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:08:19,804::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:08:19,804::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:08:19,804::task::1168::TaskManager.Task::(prepare) Task=`a6c16938-a911-4808-b254-36a5bdf3b8de`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:08:19,804::task::579::TaskManager.Task::(_updateState) Task=`a6c16938-a911-4808-b254-36a5bdf3b8de`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:08:19,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:08:19,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:08:19,805::task::974::TaskManager.Task::(_decref) Task=`a6c16938-a911-4808-b254-36a5bdf3b8de`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:19,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:08:19,922::task::579::TaskManager.Task::(_updateState) Task=`1fe65a44-5681-494f-97e8-4b7bb1a0c794`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:08:19,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:08:19,922::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:08:19,922::task::1168::TaskManager.Task::(prepare) Task=`1fe65a44-5681-494f-97e8-4b7bb1a0c794`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:08:19,923::task::579::TaskManager.Task::(_updateState) Task=`1fe65a44-5681-494f-97e8-4b7bb1a0c794`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:08:19,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:08:19,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:08:19,923::task::974::TaskManager.Task::(_decref) Task=`1fe65a44-5681-494f-97e8-4b7bb1a0c794`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:20,561::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:20,845::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:21,562::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:21,846::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:22,564::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:22,846::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:08:22,847::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:08:23,276::task::579::TaskManager.Task::(_updateState) Task=`78e54734-8c0b-4ab7-8c58-39ef00b445bd`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:08:23,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:08:23,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:08:23,277::task::1168::TaskManager.Task::(prepare) Task=`78e54734-8c0b-4ab7-8c58-39ef00b445bd`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:08:23,278::task::579::TaskManager.Task::(_updateState) Task=`78e54734-8c0b-4ab7-8c58-39ef00b445bd`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:08:23,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:08:23,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:08:23,278::task::974::TaskManager.Task::(_decref) Task=`78e54734-8c0b-4ab7-8c58-39ef00b445bd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:23,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:08:23,912::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:08:23,928::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00027552 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:08:24,565::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:24,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:08:25,237::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:08:25,254::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268161 s, 15.3 MB/s\n'; <rc> = 0 >Thread-287589::DEBUG::2014-01-16 17:08:25,292::task::579::TaskManager.Task::(_updateState) Task=`62c2d2d9-f30d-4d77-b958-7f724c38e425`::moving from state init -> state preparing >Thread-287589::INFO::2014-01-16 17:08:25,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287589::INFO::2014-01-16 17:08:25,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027552', 'lastCheck': '1.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268161', 'lastCheck': '0.0', 'valid': True}} >Thread-287589::DEBUG::2014-01-16 17:08:25,293::task::1168::TaskManager.Task::(prepare) Task=`62c2d2d9-f30d-4d77-b958-7f724c38e425`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027552', 'lastCheck': '1.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268161', 'lastCheck': '0.0', 'valid': True}} >Thread-287589::DEBUG::2014-01-16 17:08:25,294::task::579::TaskManager.Task::(_updateState) Task=`62c2d2d9-f30d-4d77-b958-7f724c38e425`::moving from state preparing -> state finished >Thread-287589::DEBUG::2014-01-16 17:08:25,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287589::DEBUG::2014-01-16 17:08:25,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287589::DEBUG::2014-01-16 17:08:25,294::task::974::TaskManager.Task::(_decref) Task=`62c2d2d9-f30d-4d77-b958-7f724c38e425`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:25,850::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:26,567::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:26,568::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:26,851::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:08:26,987::task::579::TaskManager.Task::(_updateState) Task=`94f2f527-9264-4e5a-9d00-5bc4d1e5c7d4`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:08:26,987::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:08:26,987::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:08:26,987::task::1168::TaskManager.Task::(prepare) Task=`94f2f527-9264-4e5a-9d00-5bc4d1e5c7d4`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:08:26,988::task::579::TaskManager.Task::(_updateState) Task=`94f2f527-9264-4e5a-9d00-5bc4d1e5c7d4`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:08:26,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:08:26,988::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:08:26,988::task::974::TaskManager.Task::(_decref) Task=`94f2f527-9264-4e5a-9d00-5bc4d1e5c7d4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:27,852::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:08:27,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:08:27,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:28,569::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:28,853::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:08:28,854::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:29,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:08:29,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:08:29,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:30,570::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:30,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:08:30,857::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:08:31,169::task::579::TaskManager.Task::(_updateState) Task=`907948c3-96b7-4894-8fdc-21752b62ae41`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:08:31,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:08:31,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:08:31,170::task::1168::TaskManager.Task::(prepare) Task=`907948c3-96b7-4894-8fdc-21752b62ae41`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:08:31,170::task::579::TaskManager.Task::(_updateState) Task=`907948c3-96b7-4894-8fdc-21752b62ae41`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:08:31,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:08:31,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:08:31,171::task::974::TaskManager.Task::(_decref) Task=`907948c3-96b7-4894-8fdc-21752b62ae41`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:31,573::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:08:31,574::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:08:31,575::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:31,858::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:08:31,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:32,576::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:32,859::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:33,861::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:08:33,861::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:08:33,935::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:08:33,952::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000283679 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:08:34,577::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:34,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:08:34,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:08:34,929::task::579::TaskManager.Task::(_updateState) Task=`8bde9c1d-2cb9-456c-a58e-58bf795119c0`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:08:34,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:08:34,930::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:08:34,930::task::1168::TaskManager.Task::(prepare) Task=`8bde9c1d-2cb9-456c-a58e-58bf795119c0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:08:34,930::task::579::TaskManager.Task::(_updateState) Task=`8bde9c1d-2cb9-456c-a58e-58bf795119c0`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:08:34,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:08:34,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:08:34,930::task::974::TaskManager.Task::(_decref) Task=`8bde9c1d-2cb9-456c-a58e-58bf795119c0`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:08:34,936::task::579::TaskManager.Task::(_updateState) Task=`a6305ac4-596a-4b72-8aa3-81a80af5fbee`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:08:34,936::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:08:34,936::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:08:34,936::task::1168::TaskManager.Task::(prepare) Task=`a6305ac4-596a-4b72-8aa3-81a80af5fbee`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:08:34,936::task::579::TaskManager.Task::(_updateState) Task=`a6305ac4-596a-4b72-8aa3-81a80af5fbee`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:08:34,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:08:34,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:08:34,937::task::974::TaskManager.Task::(_decref) Task=`a6305ac4-596a-4b72-8aa3-81a80af5fbee`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:08:35,260::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:08:35,276::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000271772 s, 15.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:08:35,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:08:35,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:08:35,863::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:08:35,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:36,579::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:36,580::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:08:36,745::task::579::TaskManager.Task::(_updateState) Task=`3b92adef-119f-4391-8c07-c4470a39f887`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:08:36,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:08:36,746::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:08:36,746::task::1168::TaskManager.Task::(prepare) Task=`3b92adef-119f-4391-8c07-c4470a39f887`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:08:36,746::task::579::TaskManager.Task::(_updateState) Task=`3b92adef-119f-4391-8c07-c4470a39f887`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:08:36,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:08:36,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:08:36,746::task::974::TaskManager.Task::(_decref) Task=`3b92adef-119f-4391-8c07-c4470a39f887`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:08:36,747::task::579::TaskManager.Task::(_updateState) Task=`128dfc87-b11b-40f8-be96-91daeba24d8e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:08:36,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:08:36,747::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:08:36,747::task::1168::TaskManager.Task::(prepare) Task=`128dfc87-b11b-40f8-be96-91daeba24d8e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:08:36,747::task::579::TaskManager.Task::(_updateState) Task=`128dfc87-b11b-40f8-be96-91daeba24d8e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:08:36,747::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:08:36,747::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:08:36,748::task::974::TaskManager.Task::(_decref) Task=`128dfc87-b11b-40f8-be96-91daeba24d8e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:36,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:08:36,865::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:08:36,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:37,866::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:08:37,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:38,582::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:38,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:08:38,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:08:38,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:08:38,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:39,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:08:40,003::task::579::TaskManager.Task::(_updateState) Task=`32d3be9d-4553-44d2-8af5-b4fc6ce25300`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:08:40,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:08:40,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:08:40,005::task::1168::TaskManager.Task::(prepare) Task=`32d3be9d-4553-44d2-8af5-b4fc6ce25300`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:08:40,005::task::579::TaskManager.Task::(_updateState) Task=`32d3be9d-4553-44d2-8af5-b4fc6ce25300`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:08:40,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:08:40,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:08:40,005::task::974::TaskManager.Task::(_decref) Task=`32d3be9d-4553-44d2-8af5-b4fc6ce25300`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:40,583::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:40,870::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:08:40,870::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:08:40,870::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:08:40,870::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:40,871::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:08:40,871::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-287595::DEBUG::2014-01-16 17:08:41,276::task::579::TaskManager.Task::(_updateState) Task=`010f5462-fc4c-4de9-b380-dc3a01312350`::moving from state init -> state preparing >Thread-287595::INFO::2014-01-16 17:08:41,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287595::INFO::2014-01-16 17:08:41,277::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283679', 'lastCheck': '7.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271772', 'lastCheck': '6.0', 'valid': True}} >Thread-287595::DEBUG::2014-01-16 17:08:41,277::task::1168::TaskManager.Task::(prepare) Task=`010f5462-fc4c-4de9-b380-dc3a01312350`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283679', 'lastCheck': '7.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271772', 'lastCheck': '6.0', 'valid': True}} >Thread-287595::DEBUG::2014-01-16 17:08:41,277::task::579::TaskManager.Task::(_updateState) Task=`010f5462-fc4c-4de9-b380-dc3a01312350`::moving from state preparing -> state finished >Thread-287595::DEBUG::2014-01-16 17:08:41,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287595::DEBUG::2014-01-16 17:08:41,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287595::DEBUG::2014-01-16 17:08:41,277::task::974::TaskManager.Task::(_decref) Task=`010f5462-fc4c-4de9-b380-dc3a01312350`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:41,585::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:41,871::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:08:42,294::task::579::TaskManager.Task::(_updateState) Task=`e97e2c43-f1d6-4024-b701-e0220a0d8e47`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:08:42,294::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:08:42,295::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:08:42,295::task::1168::TaskManager.Task::(prepare) Task=`e97e2c43-f1d6-4024-b701-e0220a0d8e47`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:08:42,295::task::579::TaskManager.Task::(_updateState) Task=`e97e2c43-f1d6-4024-b701-e0220a0d8e47`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:08:42,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:08:42,295::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:08:42,295::task::974::TaskManager.Task::(_decref) Task=`e97e2c43-f1d6-4024-b701-e0220a0d8e47`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:42,586::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:42,873::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:08:42,873::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:08:42,873::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:08:43,199::task::579::TaskManager.Task::(_updateState) Task=`ceb94bdb-728e-4866-a4ba-d6ad033ed6a9`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:08:43,199::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:08:43,199::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:08:43,200::task::1168::TaskManager.Task::(prepare) Task=`ceb94bdb-728e-4866-a4ba-d6ad033ed6a9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:08:43,200::task::579::TaskManager.Task::(_updateState) Task=`ceb94bdb-728e-4866-a4ba-d6ad033ed6a9`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:08:43,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:08:43,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:08:43,200::task::974::TaskManager.Task::(_decref) Task=`ceb94bdb-728e-4866-a4ba-d6ad033ed6a9`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:08:43,368::task::579::TaskManager.Task::(_updateState) Task=`3535ad80-cdce-4daf-ad7d-26a747f5eb18`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:08:43,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:08:43,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:08:43,368::task::1168::TaskManager.Task::(prepare) Task=`3535ad80-cdce-4daf-ad7d-26a747f5eb18`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:08:43,369::task::579::TaskManager.Task::(_updateState) Task=`3535ad80-cdce-4daf-ad7d-26a747f5eb18`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:08:43,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:08:43,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:08:43,369::task::974::TaskManager.Task::(_decref) Task=`3535ad80-cdce-4daf-ad7d-26a747f5eb18`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:08:43,386::task::579::TaskManager.Task::(_updateState) Task=`1a53e883-b494-4c1c-b2ef-72a4557e6c5a`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:08:43,386::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:08:43,387::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:08:43,387::task::1168::TaskManager.Task::(prepare) Task=`1a53e883-b494-4c1c-b2ef-72a4557e6c5a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:08:43,387::task::579::TaskManager.Task::(_updateState) Task=`1a53e883-b494-4c1c-b2ef-72a4557e6c5a`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:08:43,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:08:43,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:08:43,387::task::974::TaskManager.Task::(_decref) Task=`1a53e883-b494-4c1c-b2ef-72a4557e6c5a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:43,874::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:08:43,874::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:08:43,875::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:08:43,912::task::579::TaskManager.Task::(_updateState) Task=`d1d7de9f-0a44-4579-b27c-f5f9fce92e3a`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:08:43,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:08:43,913::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:08:43,913::task::1168::TaskManager.Task::(prepare) Task=`d1d7de9f-0a44-4579-b27c-f5f9fce92e3a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:08:43,913::task::579::TaskManager.Task::(_updateState) Task=`d1d7de9f-0a44-4579-b27c-f5f9fce92e3a`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:08:43,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:08:43,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:08:43,914::task::974::TaskManager.Task::(_decref) Task=`d1d7de9f-0a44-4579-b27c-f5f9fce92e3a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:08:43,959::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:08:43,976::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279343 s, 1.3 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:08:44,305::task::579::TaskManager.Task::(_updateState) Task=`ac738de9-2d9b-418f-895b-2dce87adb93d`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:08:44,305::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:08:44,305::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:08:44,305::task::1168::TaskManager.Task::(prepare) Task=`ac738de9-2d9b-418f-895b-2dce87adb93d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:08:44,306::task::579::TaskManager.Task::(_updateState) Task=`ac738de9-2d9b-418f-895b-2dce87adb93d`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:08:44,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:08:44,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:08:44,306::task::974::TaskManager.Task::(_decref) Task=`ac738de9-2d9b-418f-895b-2dce87adb93d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:08:44,588::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:44,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:08:44,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:08:44,876::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:08:44,876::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:08:45,281::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:08:45,299::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000250461 s, 16.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:08:45,877::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:46,589::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:46,591::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:08:46,591::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:08:46,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:46,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:08:46,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:47,880::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:48,593::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:48,881::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:49,881::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:50,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:08:50,661::task::579::TaskManager.Task::(_updateState) Task=`d03ad9aa-2a6c-4b0e-bd2b-5c15f4ccc9e5`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:08:50,662::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:08:50,662::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:08:50,662::task::1168::TaskManager.Task::(prepare) Task=`d03ad9aa-2a6c-4b0e-bd2b-5c15f4ccc9e5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:08:50,662::task::579::TaskManager.Task::(_updateState) Task=`d03ad9aa-2a6c-4b0e-bd2b-5c15f4ccc9e5`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:08:50,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:08:50,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:08:50,663::task::974::TaskManager.Task::(_decref) Task=`d03ad9aa-2a6c-4b0e-bd2b-5c15f4ccc9e5`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:08:50,663::task::579::TaskManager.Task::(_updateState) Task=`dde95822-cd1d-4cc7-9153-ee1fa7c5b487`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:08:50,663::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:08:50,664::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:08:50,664::task::1168::TaskManager.Task::(prepare) Task=`dde95822-cd1d-4cc7-9153-ee1fa7c5b487`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:08:50,664::task::579::TaskManager.Task::(_updateState) Task=`dde95822-cd1d-4cc7-9153-ee1fa7c5b487`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:08:50,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:08:50,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:08:50,664::task::974::TaskManager.Task::(_decref) Task=`dde95822-cd1d-4cc7-9153-ee1fa7c5b487`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:08:50,664::task::579::TaskManager.Task::(_updateState) Task=`63b102f5-b658-4586-b44c-b54244b58a26`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:08:50,665::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:08:50,665::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:08:50,665::task::1168::TaskManager.Task::(prepare) Task=`63b102f5-b658-4586-b44c-b54244b58a26`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:08:50,665::task::579::TaskManager.Task::(_updateState) Task=`63b102f5-b658-4586-b44c-b54244b58a26`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:08:50,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:08:50,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:08:50,665::task::974::TaskManager.Task::(_decref) Task=`63b102f5-b658-4586-b44c-b54244b58a26`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:50,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:51,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:08:51,824::task::579::TaskManager.Task::(_updateState) Task=`1e2dd81f-959c-4ba5-9b23-4aa54db7f29a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:08:51,824::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:08:51,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:08:51,825::task::1168::TaskManager.Task::(prepare) Task=`1e2dd81f-959c-4ba5-9b23-4aa54db7f29a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:08:51,825::task::579::TaskManager.Task::(_updateState) Task=`1e2dd81f-959c-4ba5-9b23-4aa54db7f29a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:08:51,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:08:51,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:08:51,825::task::974::TaskManager.Task::(_decref) Task=`1e2dd81f-959c-4ba5-9b23-4aa54db7f29a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:51,884::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:52,597::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:52,885::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:08:52,885::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:53,885::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:08:53,985::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:08:54,007::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264126 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:08:54,598::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:54,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:08:55,305::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:08:55,324::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026241 s, 15.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:08:55,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:56,600::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:08:56,602::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:56,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:08:56,915::task::579::TaskManager.Task::(_updateState) Task=`148c1a83-edd2-4cee-8572-1b5faba43a6c`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:08:56,915::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:08:56,916::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:08:56,916::task::1168::TaskManager.Task::(prepare) Task=`148c1a83-edd2-4cee-8572-1b5faba43a6c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:08:56,916::task::579::TaskManager.Task::(_updateState) Task=`148c1a83-edd2-4cee-8572-1b5faba43a6c`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:08:56,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:08:56,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:08:56,916::task::974::TaskManager.Task::(_decref) Task=`148c1a83-edd2-4cee-8572-1b5faba43a6c`::ref 0 aborting False >Thread-287601::DEBUG::2014-01-16 17:08:57,166::task::579::TaskManager.Task::(_updateState) Task=`d1c40ff6-ada2-4cf2-b018-80b1d11996e1`::moving from state init -> state preparing >Thread-287601::INFO::2014-01-16 17:08:57,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287601::INFO::2014-01-16 17:08:57,166::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264126', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026241', 'lastCheck': '1.8', 'valid': True}} >Thread-287601::DEBUG::2014-01-16 17:08:57,166::task::1168::TaskManager.Task::(prepare) Task=`d1c40ff6-ada2-4cf2-b018-80b1d11996e1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264126', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026241', 'lastCheck': '1.8', 'valid': True}} >Thread-287601::DEBUG::2014-01-16 17:08:57,167::task::579::TaskManager.Task::(_updateState) Task=`d1c40ff6-ada2-4cf2-b018-80b1d11996e1`::moving from state preparing -> state finished >Thread-287601::DEBUG::2014-01-16 17:08:57,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287601::DEBUG::2014-01-16 17:08:57,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287601::DEBUG::2014-01-16 17:08:57,167::task::974::TaskManager.Task::(_decref) Task=`d1c40ff6-ada2-4cf2-b018-80b1d11996e1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:08:57,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:08:57,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:08:57,890::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:08:58,603::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:08:58,892::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:08:58,892::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:08:59,893::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:08:59,894::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:08:59,894::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:00,604::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:00,895::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:09:00,895::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:01,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:09:01,607::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:09:01,608::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:01,896::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:09:01,897::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:02,609::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:02,898::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:09:03,279::task::579::TaskManager.Task::(_updateState) Task=`8cdc3027-81cb-416d-8d35-4f1400a693c4`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:09:03,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:09:03,280::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:09:03,280::task::1168::TaskManager.Task::(prepare) Task=`8cdc3027-81cb-416d-8d35-4f1400a693c4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:09:03,280::task::579::TaskManager.Task::(_updateState) Task=`8cdc3027-81cb-416d-8d35-4f1400a693c4`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:09:03,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:09:03,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:09:03,281::task::974::TaskManager.Task::(_decref) Task=`8cdc3027-81cb-416d-8d35-4f1400a693c4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:03,899::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:09:03,899::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:09:04,014::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:09:04,031::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000262137 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:09:04,610::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:04,901::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:09:04,901::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:09:05,330::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:09:05,347::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000234382 s, 17.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:09:05,902::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:09:05,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:09:05,903::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:09:05,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:06,612::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:06,613::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:06,904::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:09:06,905::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:09:06,905::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:07,906::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:09:07,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:09:08,009::task::579::TaskManager.Task::(_updateState) Task=`832d57a4-027a-4854-b899-f4440cde05fe`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:09:08,009::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:09:08,010::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:09:08,010::task::1168::TaskManager.Task::(prepare) Task=`832d57a4-027a-4854-b899-f4440cde05fe`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:09:08,010::task::579::TaskManager.Task::(_updateState) Task=`832d57a4-027a-4854-b899-f4440cde05fe`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:09:08,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:09:08,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:09:08,010::task::974::TaskManager.Task::(_decref) Task=`832d57a4-027a-4854-b899-f4440cde05fe`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:09:08,029::task::579::TaskManager.Task::(_updateState) Task=`047ab266-a742-4d08-8c77-e41469817e49`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:09:08,030::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:09:08,030::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:09:08,030::task::1168::TaskManager.Task::(prepare) Task=`047ab266-a742-4d08-8c77-e41469817e49`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:09:08,030::task::579::TaskManager.Task::(_updateState) Task=`047ab266-a742-4d08-8c77-e41469817e49`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:09:08,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:09:08,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:09:08,031::task::974::TaskManager.Task::(_decref) Task=`047ab266-a742-4d08-8c77-e41469817e49`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:08,614::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:08,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:09:08,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:09:08,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:09:08,907::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:09:09,851::task::579::TaskManager.Task::(_updateState) Task=`8d6ac383-c198-4289-9713-baf166eb2441`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:09:09,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:09:09,852::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:09:09,852::task::1168::TaskManager.Task::(prepare) Task=`8d6ac383-c198-4289-9713-baf166eb2441`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:09:09,852::task::579::TaskManager.Task::(_updateState) Task=`8d6ac383-c198-4289-9713-baf166eb2441`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:09:09,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:09:09,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:09:09,853::task::974::TaskManager.Task::(_decref) Task=`8d6ac383-c198-4289-9713-baf166eb2441`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:09:09,853::task::579::TaskManager.Task::(_updateState) Task=`4b04d28c-2a63-48c2-8280-161103e3b591`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:09:09,853::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:09:09,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:09:09,853::task::1168::TaskManager.Task::(prepare) Task=`4b04d28c-2a63-48c2-8280-161103e3b591`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:09:09,854::task::579::TaskManager.Task::(_updateState) Task=`4b04d28c-2a63-48c2-8280-161103e3b591`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:09:09,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:09:09,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:09:09,854::task::974::TaskManager.Task::(_decref) Task=`4b04d28c-2a63-48c2-8280-161103e3b591`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:09,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:09:10,293::task::579::TaskManager.Task::(_updateState) Task=`e24a75ed-cec6-437c-aa21-33502343dce4`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:09:10,293::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:09:10,293::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:09:10,293::task::1168::TaskManager.Task::(prepare) Task=`e24a75ed-cec6-437c-aa21-33502343dce4`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:09:10,294::task::579::TaskManager.Task::(_updateState) Task=`e24a75ed-cec6-437c-aa21-33502343dce4`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:09:10,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:09:10,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:09:10,294::task::974::TaskManager.Task::(_decref) Task=`e24a75ed-cec6-437c-aa21-33502343dce4`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:09:10,294::task::579::TaskManager.Task::(_updateState) Task=`81de3dec-6981-4151-8916-4000866f03ca`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:09:10,294::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:09:10,295::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:09:10,295::task::1168::TaskManager.Task::(prepare) Task=`81de3dec-6981-4151-8916-4000866f03ca`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:09:10,295::task::579::TaskManager.Task::(_updateState) Task=`81de3dec-6981-4151-8916-4000866f03ca`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:09:10,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:09:10,295::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:09:10,295::task::974::TaskManager.Task::(_decref) Task=`81de3dec-6981-4151-8916-4000866f03ca`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:09:10,436::task::579::TaskManager.Task::(_updateState) Task=`3ef2aefc-15eb-4203-a135-c68305f1ed0e`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:09:10,436::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:09:10,437::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:09:10,437::task::1168::TaskManager.Task::(prepare) Task=`3ef2aefc-15eb-4203-a135-c68305f1ed0e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:09:10,437::task::579::TaskManager.Task::(_updateState) Task=`3ef2aefc-15eb-4203-a135-c68305f1ed0e`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:09:10,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:09:10,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:09:10,437::task::974::TaskManager.Task::(_decref) Task=`3ef2aefc-15eb-4203-a135-c68305f1ed0e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:10,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:10,910::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:09:10,910::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:09:10,910::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:09:10,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:10,910::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:09:10,911::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:09:11,616::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:11,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:12,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:12,912::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:09:12,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:09:12,913::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287607::DEBUG::2014-01-16 17:09:13,063::task::579::TaskManager.Task::(_updateState) Task=`7b6d6b95-4091-4525-ba37-8e60d274606c`::moving from state init -> state preparing >Thread-287607::INFO::2014-01-16 17:09:13,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287607::INFO::2014-01-16 17:09:13,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262137', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234382', 'lastCheck': '7.7', 'valid': True}} >Thread-287607::DEBUG::2014-01-16 17:09:13,063::task::1168::TaskManager.Task::(prepare) Task=`7b6d6b95-4091-4525-ba37-8e60d274606c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000262137', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234382', 'lastCheck': '7.7', 'valid': True}} >Thread-287607::DEBUG::2014-01-16 17:09:13,063::task::579::TaskManager.Task::(_updateState) Task=`7b6d6b95-4091-4525-ba37-8e60d274606c`::moving from state preparing -> state finished >Thread-287607::DEBUG::2014-01-16 17:09:13,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287607::DEBUG::2014-01-16 17:09:13,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287607::DEBUG::2014-01-16 17:09:13,064::task::974::TaskManager.Task::(_decref) Task=`7b6d6b95-4091-4525-ba37-8e60d274606c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:13,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:09:13,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:09:13,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:09:14,039::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:09:14,056::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000270722 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:09:14,197::task::579::TaskManager.Task::(_updateState) Task=`239bf52a-fce6-4e37-970d-2e7589f101cd`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:09:14,198::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:09:14,198::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:09:14,198::task::1168::TaskManager.Task::(prepare) Task=`239bf52a-fce6-4e37-970d-2e7589f101cd`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:09:14,198::task::579::TaskManager.Task::(_updateState) Task=`239bf52a-fce6-4e37-970d-2e7589f101cd`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:09:14,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:09:14,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:09:14,199::task::974::TaskManager.Task::(_decref) Task=`239bf52a-fce6-4e37-970d-2e7589f101cd`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:09:14,594::task::579::TaskManager.Task::(_updateState) Task=`b62bfe38-ee2c-4066-8fbc-92668e287a84`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:09:14,594::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:09:14,595::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:09:14,595::task::1168::TaskManager.Task::(prepare) Task=`b62bfe38-ee2c-4066-8fbc-92668e287a84`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:09:14,595::task::579::TaskManager.Task::(_updateState) Task=`b62bfe38-ee2c-4066-8fbc-92668e287a84`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:09:14,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:09:14,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:09:14,595::task::974::TaskManager.Task::(_decref) Task=`b62bfe38-ee2c-4066-8fbc-92668e287a84`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:14,619::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:14,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:09:14,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:09:14,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:09:14,916::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:09:15,352::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:09:15,370::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022225 s, 18.4 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:09:15,721::task::579::TaskManager.Task::(_updateState) Task=`e0787709-4af9-4000-95b7-58631f04be60`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:09:15,722::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:09:15,722::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:09:15,722::task::1168::TaskManager.Task::(prepare) Task=`e0787709-4af9-4000-95b7-58631f04be60`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:09:15,723::task::579::TaskManager.Task::(_updateState) Task=`e0787709-4af9-4000-95b7-58631f04be60`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:09:15,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:09:15,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:09:15,723::task::974::TaskManager.Task::(_decref) Task=`e0787709-4af9-4000-95b7-58631f04be60`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:15,918::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:09:16,113::task::579::TaskManager.Task::(_updateState) Task=`7c6998bc-cbe9-423e-8fa6-5d8efaf20cd5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:09:16,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:09:16,113::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:09:16,113::task::1168::TaskManager.Task::(prepare) Task=`7c6998bc-cbe9-423e-8fa6-5d8efaf20cd5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:09:16,114::task::579::TaskManager.Task::(_updateState) Task=`7c6998bc-cbe9-423e-8fa6-5d8efaf20cd5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:09:16,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:09:16,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:09:16,114::task::974::TaskManager.Task::(_decref) Task=`7c6998bc-cbe9-423e-8fa6-5d8efaf20cd5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:09:16,114::task::579::TaskManager.Task::(_updateState) Task=`8050ed4f-5a97-414a-b97f-e3a7fa0ec172`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:09:16,115::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:09:16,115::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:09:16,116::task::1168::TaskManager.Task::(prepare) Task=`8050ed4f-5a97-414a-b97f-e3a7fa0ec172`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:09:16,116::task::579::TaskManager.Task::(_updateState) Task=`8050ed4f-5a97-414a-b97f-e3a7fa0ec172`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:09:16,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:09:16,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:09:16,116::task::974::TaskManager.Task::(_decref) Task=`8050ed4f-5a97-414a-b97f-e3a7fa0ec172`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:16,621::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:16,621::task::579::TaskManager.Task::(_updateState) Task=`2bd611cb-7781-4ae0-b781-e7d218018d00`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:09:16,621::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:09:16,622::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:09:16,622::task::1168::TaskManager.Task::(prepare) Task=`2bd611cb-7781-4ae0-b781-e7d218018d00`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:09:16,622::task::579::TaskManager.Task::(_updateState) Task=`2bd611cb-7781-4ae0-b781-e7d218018d00`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:09:16,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:09:16,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:09:16,623::task::974::TaskManager.Task::(_decref) Task=`2bd611cb-7781-4ae0-b781-e7d218018d00`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:16,624::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:09:16,624::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:09:16,626::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:16,628::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:16,629::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 17:09:16,707::task::579::TaskManager.Task::(_updateState) Task=`f4d62bd6-f085-460a-a3e8-f36ac0cc39c5`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:09:16,707::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:09:16,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:09:16,708::task::1168::TaskManager.Task::(prepare) Task=`f4d62bd6-f085-460a-a3e8-f36ac0cc39c5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:09:16,708::task::579::TaskManager.Task::(_updateState) Task=`f4d62bd6-f085-460a-a3e8-f36ac0cc39c5`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:09:16,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:09:16,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:09:16,708::task::974::TaskManager.Task::(_decref) Task=`f4d62bd6-f085-460a-a3e8-f36ac0cc39c5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:16,918::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:09:16,919::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:17,920::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:18,630::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:18,921::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:09:19,502::task::579::TaskManager.Task::(_updateState) Task=`15241729-15cf-46b8-b283-4cd1c2c78b21`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:09:19,502::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:09:19,502::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:09:19,502::task::1168::TaskManager.Task::(prepare) Task=`15241729-15cf-46b8-b283-4cd1c2c78b21`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:09:19,503::task::579::TaskManager.Task::(_updateState) Task=`15241729-15cf-46b8-b283-4cd1c2c78b21`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:09:19,503::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:09:19,503::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:09:19,503::task::974::TaskManager.Task::(_decref) Task=`15241729-15cf-46b8-b283-4cd1c2c78b21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:19,922::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:09:20,093::task::579::TaskManager.Task::(_updateState) Task=`602ab53d-4d2d-434f-a1c2-d6be9f82244a`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:09:20,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:09:20,094::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:09:20,094::task::1168::TaskManager.Task::(prepare) Task=`602ab53d-4d2d-434f-a1c2-d6be9f82244a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:09:20,094::task::579::TaskManager.Task::(_updateState) Task=`602ab53d-4d2d-434f-a1c2-d6be9f82244a`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:09:20,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:09:20,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:09:20,095::task::974::TaskManager.Task::(_decref) Task=`602ab53d-4d2d-434f-a1c2-d6be9f82244a`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:09:20,397::task::579::TaskManager.Task::(_updateState) Task=`6244a6f2-03fb-46f0-baf1-25ce1a4c2b76`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:09:20,397::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:09:20,398::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:09:20,398::task::1168::TaskManager.Task::(prepare) Task=`6244a6f2-03fb-46f0-baf1-25ce1a4c2b76`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:09:20,398::task::579::TaskManager.Task::(_updateState) Task=`6244a6f2-03fb-46f0-baf1-25ce1a4c2b76`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:09:20,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:09:20,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:09:20,398::task::974::TaskManager.Task::(_decref) Task=`6244a6f2-03fb-46f0-baf1-25ce1a4c2b76`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:09:20,399::task::579::TaskManager.Task::(_updateState) Task=`5d4dfa75-098f-41e1-a70b-e6300d1853ea`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:09:20,399::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:09:20,399::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:09:20,399::task::1168::TaskManager.Task::(prepare) Task=`5d4dfa75-098f-41e1-a70b-e6300d1853ea`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:09:20,399::task::579::TaskManager.Task::(_updateState) Task=`5d4dfa75-098f-41e1-a70b-e6300d1853ea`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:09:20,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:09:20,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:09:20,400::task::974::TaskManager.Task::(_decref) Task=`5d4dfa75-098f-41e1-a70b-e6300d1853ea`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:09:20,400::task::579::TaskManager.Task::(_updateState) Task=`4a809b14-77d4-4eb2-bc47-500555729c74`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:09:20,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:09:20,400::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:09:20,400::task::1168::TaskManager.Task::(prepare) Task=`4a809b14-77d4-4eb2-bc47-500555729c74`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:09:20,401::task::579::TaskManager.Task::(_updateState) Task=`4a809b14-77d4-4eb2-bc47-500555729c74`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:09:20,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:09:20,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:09:20,401::task::974::TaskManager.Task::(_decref) Task=`4a809b14-77d4-4eb2-bc47-500555729c74`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:20,631::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:20,923::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:21,633::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:21,924::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:22,634::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:22,925::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:09:22,926::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:09:23,441::task::579::TaskManager.Task::(_updateState) Task=`6405a83e-831d-4c7b-b00a-7a33bee16182`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:09:23,441::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:09:23,442::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:09:23,442::task::1168::TaskManager.Task::(prepare) Task=`6405a83e-831d-4c7b-b00a-7a33bee16182`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:09:23,442::task::579::TaskManager.Task::(_updateState) Task=`6405a83e-831d-4c7b-b00a-7a33bee16182`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:09:23,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:09:23,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:09:23,442::task::974::TaskManager.Task::(_decref) Task=`6405a83e-831d-4c7b-b00a-7a33bee16182`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:23,926::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:09:24,064::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:09:24,084::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281905 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:09:24,636::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:24,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:09:25,376::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:09:25,394::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000263416 s, 15.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:09:25,928::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:26,637::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:26,638::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:26,930::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:09:27,049::task::579::TaskManager.Task::(_updateState) Task=`be6869ea-723b-41a7-801a-b0b91b745585`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:09:27,050::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:09:27,050::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:09:27,050::task::1168::TaskManager.Task::(prepare) Task=`be6869ea-723b-41a7-801a-b0b91b745585`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:09:27,050::task::579::TaskManager.Task::(_updateState) Task=`be6869ea-723b-41a7-801a-b0b91b745585`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:09:27,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:09:27,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:09:27,051::task::974::TaskManager.Task::(_decref) Task=`be6869ea-723b-41a7-801a-b0b91b745585`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:27,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:09:27,931::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:09:27,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:28,640::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287613::DEBUG::2014-01-16 17:09:28,907::task::579::TaskManager.Task::(_updateState) Task=`7c410359-b1d0-4f03-b7c0-fb8e9027e544`::moving from state init -> state preparing >Thread-287613::INFO::2014-01-16 17:09:28,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287613::INFO::2014-01-16 17:09:28,908::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281905', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263416', 'lastCheck': '3.5', 'valid': True}} >Thread-287613::DEBUG::2014-01-16 17:09:28,908::task::1168::TaskManager.Task::(prepare) Task=`7c410359-b1d0-4f03-b7c0-fb8e9027e544`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000281905', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263416', 'lastCheck': '3.5', 'valid': True}} >Thread-287613::DEBUG::2014-01-16 17:09:28,908::task::579::TaskManager.Task::(_updateState) Task=`7c410359-b1d0-4f03-b7c0-fb8e9027e544`::moving from state preparing -> state finished >Thread-287613::DEBUG::2014-01-16 17:09:28,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287613::DEBUG::2014-01-16 17:09:28,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287613::DEBUG::2014-01-16 17:09:28,908::task::974::TaskManager.Task::(_decref) Task=`7c410359-b1d0-4f03-b7c0-fb8e9027e544`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:28,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:09:28,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:29,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:09:29,933::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:09:29,934::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:30,641::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:30,935::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:09:30,935::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:09:31,334::task::579::TaskManager.Task::(_updateState) Task=`c63c5713-8486-4deb-bf8b-7524712da31c`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:09:31,334::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:09:31,334::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:09:31,335::task::1168::TaskManager.Task::(prepare) Task=`c63c5713-8486-4deb-bf8b-7524712da31c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:09:31,335::task::579::TaskManager.Task::(_updateState) Task=`c63c5713-8486-4deb-bf8b-7524712da31c`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:09:31,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:09:31,335::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:09:31,335::task::974::TaskManager.Task::(_decref) Task=`c63c5713-8486-4deb-bf8b-7524712da31c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:31,644::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:09:31,644::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:09:31,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:31,936::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:09:31,937::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:32,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:32,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:33,939::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:09:33,939::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:09:34,092::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:09:34,109::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000277909 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:09:34,648::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:34,941::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:09:34,941::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:09:35,102::task::579::TaskManager.Task::(_updateState) Task=`53d39c41-2161-479e-8fa6-b4a5e2f43217`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:09:35,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:09:35,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:09:35,103::task::1168::TaskManager.Task::(prepare) Task=`53d39c41-2161-479e-8fa6-b4a5e2f43217`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:09:35,103::task::579::TaskManager.Task::(_updateState) Task=`53d39c41-2161-479e-8fa6-b4a5e2f43217`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:09:35,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:09:35,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:09:35,104::task::974::TaskManager.Task::(_decref) Task=`53d39c41-2161-479e-8fa6-b4a5e2f43217`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:09:35,110::task::579::TaskManager.Task::(_updateState) Task=`be70e29d-8cc8-490f-9c96-0b7c85383165`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:09:35,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:09:35,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:09:35,111::task::1168::TaskManager.Task::(prepare) Task=`be70e29d-8cc8-490f-9c96-0b7c85383165`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:09:35,111::task::579::TaskManager.Task::(_updateState) Task=`be70e29d-8cc8-490f-9c96-0b7c85383165`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:09:35,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:09:35,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:09:35,111::task::974::TaskManager.Task::(_decref) Task=`be70e29d-8cc8-490f-9c96-0b7c85383165`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:09:35,400::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:09:35,418::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000197461 s, 20.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:09:35,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:09:35,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:09:35,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:09:35,943::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:36,650::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:36,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:36,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:09:36,943::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:09:36,944::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:09:37,116::task::579::TaskManager.Task::(_updateState) Task=`ad683613-ff24-4696-8dc1-1c191b5560a5`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:09:37,117::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:09:37,117::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:09:37,117::task::1168::TaskManager.Task::(prepare) Task=`ad683613-ff24-4696-8dc1-1c191b5560a5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:09:37,117::task::579::TaskManager.Task::(_updateState) Task=`ad683613-ff24-4696-8dc1-1c191b5560a5`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:09:37,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:09:37,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:09:37,118::task::974::TaskManager.Task::(_decref) Task=`ad683613-ff24-4696-8dc1-1c191b5560a5`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:09:37,118::task::579::TaskManager.Task::(_updateState) Task=`4d0b2c9f-6abf-4fd1-980a-7769152c4432`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:09:37,118::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:09:37,118::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:09:37,118::task::1168::TaskManager.Task::(prepare) Task=`4d0b2c9f-6abf-4fd1-980a-7769152c4432`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:09:37,118::task::579::TaskManager.Task::(_updateState) Task=`4d0b2c9f-6abf-4fd1-980a-7769152c4432`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:09:37,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:09:37,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:09:37,119::task::974::TaskManager.Task::(_decref) Task=`4d0b2c9f-6abf-4fd1-980a-7769152c4432`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:37,945::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:09:37,945::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:38,652::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:38,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:09:38,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:09:38,947::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:09:38,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:39,948::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:09:40,173::task::579::TaskManager.Task::(_updateState) Task=`c168fba1-e6e2-4bb0-8214-0a581e631ddf`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:09:40,174::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:09:40,174::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:09:40,174::task::1168::TaskManager.Task::(prepare) Task=`c168fba1-e6e2-4bb0-8214-0a581e631ddf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:09:40,174::task::579::TaskManager.Task::(_updateState) Task=`c168fba1-e6e2-4bb0-8214-0a581e631ddf`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:09:40,174::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:09:40,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:09:40,175::task::974::TaskManager.Task::(_decref) Task=`c168fba1-e6e2-4bb0-8214-0a581e631ddf`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:40,654::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:40,948::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:09:40,949::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:09:40,949::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:09:40,949::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:40,949::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:09:40,949::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:09:41,655::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:41,950::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:09:42,487::task::579::TaskManager.Task::(_updateState) Task=`44d641a0-73a8-4c2c-b593-fb02bfab16be`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:09:42,487::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:09:42,488::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:09:42,488::task::1168::TaskManager.Task::(prepare) Task=`44d641a0-73a8-4c2c-b593-fb02bfab16be`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:09:42,488::task::579::TaskManager.Task::(_updateState) Task=`44d641a0-73a8-4c2c-b593-fb02bfab16be`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:09:42,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:09:42,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:09:42,488::task::974::TaskManager.Task::(_decref) Task=`44d641a0-73a8-4c2c-b593-fb02bfab16be`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:42,657::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:42,951::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:09:42,951::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:09:42,952::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:09:43,374::task::579::TaskManager.Task::(_updateState) Task=`c265e3b2-258c-4876-8aca-1f451366270e`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:09:43,374::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:09:43,374::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:09:43,374::task::1168::TaskManager.Task::(prepare) Task=`c265e3b2-258c-4876-8aca-1f451366270e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:09:43,375::task::579::TaskManager.Task::(_updateState) Task=`c265e3b2-258c-4876-8aca-1f451366270e`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:09:43,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:09:43,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:09:43,375::task::974::TaskManager.Task::(_decref) Task=`c265e3b2-258c-4876-8aca-1f451366270e`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:09:43,532::task::579::TaskManager.Task::(_updateState) Task=`3ed9a931-db97-4654-92c3-ac6ddaa06bc8`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:09:43,533::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:09:43,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:09:43,533::task::1168::TaskManager.Task::(prepare) Task=`3ed9a931-db97-4654-92c3-ac6ddaa06bc8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:09:43,533::task::579::TaskManager.Task::(_updateState) Task=`3ed9a931-db97-4654-92c3-ac6ddaa06bc8`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:09:43,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:09:43,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:09:43,534::task::974::TaskManager.Task::(_decref) Task=`3ed9a931-db97-4654-92c3-ac6ddaa06bc8`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:09:43,552::task::579::TaskManager.Task::(_updateState) Task=`7ca503e8-95d7-4eeb-9a95-ea876123b8fa`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:09:43,553::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:09:43,553::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:09:43,553::task::1168::TaskManager.Task::(prepare) Task=`7ca503e8-95d7-4eeb-9a95-ea876123b8fa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:09:43,553::task::579::TaskManager.Task::(_updateState) Task=`7ca503e8-95d7-4eeb-9a95-ea876123b8fa`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:09:43,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:09:43,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:09:43,554::task::974::TaskManager.Task::(_decref) Task=`7ca503e8-95d7-4eeb-9a95-ea876123b8fa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:43,953::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:09:43,953::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:09:43,953::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:09:44,069::task::579::TaskManager.Task::(_updateState) Task=`9f9301ca-cc77-4a09-8c98-d3089087892d`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:09:44,069::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:09:44,070::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:09:44,070::task::1168::TaskManager.Task::(prepare) Task=`9f9301ca-cc77-4a09-8c98-d3089087892d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:09:44,070::task::579::TaskManager.Task::(_updateState) Task=`9f9301ca-cc77-4a09-8c98-d3089087892d`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:09:44,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:09:44,070::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:09:44,070::task::974::TaskManager.Task::(_decref) Task=`9f9301ca-cc77-4a09-8c98-d3089087892d`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:09:44,116::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:09:44,133::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00033207 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:09:44,490::task::579::TaskManager.Task::(_updateState) Task=`a7961bae-5af0-49a9-856a-af59c0b53647`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:09:44,491::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:09:44,491::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:09:44,491::task::1168::TaskManager.Task::(prepare) Task=`a7961bae-5af0-49a9-856a-af59c0b53647`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:09:44,492::task::579::TaskManager.Task::(_updateState) Task=`a7961bae-5af0-49a9-856a-af59c0b53647`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:09:44,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:09:44,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:09:44,492::task::974::TaskManager.Task::(_decref) Task=`a7961bae-5af0-49a9-856a-af59c0b53647`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:44,659::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:44,954::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:09:44,954::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:09:44,955::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:09:44,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287619::DEBUG::2014-01-16 17:09:45,016::task::579::TaskManager.Task::(_updateState) Task=`86fb1aaa-7b55-475b-a399-8e359ae1fd70`::moving from state init -> state preparing >Thread-287619::INFO::2014-01-16 17:09:45,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287619::INFO::2014-01-16 17:09:45,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033207', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000197461', 'lastCheck': '9.6', 'valid': True}} >Thread-287619::DEBUG::2014-01-16 17:09:45,017::task::1168::TaskManager.Task::(prepare) Task=`86fb1aaa-7b55-475b-a399-8e359ae1fd70`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033207', 'lastCheck': '0.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000197461', 'lastCheck': '9.6', 'valid': True}} >Thread-287619::DEBUG::2014-01-16 17:09:45,017::task::579::TaskManager.Task::(_updateState) Task=`86fb1aaa-7b55-475b-a399-8e359ae1fd70`::moving from state preparing -> state finished >Thread-287619::DEBUG::2014-01-16 17:09:45,017::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287619::DEBUG::2014-01-16 17:09:45,017::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287619::DEBUG::2014-01-16 17:09:45,017::task::974::TaskManager.Task::(_decref) Task=`86fb1aaa-7b55-475b-a399-8e359ae1fd70`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:09:45,425::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:09:45,442::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000181501 s, 22.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:09:45,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:46,660::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:46,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:09:46,663::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:09:46,664::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:46,957::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:09:46,958::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:47,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:48,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:48,960::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:49,962::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:50,667::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:09:50,926::task::579::TaskManager.Task::(_updateState) Task=`6060514a-f3b8-4d79-a3b9-d30b4eaf4c80`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:09:50,927::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:09:50,927::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:09:50,927::task::1168::TaskManager.Task::(prepare) Task=`6060514a-f3b8-4d79-a3b9-d30b4eaf4c80`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:09:50,927::task::579::TaskManager.Task::(_updateState) Task=`6060514a-f3b8-4d79-a3b9-d30b4eaf4c80`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:09:50,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:09:50,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:09:50,928::task::974::TaskManager.Task::(_decref) Task=`6060514a-f3b8-4d79-a3b9-d30b4eaf4c80`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:09:50,928::task::579::TaskManager.Task::(_updateState) Task=`2175109d-ed19-414e-9e0c-0e23249cd69d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:09:50,928::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:09:50,928::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:09:50,928::task::1168::TaskManager.Task::(prepare) Task=`2175109d-ed19-414e-9e0c-0e23249cd69d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:09:50,929::task::579::TaskManager.Task::(_updateState) Task=`2175109d-ed19-414e-9e0c-0e23249cd69d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:09:50,929::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:09:50,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:09:50,929::task::974::TaskManager.Task::(_decref) Task=`2175109d-ed19-414e-9e0c-0e23249cd69d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:09:50,929::task::579::TaskManager.Task::(_updateState) Task=`9a194912-702d-4778-aed4-0f359bfc0ebb`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:09:50,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:09:50,930::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:09:50,930::task::1168::TaskManager.Task::(prepare) Task=`9a194912-702d-4778-aed4-0f359bfc0ebb`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:09:50,930::task::579::TaskManager.Task::(_updateState) Task=`9a194912-702d-4778-aed4-0f359bfc0ebb`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:09:50,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:09:50,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:09:50,930::task::974::TaskManager.Task::(_decref) Task=`9a194912-702d-4778-aed4-0f359bfc0ebb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:50,963::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:51,668::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:51,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:09:51,977::task::579::TaskManager.Task::(_updateState) Task=`0e4f9dc4-cb1d-46ac-a40a-3bcf984787e5`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:09:51,977::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:09:51,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:09:51,977::task::1168::TaskManager.Task::(prepare) Task=`0e4f9dc4-cb1d-46ac-a40a-3bcf984787e5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:09:51,978::task::579::TaskManager.Task::(_updateState) Task=`0e4f9dc4-cb1d-46ac-a40a-3bcf984787e5`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:09:51,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:09:51,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:09:51,978::task::974::TaskManager.Task::(_decref) Task=`0e4f9dc4-cb1d-46ac-a40a-3bcf984787e5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:09:52,670::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:52,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:09:52,965::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:53,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:09:54,140::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:09:54,156::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289486 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:09:54,672::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:54,968::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:09:55,449::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:09:55,468::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000209576 s, 19.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:09:55,969::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:56,674::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:09:56,675::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:56,970::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:09:57,091::task::579::TaskManager.Task::(_updateState) Task=`15cca5ef-2e01-425d-a292-105907980df8`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:09:57,091::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:09:57,091::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:09:57,092::task::1168::TaskManager.Task::(prepare) Task=`15cca5ef-2e01-425d-a292-105907980df8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:09:57,092::task::579::TaskManager.Task::(_updateState) Task=`15cca5ef-2e01-425d-a292-105907980df8`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:09:57,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:09:57,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:09:57,092::task::974::TaskManager.Task::(_decref) Task=`15cca5ef-2e01-425d-a292-105907980df8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:09:57,972::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:09:57,972::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:09:57,972::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:09:58,676::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:09:58,972::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:09:58,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:09:59,973::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:09:59,974::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:09:59,974::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:00,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:00,975::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:10:00,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287625::DEBUG::2014-01-16 17:10:01,565::task::579::TaskManager.Task::(_updateState) Task=`0dbc6f84-ecb5-4764-b71b-855e9df2786f`::moving from state init -> state preparing >Thread-287625::INFO::2014-01-16 17:10:01,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287625::INFO::2014-01-16 17:10:01,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289486', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000209576', 'lastCheck': '6.1', 'valid': True}} >Thread-287625::DEBUG::2014-01-16 17:10:01,566::task::1168::TaskManager.Task::(prepare) Task=`0dbc6f84-ecb5-4764-b71b-855e9df2786f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000289486', 'lastCheck': '7.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000209576', 'lastCheck': '6.1', 'valid': True}} >Thread-287625::DEBUG::2014-01-16 17:10:01,566::task::579::TaskManager.Task::(_updateState) Task=`0dbc6f84-ecb5-4764-b71b-855e9df2786f`::moving from state preparing -> state finished >Thread-287625::DEBUG::2014-01-16 17:10:01,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287625::DEBUG::2014-01-16 17:10:01,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287625::DEBUG::2014-01-16 17:10:01,566::task::974::TaskManager.Task::(_decref) Task=`0dbc6f84-ecb5-4764-b71b-855e9df2786f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:01,680::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:10:01,681::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:10:01,683::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:01,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:10:01,977::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:02,684::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:02,978::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:10:03,443::task::579::TaskManager.Task::(_updateState) Task=`cf9a1fab-e1b0-46aa-9a4e-8306372d0c0c`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:10:03,444::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:10:03,444::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:10:03,444::task::1168::TaskManager.Task::(prepare) Task=`cf9a1fab-e1b0-46aa-9a4e-8306372d0c0c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:10:03,445::task::579::TaskManager.Task::(_updateState) Task=`cf9a1fab-e1b0-46aa-9a4e-8306372d0c0c`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:10:03,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:10:03,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:10:03,445::task::974::TaskManager.Task::(_decref) Task=`cf9a1fab-e1b0-46aa-9a4e-8306372d0c0c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:03,979::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:10:03,980::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:10:04,166::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:10:04,185::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271635 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:10:04,686::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:04,981::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:10:04,981::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:10:05,475::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:05,492::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0002507 s, 16.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:10:05,983::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:10:05,983::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:10:05,983::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:10:05,983::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:06,687::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:06,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:06,985::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:10:06,985::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:10:06,985::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:07,986::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:10:07,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:10:08,083::task::579::TaskManager.Task::(_updateState) Task=`473763a0-5bd3-419d-924c-a3f2728a85f4`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:10:08,084::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:10:08,084::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:10:08,084::task::1168::TaskManager.Task::(prepare) Task=`473763a0-5bd3-419d-924c-a3f2728a85f4`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:10:08,085::task::579::TaskManager.Task::(_updateState) Task=`473763a0-5bd3-419d-924c-a3f2728a85f4`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:10:08,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:10:08,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:10:08,085::task::974::TaskManager.Task::(_decref) Task=`473763a0-5bd3-419d-924c-a3f2728a85f4`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:10:08,104::task::579::TaskManager.Task::(_updateState) Task=`d295d8df-26b2-4c1d-a117-b12a1c1df3b5`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:10:08,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:10:08,104::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:10:08,104::task::1168::TaskManager.Task::(prepare) Task=`d295d8df-26b2-4c1d-a117-b12a1c1df3b5`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:10:08,105::task::579::TaskManager.Task::(_updateState) Task=`d295d8df-26b2-4c1d-a117-b12a1c1df3b5`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:10:08,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:10:08,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:10:08,105::task::974::TaskManager.Task::(_decref) Task=`d295d8df-26b2-4c1d-a117-b12a1c1df3b5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:08,690::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:08,987::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:10:08,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:10:08,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:10:08,988::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:10:09,940::task::579::TaskManager.Task::(_updateState) Task=`4c0c3103-3375-4081-80a7-9e8bd34329be`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:10:09,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:10:09,941::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:10:09,941::task::1168::TaskManager.Task::(prepare) Task=`4c0c3103-3375-4081-80a7-9e8bd34329be`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:10:09,942::task::579::TaskManager.Task::(_updateState) Task=`4c0c3103-3375-4081-80a7-9e8bd34329be`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:10:09,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:10:09,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:10:09,942::task::974::TaskManager.Task::(_decref) Task=`4c0c3103-3375-4081-80a7-9e8bd34329be`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:10:09,942::task::579::TaskManager.Task::(_updateState) Task=`47b07fdb-e0ba-4836-b888-dc302f221c1c`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:10:09,943::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:10:09,943::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:10:09,943::task::1168::TaskManager.Task::(prepare) Task=`47b07fdb-e0ba-4836-b888-dc302f221c1c`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:10:09,943::task::579::TaskManager.Task::(_updateState) Task=`47b07fdb-e0ba-4836-b888-dc302f221c1c`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:10:09,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:10:09,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:10:09,944::task::974::TaskManager.Task::(_decref) Task=`47b07fdb-e0ba-4836-b888-dc302f221c1c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:09,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:10:10,543::task::579::TaskManager.Task::(_updateState) Task=`05616592-0f37-4210-bb54-bc6f86767767`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:10:10,544::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:10:10,544::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:10:10,544::task::1168::TaskManager.Task::(prepare) Task=`05616592-0f37-4210-bb54-bc6f86767767`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:10:10,544::task::579::TaskManager.Task::(_updateState) Task=`05616592-0f37-4210-bb54-bc6f86767767`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:10:10,544::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:10:10,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:10:10,545::task::974::TaskManager.Task::(_decref) Task=`05616592-0f37-4210-bb54-bc6f86767767`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:10:10,545::task::579::TaskManager.Task::(_updateState) Task=`7ab3d36d-0962-4660-b102-31e891ae2626`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:10:10,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:10:10,545::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:10:10,546::task::1168::TaskManager.Task::(prepare) Task=`7ab3d36d-0962-4660-b102-31e891ae2626`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:10:10,546::task::579::TaskManager.Task::(_updateState) Task=`7ab3d36d-0962-4660-b102-31e891ae2626`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:10:10,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:10:10,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:10:10,546::task::974::TaskManager.Task::(_decref) Task=`7ab3d36d-0962-4660-b102-31e891ae2626`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:10:10,618::task::579::TaskManager.Task::(_updateState) Task=`170634b4-c9dc-467c-bd0f-25b85d3def5d`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:10:10,619::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:10:10,619::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:10:10,619::task::1168::TaskManager.Task::(prepare) Task=`170634b4-c9dc-467c-bd0f-25b85d3def5d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:10:10,619::task::579::TaskManager.Task::(_updateState) Task=`170634b4-c9dc-467c-bd0f-25b85d3def5d`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:10:10,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:10:10,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:10:10,620::task::974::TaskManager.Task::(_decref) Task=`170634b4-c9dc-467c-bd0f-25b85d3def5d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:10,691::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:10,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:10:10,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:10:10,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:10:10,991::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:10,991::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:10:10,993::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:10:11,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:11,993::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:12,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:12,994::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:10:12,994::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:10:12,994::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:13,995::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:10:13,996::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:10:13,996::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:10:14,194::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:10:14,210::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000318907 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:10:14,339::task::579::TaskManager.Task::(_updateState) Task=`e36cfb86-8705-4dc8-9b22-7a530664ad94`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:10:14,339::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:10:14,340::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:10:14,340::task::1168::TaskManager.Task::(prepare) Task=`e36cfb86-8705-4dc8-9b22-7a530664ad94`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:10:14,340::task::579::TaskManager.Task::(_updateState) Task=`e36cfb86-8705-4dc8-9b22-7a530664ad94`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:10:14,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:10:14,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:10:14,341::task::974::TaskManager.Task::(_decref) Task=`e36cfb86-8705-4dc8-9b22-7a530664ad94`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:14,695::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 17:10:14,763::task::579::TaskManager.Task::(_updateState) Task=`1222690f-a453-4adf-a495-14eab41bed54`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:10:14,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:10:14,764::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:10:14,764::task::1168::TaskManager.Task::(prepare) Task=`1222690f-a453-4adf-a495-14eab41bed54`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:10:14,764::task::579::TaskManager.Task::(_updateState) Task=`1222690f-a453-4adf-a495-14eab41bed54`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:10:14,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:10:14,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:10:14,765::task::974::TaskManager.Task::(_decref) Task=`1222690f-a453-4adf-a495-14eab41bed54`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:14,997::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:10:14,997::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:10:14,998::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:10:14,998::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:10:15,496::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:10:15,496::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:10:15,497::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:10:15,497::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:10:15,499::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:15,514::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000217926 s, 9.4 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:10:15,514::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000217926 s, 9.4 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:10:15,515::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:10:15,515::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:10:15,515::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:10:15,515::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:10:15,516::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:10:15,516::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:10:15,516::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:10:15,516::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:10:15,518::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:15,739::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:10:15,746::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:10:15,746::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:10:15,747::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:10:15,747::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:10:15,747::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 17:10:15,747::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::DEBUG::2014-01-16 17:10:15,902::task::579::TaskManager.Task::(_updateState) Task=`14541711-6048-4a0e-affc-8c21c436143c`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:10:15,902::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:10:15,903::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:10:15,903::task::1168::TaskManager.Task::(prepare) Task=`14541711-6048-4a0e-affc-8c21c436143c`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:10:15,903::task::579::TaskManager.Task::(_updateState) Task=`14541711-6048-4a0e-affc-8c21c436143c`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:10:15,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:10:15,905::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:10:15,907::task::974::TaskManager.Task::(_decref) Task=`14541711-6048-4a0e-affc-8c21c436143c`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:10:15,908::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:10:15,911::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:15,928::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000172581 s, 23.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:10:15,999::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:10:16,343::task::579::TaskManager.Task::(_updateState) Task=`0b2d4097-d23f-42c5-867c-6a026f72ff3e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:10:16,343::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:10:16,344::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:10:16,344::task::1168::TaskManager.Task::(prepare) Task=`0b2d4097-d23f-42c5-867c-6a026f72ff3e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:10:16,344::task::579::TaskManager.Task::(_updateState) Task=`0b2d4097-d23f-42c5-867c-6a026f72ff3e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:10:16,344::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:10:16,344::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:10:16,344::task::974::TaskManager.Task::(_decref) Task=`0b2d4097-d23f-42c5-867c-6a026f72ff3e`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:10:16,345::task::579::TaskManager.Task::(_updateState) Task=`c23b2d2a-1d36-4fd2-8ce3-6fe0f4e262d6`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:10:16,345::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:10:16,345::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:10:16,345::task::1168::TaskManager.Task::(prepare) Task=`c23b2d2a-1d36-4fd2-8ce3-6fe0f4e262d6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:10:16,346::task::579::TaskManager.Task::(_updateState) Task=`c23b2d2a-1d36-4fd2-8ce3-6fe0f4e262d6`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:10:16,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:10:16,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:10:16,346::task::974::TaskManager.Task::(_decref) Task=`c23b2d2a-1d36-4fd2-8ce3-6fe0f4e262d6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:16,697::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:16,698::task::579::TaskManager.Task::(_updateState) Task=`de9e0150-2bb2-4a38-9723-9485dec69970`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:10:16,698::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:10:16,698::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:10:16,698::task::1168::TaskManager.Task::(prepare) Task=`de9e0150-2bb2-4a38-9723-9485dec69970`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:10:16,699::task::579::TaskManager.Task::(_updateState) Task=`de9e0150-2bb2-4a38-9723-9485dec69970`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:10:16,699::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:10:16,699::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:10:16,699::task::974::TaskManager.Task::(_decref) Task=`de9e0150-2bb2-4a38-9723-9485dec69970`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:16,701::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:10:16,701::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:10:16,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:16,705::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:16,706::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 17:10:16,898::task::579::TaskManager.Task::(_updateState) Task=`d1750621-a0b6-46a2-8086-f80c47e5c9fa`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:10:16,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:10:16,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:10:16,899::task::1168::TaskManager.Task::(prepare) Task=`d1750621-a0b6-46a2-8086-f80c47e5c9fa`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:10:16,899::task::579::TaskManager.Task::(_updateState) Task=`d1750621-a0b6-46a2-8086-f80c47e5c9fa`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:10:16,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:10:16,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:10:16,900::task::974::TaskManager.Task::(_decref) Task=`d1750621-a0b6-46a2-8086-f80c47e5c9fa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:17,000::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:10:17,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287631::DEBUG::2014-01-16 17:10:17,622::task::579::TaskManager.Task::(_updateState) Task=`18af1ca2-c450-458a-a727-b37197b1399e`::moving from state init -> state preparing >Thread-287631::INFO::2014-01-16 17:10:17,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287631::INFO::2014-01-16 17:10:17,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318907', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000172581', 'lastCheck': '1.7', 'valid': True}} >Thread-287631::DEBUG::2014-01-16 17:10:17,622::task::1168::TaskManager.Task::(prepare) Task=`18af1ca2-c450-458a-a727-b37197b1399e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000318907', 'lastCheck': '3.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000172581', 'lastCheck': '1.7', 'valid': True}} >Thread-287631::DEBUG::2014-01-16 17:10:17,623::task::579::TaskManager.Task::(_updateState) Task=`18af1ca2-c450-458a-a727-b37197b1399e`::moving from state preparing -> state finished >Thread-287631::DEBUG::2014-01-16 17:10:17,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287631::DEBUG::2014-01-16 17:10:17,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287631::DEBUG::2014-01-16 17:10:17,623::task::974::TaskManager.Task::(_decref) Task=`18af1ca2-c450-458a-a727-b37197b1399e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:18,001::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:18,707::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:19,003::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:10:19,587::task::579::TaskManager.Task::(_updateState) Task=`f59fe7d8-ebca-46d5-bada-30975a13b1e6`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:10:19,587::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:10:19,589::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:10:19,589::task::1168::TaskManager.Task::(prepare) Task=`f59fe7d8-ebca-46d5-bada-30975a13b1e6`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:10:19,589::task::579::TaskManager.Task::(_updateState) Task=`f59fe7d8-ebca-46d5-bada-30975a13b1e6`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:10:19,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:10:19,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:10:19,589::task::974::TaskManager.Task::(_decref) Task=`f59fe7d8-ebca-46d5-bada-30975a13b1e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:20,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:10:20,278::task::579::TaskManager.Task::(_updateState) Task=`562b2e25-5a27-40a4-9111-06d873e0faf3`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:10:20,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:10:20,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:10:20,278::task::1168::TaskManager.Task::(prepare) Task=`562b2e25-5a27-40a4-9111-06d873e0faf3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:10:20,279::task::579::TaskManager.Task::(_updateState) Task=`562b2e25-5a27-40a4-9111-06d873e0faf3`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:10:20,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:10:20,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:10:20,279::task::974::TaskManager.Task::(_decref) Task=`562b2e25-5a27-40a4-9111-06d873e0faf3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:20,709::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:10:20,986::task::579::TaskManager.Task::(_updateState) Task=`d7c49c51-7794-4e18-9d6c-9efd75a1583f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:10:20,987::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:10:20,987::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:10:20,987::task::1168::TaskManager.Task::(prepare) Task=`d7c49c51-7794-4e18-9d6c-9efd75a1583f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:10:20,987::task::579::TaskManager.Task::(_updateState) Task=`d7c49c51-7794-4e18-9d6c-9efd75a1583f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:10:20,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:10:20,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:10:20,987::task::974::TaskManager.Task::(_decref) Task=`d7c49c51-7794-4e18-9d6c-9efd75a1583f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:10:20,988::task::579::TaskManager.Task::(_updateState) Task=`79183318-91af-4f6b-ba8f-334aeb8cbcbf`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:10:20,988::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:10:20,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:10:20,988::task::1168::TaskManager.Task::(prepare) Task=`79183318-91af-4f6b-ba8f-334aeb8cbcbf`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:10:20,988::task::579::TaskManager.Task::(_updateState) Task=`79183318-91af-4f6b-ba8f-334aeb8cbcbf`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:10:20,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:10:20,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:10:20,989::task::974::TaskManager.Task::(_decref) Task=`79183318-91af-4f6b-ba8f-334aeb8cbcbf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:10:20,989::task::579::TaskManager.Task::(_updateState) Task=`8285f2ba-186c-495a-936c-0068c7872348`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:10:20,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:10:20,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:10:20,990::task::1168::TaskManager.Task::(prepare) Task=`8285f2ba-186c-495a-936c-0068c7872348`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:10:20,990::task::579::TaskManager.Task::(_updateState) Task=`8285f2ba-186c-495a-936c-0068c7872348`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:10:20,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:10:20,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:10:20,990::task::974::TaskManager.Task::(_decref) Task=`8285f2ba-186c-495a-936c-0068c7872348`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:21,005::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:21,710::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:22,006::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:22,712::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:23,008::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:10:23,008::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:10:23,645::task::579::TaskManager.Task::(_updateState) Task=`77bd5e69-2c61-4f1b-a7a0-681c5e882a3e`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:10:23,645::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:10:23,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:10:23,646::task::1168::TaskManager.Task::(prepare) Task=`77bd5e69-2c61-4f1b-a7a0-681c5e882a3e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:10:23,646::task::579::TaskManager.Task::(_updateState) Task=`77bd5e69-2c61-4f1b-a7a0-681c5e882a3e`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:10:23,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:10:23,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:10:23,646::task::974::TaskManager.Task::(_decref) Task=`77bd5e69-2c61-4f1b-a7a0-681c5e882a3e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:24,009::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:10:24,219::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:10:24,238::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000246828 s, 1.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:10:24,714::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:25,010::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:10:25,934::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:25,955::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287737 s, 14.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:10:26,012::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:26,715::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:26,716::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:27,012::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:10:27,123::task::579::TaskManager.Task::(_updateState) Task=`5e0e2951-18d4-4d65-895c-33079f1f5f22`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:10:27,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:10:27,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:10:27,124::task::1168::TaskManager.Task::(prepare) Task=`5e0e2951-18d4-4d65-895c-33079f1f5f22`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:10:27,124::task::579::TaskManager.Task::(_updateState) Task=`5e0e2951-18d4-4d65-895c-33079f1f5f22`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:10:27,125::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:10:27,125::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:10:27,125::task::974::TaskManager.Task::(_decref) Task=`5e0e2951-18d4-4d65-895c-33079f1f5f22`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:28,013::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:10:28,014::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:10:28,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:28,718::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:29,015::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:10:29,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:30,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:10:30,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:10:30,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:30,719::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:31,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:10:31,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:10:31,510::task::579::TaskManager.Task::(_updateState) Task=`a0c518fc-cdd1-4a23-9989-c5a7a8136aa1`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:10:31,510::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:10:31,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:10:31,511::task::1168::TaskManager.Task::(prepare) Task=`a0c518fc-cdd1-4a23-9989-c5a7a8136aa1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:10:31,511::task::579::TaskManager.Task::(_updateState) Task=`a0c518fc-cdd1-4a23-9989-c5a7a8136aa1`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:10:31,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:10:31,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:10:31,511::task::974::TaskManager.Task::(_decref) Task=`a0c518fc-cdd1-4a23-9989-c5a7a8136aa1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:31,721::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:10:31,722::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:10:31,725::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:32,020::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:10:32,020::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:32,726::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:33,020::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287637::DEBUG::2014-01-16 17:10:33,465::task::579::TaskManager.Task::(_updateState) Task=`46a58d6e-f1c4-46c7-88b3-6616c5c90fe1`::moving from state init -> state preparing >Thread-287637::INFO::2014-01-16 17:10:33,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287637::INFO::2014-01-16 17:10:33,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246828', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287737', 'lastCheck': '7.5', 'valid': True}} >Thread-287637::DEBUG::2014-01-16 17:10:33,466::task::1168::TaskManager.Task::(prepare) Task=`46a58d6e-f1c4-46c7-88b3-6616c5c90fe1`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246828', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287737', 'lastCheck': '7.5', 'valid': True}} >Thread-287637::DEBUG::2014-01-16 17:10:33,466::task::579::TaskManager.Task::(_updateState) Task=`46a58d6e-f1c4-46c7-88b3-6616c5c90fe1`::moving from state preparing -> state finished >Thread-287637::DEBUG::2014-01-16 17:10:33,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287637::DEBUG::2014-01-16 17:10:33,466::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287637::DEBUG::2014-01-16 17:10:33,466::task::974::TaskManager.Task::(_decref) Task=`46a58d6e-f1c4-46c7-88b3-6616c5c90fe1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:34,021::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:10:34,027::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:10:34,245::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:10:34,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000262835 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:10:34,728::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:35,027::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:10:35,028::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:10:35,308::task::579::TaskManager.Task::(_updateState) Task=`3e97b132-9835-4d9a-97f3-0dfbf2eb4f01`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:10:35,308::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:10:35,308::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:10:35,309::task::1168::TaskManager.Task::(prepare) Task=`3e97b132-9835-4d9a-97f3-0dfbf2eb4f01`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:10:35,309::task::579::TaskManager.Task::(_updateState) Task=`3e97b132-9835-4d9a-97f3-0dfbf2eb4f01`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:10:35,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:10:35,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:10:35,309::task::974::TaskManager.Task::(_decref) Task=`3e97b132-9835-4d9a-97f3-0dfbf2eb4f01`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:10:35,311::task::579::TaskManager.Task::(_updateState) Task=`5dd4bcee-4f60-4c4b-ab50-36e38123e287`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:10:35,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:10:35,312::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:10:35,312::task::1168::TaskManager.Task::(prepare) Task=`5dd4bcee-4f60-4c4b-ab50-36e38123e287`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:10:35,312::task::579::TaskManager.Task::(_updateState) Task=`5dd4bcee-4f60-4c4b-ab50-36e38123e287`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:10:35,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:10:35,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:10:35,313::task::974::TaskManager.Task::(_decref) Task=`5dd4bcee-4f60-4c4b-ab50-36e38123e287`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:10:35,962::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:35,979::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000393654 s, 10.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:10:36,029::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:10:36,029::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:10:36,030::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:10:36,030::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:36,730::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:36,731::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:37,031::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:10:37,031::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:10:37,032::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:10:37,513::task::579::TaskManager.Task::(_updateState) Task=`384ac32a-657a-490d-897a-63dcda3e74a0`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:10:37,513::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:10:37,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:10:37,514::task::1168::TaskManager.Task::(prepare) Task=`384ac32a-657a-490d-897a-63dcda3e74a0`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:10:37,514::task::579::TaskManager.Task::(_updateState) Task=`384ac32a-657a-490d-897a-63dcda3e74a0`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:10:37,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:10:37,514::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:10:37,515::task::974::TaskManager.Task::(_decref) Task=`384ac32a-657a-490d-897a-63dcda3e74a0`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:10:37,515::task::579::TaskManager.Task::(_updateState) Task=`5c2f5f63-b943-4d11-8db9-bde5fce86a1e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:10:37,515::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:10:37,515::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:10:37,516::task::1168::TaskManager.Task::(prepare) Task=`5c2f5f63-b943-4d11-8db9-bde5fce86a1e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:10:37,516::task::579::TaskManager.Task::(_updateState) Task=`5c2f5f63-b943-4d11-8db9-bde5fce86a1e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:10:37,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:10:37,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:10:37,516::task::974::TaskManager.Task::(_decref) Task=`5c2f5f63-b943-4d11-8db9-bde5fce86a1e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:38,033::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:10:38,033::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:38,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:39,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:10:39,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:10:39,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:10:39,034::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:40,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:10:40,362::task::579::TaskManager.Task::(_updateState) Task=`9a10e692-5278-45a4-bfb0-3277bdea7a9d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:10:40,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:10:40,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:10:40,363::task::1168::TaskManager.Task::(prepare) Task=`9a10e692-5278-45a4-bfb0-3277bdea7a9d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:10:40,363::task::579::TaskManager.Task::(_updateState) Task=`9a10e692-5278-45a4-bfb0-3277bdea7a9d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:10:40,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:10:40,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:10:40,364::task::974::TaskManager.Task::(_decref) Task=`9a10e692-5278-45a4-bfb0-3277bdea7a9d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:40,734::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:41,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:10:41,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:10:41,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:10:41,037::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:41,038::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:10:41,040::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:10:41,736::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:42,040::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:10:42,669::task::579::TaskManager.Task::(_updateState) Task=`1e6bb1e3-b822-47a7-a685-31700ffaa2c9`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:10:42,669::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:10:42,670::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:10:42,670::task::1168::TaskManager.Task::(prepare) Task=`1e6bb1e3-b822-47a7-a685-31700ffaa2c9`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:10:42,670::task::579::TaskManager.Task::(_updateState) Task=`1e6bb1e3-b822-47a7-a685-31700ffaa2c9`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:10:42,670::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:10:42,670::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:10:42,671::task::974::TaskManager.Task::(_decref) Task=`1e6bb1e3-b822-47a7-a685-31700ffaa2c9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:42,737::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:43,042::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:10:43,042::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:10:43,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:10:43,552::task::579::TaskManager.Task::(_updateState) Task=`31553e84-e9dc-45d8-b7bc-9e27952a09b4`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:10:43,552::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:10:43,552::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:10:43,552::task::1168::TaskManager.Task::(prepare) Task=`31553e84-e9dc-45d8-b7bc-9e27952a09b4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:10:43,553::task::579::TaskManager.Task::(_updateState) Task=`31553e84-e9dc-45d8-b7bc-9e27952a09b4`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:10:43,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:10:43,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:10:43,553::task::974::TaskManager.Task::(_decref) Task=`31553e84-e9dc-45d8-b7bc-9e27952a09b4`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:10:43,719::task::579::TaskManager.Task::(_updateState) Task=`764e1be8-9bcd-4ab8-baa2-9cd7ac9930ab`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:10:43,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:10:43,720::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:10:43,720::task::1168::TaskManager.Task::(prepare) Task=`764e1be8-9bcd-4ab8-baa2-9cd7ac9930ab`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:10:43,720::task::579::TaskManager.Task::(_updateState) Task=`764e1be8-9bcd-4ab8-baa2-9cd7ac9930ab`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:10:43,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:10:43,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:10:43,720::task::974::TaskManager.Task::(_decref) Task=`764e1be8-9bcd-4ab8-baa2-9cd7ac9930ab`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:10:43,733::task::579::TaskManager.Task::(_updateState) Task=`45fd5fb4-0935-48ff-8d8f-ad0085e32bdf`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:10:43,734::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:10:43,734::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:10:43,734::task::1168::TaskManager.Task::(prepare) Task=`45fd5fb4-0935-48ff-8d8f-ad0085e32bdf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:10:43,734::task::579::TaskManager.Task::(_updateState) Task=`45fd5fb4-0935-48ff-8d8f-ad0085e32bdf`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:10:43,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:10:43,735::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:10:43,735::task::974::TaskManager.Task::(_decref) Task=`45fd5fb4-0935-48ff-8d8f-ad0085e32bdf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:44,043::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:10:44,043::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:10:44,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:10:44,270::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:10:44,288::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00030255 s, 1.2 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 17:10:44,292::task::579::TaskManager.Task::(_updateState) Task=`e4415c3e-b8ff-4af2-a98a-5980074e575d`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:10:44,292::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:10:44,292::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:10:44,293::task::1168::TaskManager.Task::(prepare) Task=`e4415c3e-b8ff-4af2-a98a-5980074e575d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:10:44,293::task::579::TaskManager.Task::(_updateState) Task=`e4415c3e-b8ff-4af2-a98a-5980074e575d`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:10:44,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:10:44,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:10:44,293::task::974::TaskManager.Task::(_decref) Task=`e4415c3e-b8ff-4af2-a98a-5980074e575d`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:10:44,683::task::579::TaskManager.Task::(_updateState) Task=`41156f57-5581-49ea-8ff3-9f78c85a3251`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:10:44,683::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:10:44,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:10:44,684::task::1168::TaskManager.Task::(prepare) Task=`41156f57-5581-49ea-8ff3-9f78c85a3251`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:10:44,684::task::579::TaskManager.Task::(_updateState) Task=`41156f57-5581-49ea-8ff3-9f78c85a3251`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:10:44,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:10:44,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:10:44,684::task::974::TaskManager.Task::(_decref) Task=`41156f57-5581-49ea-8ff3-9f78c85a3251`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:44,739::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:45,045::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:10:45,045::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:10:45,045::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:10:45,046::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:10:45,985::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:46,005::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000273774 s, 15.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:10:46,047::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:46,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:46,742::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:10:46,742::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:10:46,743::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:47,048::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:10:47,048::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:48,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:48,745::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:49,051::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287643::DEBUG::2014-01-16 17:10:49,435::task::579::TaskManager.Task::(_updateState) Task=`1a57b0d9-1d3a-4cdc-a390-403b4eb92991`::moving from state init -> state preparing >Thread-287643::INFO::2014-01-16 17:10:49,435::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287643::INFO::2014-01-16 17:10:49,435::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030255', 'lastCheck': '5.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273774', 'lastCheck': '3.4', 'valid': True}} >Thread-287643::DEBUG::2014-01-16 17:10:49,435::task::1168::TaskManager.Task::(prepare) Task=`1a57b0d9-1d3a-4cdc-a390-403b4eb92991`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030255', 'lastCheck': '5.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273774', 'lastCheck': '3.4', 'valid': True}} >Thread-287643::DEBUG::2014-01-16 17:10:49,436::task::579::TaskManager.Task::(_updateState) Task=`1a57b0d9-1d3a-4cdc-a390-403b4eb92991`::moving from state preparing -> state finished >Thread-287643::DEBUG::2014-01-16 17:10:49,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287643::DEBUG::2014-01-16 17:10:49,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287643::DEBUG::2014-01-16 17:10:49,436::task::974::TaskManager.Task::(_decref) Task=`1a57b0d9-1d3a-4cdc-a390-403b4eb92991`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:50,052::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:50,747::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:51,053::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:10:51,214::task::579::TaskManager.Task::(_updateState) Task=`3860cbc7-5783-47aa-a6ae-891a66a9eb90`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:10:51,214::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:10:51,214::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:10:51,214::task::1168::TaskManager.Task::(prepare) Task=`3860cbc7-5783-47aa-a6ae-891a66a9eb90`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:10:51,215::task::579::TaskManager.Task::(_updateState) Task=`3860cbc7-5783-47aa-a6ae-891a66a9eb90`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:10:51,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:10:51,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:10:51,215::task::974::TaskManager.Task::(_decref) Task=`3860cbc7-5783-47aa-a6ae-891a66a9eb90`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:10:51,215::task::579::TaskManager.Task::(_updateState) Task=`6300dba2-9a3d-47f6-865c-2c4a99062d17`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:10:51,216::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:10:51,216::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:10:51,216::task::1168::TaskManager.Task::(prepare) Task=`6300dba2-9a3d-47f6-865c-2c4a99062d17`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:10:51,216::task::579::TaskManager.Task::(_updateState) Task=`6300dba2-9a3d-47f6-865c-2c4a99062d17`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:10:51,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:10:51,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:10:51,216::task::974::TaskManager.Task::(_decref) Task=`6300dba2-9a3d-47f6-865c-2c4a99062d17`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:10:51,217::task::579::TaskManager.Task::(_updateState) Task=`060d7e0e-fc13-4ca7-b1dd-1050c3eff06a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:10:51,217::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:10:51,217::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:10:51,217::task::1168::TaskManager.Task::(prepare) Task=`060d7e0e-fc13-4ca7-b1dd-1050c3eff06a`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:10:51,217::task::579::TaskManager.Task::(_updateState) Task=`060d7e0e-fc13-4ca7-b1dd-1050c3eff06a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:10:51,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:10:51,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:10:51,218::task::974::TaskManager.Task::(_decref) Task=`060d7e0e-fc13-4ca7-b1dd-1050c3eff06a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:51,748::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:52,055::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:10:52,153::task::579::TaskManager.Task::(_updateState) Task=`1873be9f-2629-48b6-aada-50f520cd9d99`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:10:52,153::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:10:52,153::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:10:52,154::task::1168::TaskManager.Task::(prepare) Task=`1873be9f-2629-48b6-aada-50f520cd9d99`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:10:52,154::task::579::TaskManager.Task::(_updateState) Task=`1873be9f-2629-48b6-aada-50f520cd9d99`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:10:52,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:10:52,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:10:52,154::task::974::TaskManager.Task::(_decref) Task=`1873be9f-2629-48b6-aada-50f520cd9d99`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:10:52,749::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:53,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:10:53,057::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:10:54,058::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:10:54,297::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:10:54,314::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000339785 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:10:54,751::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:55,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:10:56,011::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:10:56,028::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000214843 s, 19.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:10:56,061::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:56,752::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:10:56,753::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:57,062::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:10:57,289::task::579::TaskManager.Task::(_updateState) Task=`a90b1293-e193-4e97-899d-23f4be57ce97`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:10:57,289::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:10:57,290::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:10:57,290::task::1168::TaskManager.Task::(prepare) Task=`a90b1293-e193-4e97-899d-23f4be57ce97`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:10:57,290::task::579::TaskManager.Task::(_updateState) Task=`a90b1293-e193-4e97-899d-23f4be57ce97`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:10:57,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:10:57,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:10:57,290::task::974::TaskManager.Task::(_decref) Task=`a90b1293-e193-4e97-899d-23f4be57ce97`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:10:58,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:10:58,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:10:58,063::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:10:58,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:10:59,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:10:59,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:00,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:11:00,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:11:00,066::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:00,756::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:01,067::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:11:01,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:01,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:11:01,758::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:11:01,759::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:02,068::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:11:02,069::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:02,761::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:03,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:11:03,633::task::579::TaskManager.Task::(_updateState) Task=`e0e61e05-c290-489b-920c-66611cab4a0d`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:11:03,633::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:11:03,633::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:11:03,633::task::1168::TaskManager.Task::(prepare) Task=`e0e61e05-c290-489b-920c-66611cab4a0d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:11:03,634::task::579::TaskManager.Task::(_updateState) Task=`e0e61e05-c290-489b-920c-66611cab4a0d`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:11:03,634::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:11:03,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:11:03,634::task::974::TaskManager.Task::(_decref) Task=`e0e61e05-c290-489b-920c-66611cab4a0d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:04,071::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:11:04,072::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:11:04,322::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:11:04,339::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286196 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:11:04,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:05,073::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:11:05,074::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287649::DEBUG::2014-01-16 17:11:05,306::task::579::TaskManager.Task::(_updateState) Task=`f2dddde9-c6ab-4fe4-9801-df6f410667bf`::moving from state init -> state preparing >Thread-287649::INFO::2014-01-16 17:11:05,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287649::INFO::2014-01-16 17:11:05,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286196', 'lastCheck': '1.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000214843', 'lastCheck': '9.3', 'valid': True}} >Thread-287649::DEBUG::2014-01-16 17:11:05,307::task::1168::TaskManager.Task::(prepare) Task=`f2dddde9-c6ab-4fe4-9801-df6f410667bf`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286196', 'lastCheck': '1.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000214843', 'lastCheck': '9.3', 'valid': True}} >Thread-287649::DEBUG::2014-01-16 17:11:05,307::task::579::TaskManager.Task::(_updateState) Task=`f2dddde9-c6ab-4fe4-9801-df6f410667bf`::moving from state preparing -> state finished >Thread-287649::DEBUG::2014-01-16 17:11:05,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287649::DEBUG::2014-01-16 17:11:05,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287649::DEBUG::2014-01-16 17:11:05,308::task::974::TaskManager.Task::(_decref) Task=`f2dddde9-c6ab-4fe4-9801-df6f410667bf`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:11:06,035::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:11:06,052::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000286623 s, 14.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:11:06,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:11:06,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:11:06,075::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:11:06,075::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:06,764::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:06,765::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:07,077::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:11:07,077::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:11:07,077::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:08,078::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:11:08,079::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:11:08,158::task::579::TaskManager.Task::(_updateState) Task=`6992d195-f624-4ea5-ae59-e2123f085cd4`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:11:08,159::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:11:08,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:11:08,160::task::1168::TaskManager.Task::(prepare) Task=`6992d195-f624-4ea5-ae59-e2123f085cd4`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:11:08,161::task::579::TaskManager.Task::(_updateState) Task=`6992d195-f624-4ea5-ae59-e2123f085cd4`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:11:08,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:11:08,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:11:08,161::task::974::TaskManager.Task::(_decref) Task=`6992d195-f624-4ea5-ae59-e2123f085cd4`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:11:08,174::task::579::TaskManager.Task::(_updateState) Task=`ea5b5ab2-d48a-4a34-8c47-1559ba93b16a`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:11:08,174::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:11:08,175::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:11:08,175::task::1168::TaskManager.Task::(prepare) Task=`ea5b5ab2-d48a-4a34-8c47-1559ba93b16a`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:11:08,176::task::579::TaskManager.Task::(_updateState) Task=`ea5b5ab2-d48a-4a34-8c47-1559ba93b16a`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:11:08,176::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:11:08,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:11:08,176::task::974::TaskManager.Task::(_decref) Task=`ea5b5ab2-d48a-4a34-8c47-1559ba93b16a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:08,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:09,080::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:11:09,080::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:11:09,080::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:11:09,081::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:11:10,050::task::579::TaskManager.Task::(_updateState) Task=`0d16d78b-9461-4ba0-8a10-8199be77e9ba`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:11:10,050::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:11:10,052::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:11:10,052::task::1168::TaskManager.Task::(prepare) Task=`0d16d78b-9461-4ba0-8a10-8199be77e9ba`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:11:10,052::task::579::TaskManager.Task::(_updateState) Task=`0d16d78b-9461-4ba0-8a10-8199be77e9ba`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:11:10,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:11:10,052::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:11:10,052::task::974::TaskManager.Task::(_decref) Task=`0d16d78b-9461-4ba0-8a10-8199be77e9ba`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:11:10,052::task::579::TaskManager.Task::(_updateState) Task=`9f189170-fe14-43f2-9a93-1be0aefb1db0`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:11:10,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:11:10,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:11:10,053::task::1168::TaskManager.Task::(prepare) Task=`9f189170-fe14-43f2-9a93-1be0aefb1db0`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:11:10,053::task::579::TaskManager.Task::(_updateState) Task=`9f189170-fe14-43f2-9a93-1be0aefb1db0`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:11:10,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:11:10,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:11:10,054::task::974::TaskManager.Task::(_decref) Task=`9f189170-fe14-43f2-9a93-1be0aefb1db0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:10,082::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:10,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:11:10,792::task::579::TaskManager.Task::(_updateState) Task=`69a37d39-5a69-4619-9ec4-7e5e6edf0f70`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:11:10,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:11:10,793::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:11:10,793::task::1168::TaskManager.Task::(prepare) Task=`69a37d39-5a69-4619-9ec4-7e5e6edf0f70`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:11:10,793::task::579::TaskManager.Task::(_updateState) Task=`69a37d39-5a69-4619-9ec4-7e5e6edf0f70`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:11:10,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:11:10,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:11:10,793::task::974::TaskManager.Task::(_decref) Task=`69a37d39-5a69-4619-9ec4-7e5e6edf0f70`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:11:10,799::task::579::TaskManager.Task::(_updateState) Task=`70cbe3bb-afe4-475b-ab13-ab4fd938635b`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:11:10,799::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:11:10,800::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:11:10,800::task::1168::TaskManager.Task::(prepare) Task=`70cbe3bb-afe4-475b-ab13-ab4fd938635b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:11:10,800::task::579::TaskManager.Task::(_updateState) Task=`70cbe3bb-afe4-475b-ab13-ab4fd938635b`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:11:10,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:11:10,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:11:10,800::task::974::TaskManager.Task::(_decref) Task=`70cbe3bb-afe4-475b-ab13-ab4fd938635b`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:11:10,801::task::579::TaskManager.Task::(_updateState) Task=`d9a58759-288a-40bc-a7e7-4588e37a9ad4`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:11:10,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:11:10,801::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:11:10,801::task::1168::TaskManager.Task::(prepare) Task=`d9a58759-288a-40bc-a7e7-4588e37a9ad4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:11:10,801::task::579::TaskManager.Task::(_updateState) Task=`d9a58759-288a-40bc-a7e7-4588e37a9ad4`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:11:10,801::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:11:10,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:11:10,802::task::974::TaskManager.Task::(_decref) Task=`d9a58759-288a-40bc-a7e7-4588e37a9ad4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:11,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:11:11,083::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:11:11,083::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:11:11,083::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:11,083::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:11:11,084::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:11:11,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:12,086::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:12,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:13,086::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:11:13,087::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:11:13,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287653::DEBUG::2014-01-16 17:11:13,797::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Westmere', 'smp': '1', 'custom': {}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'pbajenez-RHEL_6.5', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '062b5e0e-cd14-451b-9a09-a0f8a0f0f0fe'}, {'index': '2', 'iface': 'ide', 'bootOrder': '1', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '94db6d62-6a07-4203-9d13-7d4340a6355f', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'type': 'disk', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'specParams': {}, 'readonly': 'false', 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'deviceId': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '2968ded5-39b3-4eaa-9838-d3be56872ba7'}, {'device': 'scsi', 'specParams': {}, 'model': 'virtio-scsi', 'type': 'controller', 'deviceId': 'd64f7684-c3ce-44b5-b72d-9878704e9bfc'}], 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [182e1dd] >Thread-287653::INFO::2014-01-16 17:11:13,800::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-287653::INFO::2014-01-16 17:11:13,800::clientIF::393::vds::(createVm) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-287654::DEBUG::2014-01-16 17:11:13,803::vm::2115::vm.Vm::(_startUnderlyingVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Start >Thread-287653::DEBUG::2014-01-16 17:11:13,803::clientIF::406::vds::(createVm) Total desktops after creation of 10bce6b5-ab25-452b-a8e2-24309deae8b7 is 32 >Thread-287654::DEBUG::2014-01-16 17:11:13,803::vm::2119::vm.Vm::(_startUnderlyingVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::_ongoingCreations acquired >Thread-287653::DEBUG::2014-01-16 17:11:13,804::BindingXMLRPC::991::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '062b5e0e-cd14-451b-9a09-a0f8a0f0f0fe'}, {'index': '2', 'iface': 'ide', 'bootOrder': '1', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '94db6d62-6a07-4203-9d13-7d4340a6355f', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'type': 'disk', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'specParams': {}, 'readonly': 'false', 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'deviceId': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '2968ded5-39b3-4eaa-9838-d3be56872ba7'}, {'device': 'scsi', 'specParams': {}, 'model': 'virtio-scsi', 'type': 'controller', 'deviceId': 'd64f7684-c3ce-44b5-b72d-9878704e9bfc'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'pbajenez-RHEL_6.5', 'display': 'qxl', 'nice': '0'}} >Thread-287654::INFO::2014-01-16 17:11:13,804::vm::2969::vm.Vm::(_run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::VM wrapper has started >Thread-287654::DEBUG::2014-01-16 17:11:13,806::task::579::TaskManager.Task::(_updateState) Task=`a8b6726f-95b7-43d9-ab9f-bc38803e46ad`::moving from state init -> state preparing >Thread-287654::INFO::2014-01-16 17:11:13,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287654::DEBUG::2014-01-16 17:11:13,807::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-287654::DEBUG::2014-01-16 17:11:13,808::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-287654::DEBUG::2014-01-16 17:11:14,061::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:11:14,090::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:11:14,093::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:11:14,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:11:14,341::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:11:14,379::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:11:14,386::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:11:14,400::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:11:14,411::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:11:14,414::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:11:14,415::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-287654::DEBUG::2014-01-16 17:11:14,462::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287654::DEBUG::2014-01-16 17:11:14,464::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287654::INFO::2014-01-16 17:11:14,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287654::DEBUG::2014-01-16 17:11:14,468::task::1168::TaskManager.Task::(prepare) Task=`a8b6726f-95b7-43d9-ab9f-bc38803e46ad`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287654::DEBUG::2014-01-16 17:11:14,471::task::579::TaskManager.Task::(_updateState) Task=`a8b6726f-95b7-43d9-ab9f-bc38803e46ad`::moving from state preparing -> state finished >Thread-287654::DEBUG::2014-01-16 17:11:14,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287654::DEBUG::2014-01-16 17:11:14,474::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287654::DEBUG::2014-01-16 17:11:14,476::task::974::TaskManager.Task::(_decref) Task=`a8b6726f-95b7-43d9-ab9f-bc38803e46ad`::ref 0 aborting False >Thread-287654::INFO::2014-01-16 17:11:14,479::clientIF::352::vds::(prepareVolumePath) prepared volume path: >Thread-17177::DEBUG::2014-01-16 17:11:14,481::task::579::TaskManager.Task::(_updateState) Task=`9e237a5e-3c90-4b6b-80c8-7b7aa1b8ad96`::moving from state init -> state preparing >Thread-287654::DEBUG::2014-01-16 17:11:14,486::task::579::TaskManager.Task::(_updateState) Task=`9094be38-3759-4e72-81ff-8928140c76cf`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:11:14,487::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-287654::INFO::2014-01-16 17:11:14,491::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', leafUUID='8688815d-b239-43d4-8688-813810a9b6b6') >Thread-17177::INFO::2014-01-16 17:11:14,493::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:11:14,496::task::1168::TaskManager.Task::(prepare) Task=`9e237a5e-3c90-4b6b-80c8-7b7aa1b8ad96`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:11:14,500::task::579::TaskManager.Task::(_updateState) Task=`9e237a5e-3c90-4b6b-80c8-7b7aa1b8ad96`::moving from state preparing -> state finished >Thread-287654::DEBUG::2014-01-16 17:11:14,500::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02`ReqID=`632e58b1-af40-4ae3-8d82-4de442c9e228`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-17177::DEBUG::2014-01-16 17:11:14,503::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287654::DEBUG::2014-01-16 17:11:14,503::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' for lock type 'shared' >Thread-17177::DEBUG::2014-01-16 17:11:14,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2014-01-16 17:11:14,507::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-287654::DEBUG::2014-01-16 17:11:14,508::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' is free. Now locking as 'shared' (1 active user) >Thread-17177::DEBUG::2014-01-16 17:11:14,509::task::974::TaskManager.Task::(_decref) Task=`9e237a5e-3c90-4b6b-80c8-7b7aa1b8ad96`::ref 0 aborting False >Thread-287654::DEBUG::2014-01-16 17:11:14,534::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02`ReqID=`632e58b1-af40-4ae3-8d82-4de442c9e228`::Granted request >Thread-287654::DEBUG::2014-01-16 17:11:14,538::task::811::TaskManager.Task::(resourceAcquired) Task=`9094be38-3759-4e72-81ff-8928140c76cf`::_resourcesAcquired: Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (shared) >Thread-287654::DEBUG::2014-01-16 17:11:14,541::task::974::TaskManager.Task::(_decref) Task=`9094be38-3759-4e72-81ff-8928140c76cf`::ref 1 aborting False >Thread-287654::DEBUG::2014-01-16 17:11:14,544::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-01-16 17:11:14,549::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026707 s, 1.4 MB/s\n'; <rc> = 0 >Thread-287654::DEBUG::2014-01-16 17:11:14,553::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-287654::DEBUG::2014-01-16 17:11:14,749::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:11:14,783::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-26403::DEBUG::2014-01-16 17:11:14,945::task::579::TaskManager.Task::(_updateState) Task=`67605d08-8d68-4aa0-9273-d3739a1b8394`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:11:14,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:11:14,954::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:11:14,956::task::1168::TaskManager.Task::(prepare) Task=`67605d08-8d68-4aa0-9273-d3739a1b8394`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:11:14,959::task::579::TaskManager.Task::(_updateState) Task=`67605d08-8d68-4aa0-9273-d3739a1b8394`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:11:14,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:11:14,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:11:14,966::task::974::TaskManager.Task::(_decref) Task=`67605d08-8d68-4aa0-9273-d3739a1b8394`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:15,100::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:11:15,103::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:11:15,105::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:11:15,107::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287654::DEBUG::2014-01-16 17:11:15,121::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287654::DEBUG::2014-01-16 17:11:15,121::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287654::DEBUG::2014-01-16 17:11:15,125::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/8688815d-b239-43d4-8688-813810a9b6b6' (cwd None) >Thread-287654::DEBUG::2014-01-16 17:11:15,495::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287654::DEBUG::2014-01-16 17:11:15,496::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-287654::DEBUG::2014-01-16 17:11:15,496::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-287654::DEBUG::2014-01-16 17:11:15,497::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-287654::DEBUG::2014-01-16 17:11:15,498::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-287654::DEBUG::2014-01-16 17:11:15,704::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287654::DEBUG::2014-01-16 17:11:16,026::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287654::DEBUG::2014-01-16 17:11:16,026::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287654::INFO::2014-01-16 17:11:16,027::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'imgVolumesInfo': [{'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}]} >Thread-287654::DEBUG::2014-01-16 17:11:16,027::task::1168::TaskManager.Task::(prepare) Task=`9094be38-3759-4e72-81ff-8928140c76cf`::finished: {'info': {'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'imgVolumesInfo': [{'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}]} >Thread-287654::DEBUG::2014-01-16 17:11:16,027::task::579::TaskManager.Task::(_updateState) Task=`9094be38-3759-4e72-81ff-8928140c76cf`::moving from state preparing -> state finished >Thread-287654::DEBUG::2014-01-16 17:11:16,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': < ResourceRef 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', isValid: 'True' obj: 'None'>} >Thread-287654::DEBUG::2014-01-16 17:11:16,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287654::DEBUG::2014-01-16 17:11:16,028::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' >Thread-287654::DEBUG::2014-01-16 17:11:16,028::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (0 active users) >Thread-287654::DEBUG::2014-01-16 17:11:16,028::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' is free, finding out if anyone is waiting for it. >Thread-287654::DEBUG::2014-01-16 17:11:16,028::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', Clearing records. >Thread-287654::DEBUG::2014-01-16 17:11:16,029::task::974::TaskManager.Task::(_decref) Task=`9094be38-3759-4e72-81ff-8928140c76cf`::ref 0 aborting False >Thread-287654::INFO::2014-01-16 17:11:16,029::clientIF::352::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6 >Thread-287654::DEBUG::2014-01-16 17:11:16,040::vm::3031::vm.Vm::(_run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>pbajenez-RHEL_6.5</name> > <uuid>10bce6b5-ab25-452b-a8e2-24309deae8b7</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu>1</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <controller model="virtio-scsi" type="scsi"/> > <video> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > <boot order="1"/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <source dev="/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6"/> > <target bus="virtio" dev="vda"/> > <serial>2a34e0d0-6658-4ed4-ade1-f78c3c6919fa</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> > </disk> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.5.0.1.el6</entry> > <entry name="serial">06BD148D-3986-35A8-840D-259FB621438F</entry> > <entry name="uuid">10bce6b5-ab25-452b-a8e2-24309deae8b7</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Westmere</model> > <topology cores="1" sockets="1" threads="1"/> > </cpu> ></domain> > >Thread-22::DEBUG::2014-01-16 17:11:16,058::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:11:16,076::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00031652 s, 12.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:11:16,110::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:11:16,182::task::579::TaskManager.Task::(_updateState) Task=`391f1616-afe2-474f-b7d7-5ef44d790393`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:11:16,182::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:11:16,183::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:11:16,183::task::1168::TaskManager.Task::(prepare) Task=`391f1616-afe2-474f-b7d7-5ef44d790393`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:11:16,183::task::579::TaskManager.Task::(_updateState) Task=`391f1616-afe2-474f-b7d7-5ef44d790393`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:11:16,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:11:16,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:11:16,183::task::974::TaskManager.Task::(_decref) Task=`391f1616-afe2-474f-b7d7-5ef44d790393`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:11:16,588::task::579::TaskManager.Task::(_updateState) Task=`612eceae-d47f-4fb7-97bd-cc240d05762c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:11:16,588::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:11:16,589::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:11:16,589::task::1168::TaskManager.Task::(prepare) Task=`612eceae-d47f-4fb7-97bd-cc240d05762c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:11:16,589::task::579::TaskManager.Task::(_updateState) Task=`612eceae-d47f-4fb7-97bd-cc240d05762c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:11:16,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:11:16,589::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:11:16,589::task::974::TaskManager.Task::(_decref) Task=`612eceae-d47f-4fb7-97bd-cc240d05762c`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:11:16,590::task::579::TaskManager.Task::(_updateState) Task=`24736daf-1d12-43c0-9b4b-4922356d5b3c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:11:16,590::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:11:16,590::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >libvirtEventLoop::DEBUG::2014-01-16 17:11:16,591::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::event Started detail 0 opaque None >Thread-17110::DEBUG::2014-01-16 17:11:16,594::task::1168::TaskManager.Task::(prepare) Task=`24736daf-1d12-43c0-9b4b-4922356d5b3c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:11:16,596::task::579::TaskManager.Task::(_updateState) Task=`24736daf-1d12-43c0-9b4b-4922356d5b3c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:11:16,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:11:16,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:11:16,601::task::974::TaskManager.Task::(_decref) Task=`24736daf-1d12-43c0-9b4b-4922356d5b3c`::ref 0 aborting False >Thread-287654::DEBUG::2014-01-16 17:11:16,675::sampling::285::vm.Vm::(start) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Start statistics collection >Thread-287658::DEBUG::2014-01-16 17:11:16,675::sampling::314::vm.Vm::(run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Stats thread started >Thread-287658::DEBUG::2014-01-16 17:11:16,677::task::579::TaskManager.Task::(_updateState) Task=`87397ba3-6e76-4e02-97af-3338ffdf852d`::moving from state init -> state preparing >Thread-287658::INFO::2014-01-16 17:11:16,678::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287658::INFO::2014-01-16 17:11:16,678::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287658::DEBUG::2014-01-16 17:11:16,678::task::1168::TaskManager.Task::(prepare) Task=`87397ba3-6e76-4e02-97af-3338ffdf852d`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287658::DEBUG::2014-01-16 17:11:16,678::task::579::TaskManager.Task::(_updateState) Task=`87397ba3-6e76-4e02-97af-3338ffdf852d`::moving from state preparing -> state finished >Thread-287658::DEBUG::2014-01-16 17:11:16,678::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287658::DEBUG::2014-01-16 17:11:16,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287658::DEBUG::2014-01-16 17:11:16,679::task::974::TaskManager.Task::(_decref) Task=`87397ba3-6e76-4e02-97af-3338ffdf852d`::ref 0 aborting False >Thread-287654::DEBUG::2014-01-16 17:11:16,701::vmChannels::194::vds::(register) Add fileno 62 to listener's channels. >Thread-287654::WARNING::2014-01-16 17:11:16,704::vm::3536::vm.Vm::(_readPauseCode) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::_readPauseCode unsupported by libvirt vm >Thread-287654::DEBUG::2014-01-16 17:11:16,712::vm::2136::vm.Vm::(_startUnderlyingVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::_ongoingCreations released >Thread-189817::DEBUG::2014-01-16 17:11:16,802::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:16,806::task::579::TaskManager.Task::(_updateState) Task=`759eb498-9738-4b8e-9deb-d8e04cfefaca`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:11:16,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:11:16,810::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:11:16,812::task::1168::TaskManager.Task::(prepare) Task=`759eb498-9738-4b8e-9deb-d8e04cfefaca`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:11:16,813::task::579::TaskManager.Task::(_updateState) Task=`759eb498-9738-4b8e-9deb-d8e04cfefaca`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:11:16,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:11:16,816::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:11:16,817::task::974::TaskManager.Task::(_decref) Task=`759eb498-9738-4b8e-9deb-d8e04cfefaca`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:16,820::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:11:16,821::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:11:16,824::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:16,827::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:16,828::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84402::DEBUG::2014-01-16 17:11:17,077::task::579::TaskManager.Task::(_updateState) Task=`7980abc5-6e38-4d31-a973-623b61a5bf6c`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:11:17,077::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:11:17,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:11:17,078::task::1168::TaskManager.Task::(prepare) Task=`7980abc5-6e38-4d31-a973-623b61a5bf6c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:11:17,078::task::579::TaskManager.Task::(_updateState) Task=`7980abc5-6e38-4d31-a973-623b61a5bf6c`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:11:17,078::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:11:17,078::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:11:17,079::task::974::TaskManager.Task::(_decref) Task=`7980abc5-6e38-4d31-a973-623b61a5bf6c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:17,116::vmChannels::102::vds::(_do_add_channels) fileno 62 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-01-16 17:11:17,117::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:11:17,117::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:17,117::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:11:17,117::guestIF::147::vm.Vm::(_connect) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Attempting connection to /var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:11:17,118::guestIF::150::vm.Vm::(_connect) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Connected to /var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:11:17,118::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 62 succeeded. >Thread-287660::DEBUG::2014-01-16 17:11:18,066::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287660::DEBUG::2014-01-16 17:11:18,066::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287660::DEBUG::2014-01-16 17:11:18,066::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287660::DEBUG::2014-01-16 17:11:18,067::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287660::DEBUG::2014-01-16 17:11:18,067::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287660::DEBUG::2014-01-16 17:11:18,067::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287660::DEBUG::2014-01-16 17:11:18,068::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.39', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:11:18,119::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:18,829::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:19,120::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:11:19,675::task::579::TaskManager.Task::(_updateState) Task=`1fd6d11f-65ca-4b35-991f-549990674b59`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:11:19,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:11:19,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:11:19,677::task::1168::TaskManager.Task::(prepare) Task=`1fd6d11f-65ca-4b35-991f-549990674b59`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:11:19,677::task::579::TaskManager.Task::(_updateState) Task=`1fd6d11f-65ca-4b35-991f-549990674b59`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:11:19,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:11:19,678::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:11:19,678::task::974::TaskManager.Task::(_decref) Task=`1fd6d11f-65ca-4b35-991f-549990674b59`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:20,121::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:11:20,593::task::579::TaskManager.Task::(_updateState) Task=`63388592-da2b-47eb-8f7d-fc656044e0f4`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:11:20,594::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:11:20,594::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:11:20,594::task::1168::TaskManager.Task::(prepare) Task=`63388592-da2b-47eb-8f7d-fc656044e0f4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:11:20,595::task::579::TaskManager.Task::(_updateState) Task=`63388592-da2b-47eb-8f7d-fc656044e0f4`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:11:20,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:11:20,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:11:20,595::task::974::TaskManager.Task::(_decref) Task=`63388592-da2b-47eb-8f7d-fc656044e0f4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:20,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:21,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287662::DEBUG::2014-01-16 17:11:21,274::task::579::TaskManager.Task::(_updateState) Task=`27329eb7-ce62-4e9b-bdd5-df8472666a69`::moving from state init -> state preparing >Thread-287662::INFO::2014-01-16 17:11:21,275::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287662::INFO::2014-01-16 17:11:21,275::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026707', 'lastCheck': '6.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031652', 'lastCheck': '5.2', 'valid': True}} >Thread-287662::DEBUG::2014-01-16 17:11:21,275::task::1168::TaskManager.Task::(prepare) Task=`27329eb7-ce62-4e9b-bdd5-df8472666a69`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00026707', 'lastCheck': '6.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031652', 'lastCheck': '5.2', 'valid': True}} >Thread-287662::DEBUG::2014-01-16 17:11:21,275::task::579::TaskManager.Task::(_updateState) Task=`27329eb7-ce62-4e9b-bdd5-df8472666a69`::moving from state preparing -> state finished >Thread-287662::DEBUG::2014-01-16 17:11:21,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287662::DEBUG::2014-01-16 17:11:21,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287662::DEBUG::2014-01-16 17:11:21,276::task::974::TaskManager.Task::(_decref) Task=`27329eb7-ce62-4e9b-bdd5-df8472666a69`::ref 0 aborting False >Thread-287663::DEBUG::2014-01-16 17:11:21,385::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287663::DEBUG::2014-01-16 17:11:21,386::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287663::DEBUG::2014-01-16 17:11:21,387::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287663::DEBUG::2014-01-16 17:11:21,387::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287663::DEBUG::2014-01-16 17:11:21,387::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-48934::DEBUG::2014-01-16 17:11:21,628::task::579::TaskManager.Task::(_updateState) Task=`6168c193-a6e7-4e28-8e50-0d4d3d5357e9`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:11:21,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:11:21,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:11:21,629::task::1168::TaskManager.Task::(prepare) Task=`6168c193-a6e7-4e28-8e50-0d4d3d5357e9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:11:21,629::task::579::TaskManager.Task::(_updateState) Task=`6168c193-a6e7-4e28-8e50-0d4d3d5357e9`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:11:21,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:11:21,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:11:21,629::task::974::TaskManager.Task::(_decref) Task=`6168c193-a6e7-4e28-8e50-0d4d3d5357e9`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:11:21,630::task::579::TaskManager.Task::(_updateState) Task=`a49d6480-c72f-4ad3-8dcd-9372371c39a1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:11:21,630::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:11:21,630::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:11:21,630::task::1168::TaskManager.Task::(prepare) Task=`a49d6480-c72f-4ad3-8dcd-9372371c39a1`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:11:21,630::task::579::TaskManager.Task::(_updateState) Task=`a49d6480-c72f-4ad3-8dcd-9372371c39a1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:11:21,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:11:21,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:11:21,631::task::974::TaskManager.Task::(_decref) Task=`a49d6480-c72f-4ad3-8dcd-9372371c39a1`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:11:21,631::task::579::TaskManager.Task::(_updateState) Task=`36b279b8-4727-48f6-8fbf-937080aaf409`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:11:21,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:11:21,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:11:21,632::task::1168::TaskManager.Task::(prepare) Task=`36b279b8-4727-48f6-8fbf-937080aaf409`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:11:21,632::task::579::TaskManager.Task::(_updateState) Task=`36b279b8-4727-48f6-8fbf-937080aaf409`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:11:21,632::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:11:21,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:11:21,632::task::974::TaskManager.Task::(_decref) Task=`36b279b8-4727-48f6-8fbf-937080aaf409`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:21,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:22,123::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:22,832::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:23,124::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:11:23,124::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:11:23,821::task::579::TaskManager.Task::(_updateState) Task=`586de851-324e-484d-9746-ec569a32ed3c`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:11:23,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:11:23,822::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:11:23,822::task::1168::TaskManager.Task::(prepare) Task=`586de851-324e-484d-9746-ec569a32ed3c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:11:23,822::task::579::TaskManager.Task::(_updateState) Task=`586de851-324e-484d-9746-ec569a32ed3c`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:11:23,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:11:23,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:11:23,823::task::974::TaskManager.Task::(_decref) Task=`586de851-324e-484d-9746-ec569a32ed3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:24,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:11:24,577::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:11:24,594::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000320444 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:11:24,834::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287665::DEBUG::2014-01-16 17:11:24,914::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287665::DEBUG::2014-01-16 17:11:24,915::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287665::DEBUG::2014-01-16 17:11:24,915::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287665::DEBUG::2014-01-16 17:11:24,915::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287665::DEBUG::2014-01-16 17:11:24,915::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287665::DEBUG::2014-01-16 17:11:24,915::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287665::DEBUG::2014-01-16 17:11:24,917::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.20', 'elapsedTime': '11', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:11:25,127::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:11:26,084::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:11:26,107::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000276487 s, 14.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:11:26,130::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:26,837::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:26,839::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:27,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:11:27,194::task::579::TaskManager.Task::(_updateState) Task=`23e3d591-6956-4525-89c4-270cb25aaa9b`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:11:27,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:11:27,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:11:27,196::task::1168::TaskManager.Task::(prepare) Task=`23e3d591-6956-4525-89c4-270cb25aaa9b`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:11:27,196::task::579::TaskManager.Task::(_updateState) Task=`23e3d591-6956-4525-89c4-270cb25aaa9b`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:11:27,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:11:27,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:11:27,196::task::974::TaskManager.Task::(_decref) Task=`23e3d591-6956-4525-89c4-270cb25aaa9b`::ref 0 aborting False >Thread-287666::DEBUG::2014-01-16 17:11:27,237::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmSetTicket with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', 'dq3VWTgm9asl', '120', 'disconnect', {'userName': 'rhevadmin', 'userId': '88011004-16db-11e2-9b90-001a4a0cff04'}) {} flowID [76948b7] >Thread-287666::DEBUG::2014-01-16 17:11:27,254::BindingXMLRPC::991::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >VM Channels Listener::DEBUG::2014-01-16 17:11:28,132::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:11:28,132::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:11:28,132::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287668::DEBUG::2014-01-16 17:11:28,183::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [28ecfacc] >Thread-287668::DEBUG::2014-01-16 17:11:28,183::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287668::DEBUG::2014-01-16 17:11:28,183::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287668::DEBUG::2014-01-16 17:11:28,183::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287668::DEBUG::2014-01-16 17:11:28,184::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287668::DEBUG::2014-01-16 17:11:28,184::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287668::DEBUG::2014-01-16 17:11:28,185::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.47', 'elapsedTime': '14', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:11:28,840::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:29,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:11:29,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:30,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:11:30,135::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:11:30,135::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,451::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,514::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,522::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,554::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,587::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,587::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,648::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:30,649::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >Thread-189817::DEBUG::2014-01-16 17:11:30,842::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:31,136::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:11:31,137::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287670::DEBUG::2014-01-16 17:11:31,295::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287670::DEBUG::2014-01-16 17:11:31,295::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287670::DEBUG::2014-01-16 17:11:31,295::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287670::DEBUG::2014-01-16 17:11:31,295::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287670::DEBUG::2014-01-16 17:11:31,296::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287670::DEBUG::2014-01-16 17:11:31,296::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287670::DEBUG::2014-01-16 17:11:31,297::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'elapsedTime': '17', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189046::DEBUG::2014-01-16 17:11:31,709::task::579::TaskManager.Task::(_updateState) Task=`463b873b-529a-44d7-bf99-ff85202e56eb`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:11:31,709::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:11:31,710::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:11:31,710::task::1168::TaskManager.Task::(prepare) Task=`463b873b-529a-44d7-bf99-ff85202e56eb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:11:31,710::task::579::TaskManager.Task::(_updateState) Task=`463b873b-529a-44d7-bf99-ff85202e56eb`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:11:31,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:11:31,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:11:31,711::task::974::TaskManager.Task::(_decref) Task=`463b873b-529a-44d7-bf99-ff85202e56eb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:31,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:11:31,844::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:11:31,852::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:32,138::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:11:32,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:32,853::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:33,139::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:34,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:11:34,141::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287672::DEBUG::2014-01-16 17:11:34,403::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287672::DEBUG::2014-01-16 17:11:34,404::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287672::DEBUG::2014-01-16 17:11:34,404::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287672::DEBUG::2014-01-16 17:11:34,404::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287672::DEBUG::2014-01-16 17:11:34,404::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287672::DEBUG::2014-01-16 17:11:34,407::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '2.35', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.69', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '1.53', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:11:34,603::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:11:34,620::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000294846 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:11:34,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:35,143::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:11:35,143::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:11:35,512::task::579::TaskManager.Task::(_updateState) Task=`08876a11-6bfc-4482-9836-2afee025556c`::moving from state init -> state preparing >Thread-59295::DEBUG::2014-01-16 17:11:35,512::task::579::TaskManager.Task::(_updateState) Task=`9435f05e-14d1-4f20-bbc8-ed14bebb6af4`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:11:35,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-59295::INFO::2014-01-16 17:11:35,515::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-3175::INFO::2014-01-16 17:11:35,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::INFO::2014-01-16 17:11:35,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 17:11:35,519::task::1168::TaskManager.Task::(prepare) Task=`08876a11-6bfc-4482-9836-2afee025556c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:11:35,520::task::579::TaskManager.Task::(_updateState) Task=`08876a11-6bfc-4482-9836-2afee025556c`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:11:35,521::task::1168::TaskManager.Task::(prepare) Task=`9435f05e-14d1-4f20-bbc8-ed14bebb6af4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 17:11:35,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:11:35,523::task::579::TaskManager.Task::(_updateState) Task=`9435f05e-14d1-4f20-bbc8-ed14bebb6af4`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:11:35,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:11:35,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:11:35,526::task::974::TaskManager.Task::(_decref) Task=`08876a11-6bfc-4482-9836-2afee025556c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:11:35,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:11:35,527::task::974::TaskManager.Task::(_decref) Task=`9435f05e-14d1-4f20-bbc8-ed14bebb6af4`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:11:36,114::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:11:36,133::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000190001 s, 21.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:11:36,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:11:36,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:11:36,145::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:11:36,145::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:36,857::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:36,858::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:37,146::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:11:37,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:11:37,152::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287673::DEBUG::2014-01-16 17:11:37,487::task::579::TaskManager.Task::(_updateState) Task=`4937057e-8496-44d7-a7e6-b614613c27d2`::moving from state init -> state preparing >Thread-287673::INFO::2014-01-16 17:11:37,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287673::INFO::2014-01-16 17:11:37,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294846', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000190001', 'lastCheck': '1.4', 'valid': True}} >Thread-287673::DEBUG::2014-01-16 17:11:37,488::task::1168::TaskManager.Task::(prepare) Task=`4937057e-8496-44d7-a7e6-b614613c27d2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000294846', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000190001', 'lastCheck': '1.4', 'valid': True}} >Thread-287673::DEBUG::2014-01-16 17:11:37,488::task::579::TaskManager.Task::(_updateState) Task=`4937057e-8496-44d7-a7e6-b614613c27d2`::moving from state preparing -> state finished >Thread-287673::DEBUG::2014-01-16 17:11:37,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287673::DEBUG::2014-01-16 17:11:37,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287673::DEBUG::2014-01-16 17:11:37,488::task::974::TaskManager.Task::(_decref) Task=`4937057e-8496-44d7-a7e6-b614613c27d2`::ref 0 aborting False >Thread-287674::DEBUG::2014-01-16 17:11:37,594::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287674::DEBUG::2014-01-16 17:11:37,594::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287674::DEBUG::2014-01-16 17:11:37,595::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287674::DEBUG::2014-01-16 17:11:37,595::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-48925::DEBUG::2014-01-16 17:11:37,911::task::579::TaskManager.Task::(_updateState) Task=`d17b5a30-c1b5-4ab1-8117-703b028845d5`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:11:37,911::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:11:37,912::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:11:37,912::task::1168::TaskManager.Task::(prepare) Task=`d17b5a30-c1b5-4ab1-8117-703b028845d5`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:11:37,912::task::579::TaskManager.Task::(_updateState) Task=`d17b5a30-c1b5-4ab1-8117-703b028845d5`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:11:37,912::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:11:37,912::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:11:37,912::task::974::TaskManager.Task::(_decref) Task=`d17b5a30-c1b5-4ab1-8117-703b028845d5`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:11:37,913::task::579::TaskManager.Task::(_updateState) Task=`5f9d61f1-b0d7-45fa-9f8e-496525c1c9d3`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:11:37,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:11:37,913::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:11:37,913::task::1168::TaskManager.Task::(prepare) Task=`5f9d61f1-b0d7-45fa-9f8e-496525c1c9d3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:11:37,913::task::579::TaskManager.Task::(_updateState) Task=`5f9d61f1-b0d7-45fa-9f8e-496525c1c9d3`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:11:37,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:11:37,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:11:37,914::task::974::TaskManager.Task::(_decref) Task=`5f9d61f1-b0d7-45fa-9f8e-496525c1c9d3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:38,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:11:38,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:38,859::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:39,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:11:39,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:11:39,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:11:39,154::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:40,155::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:11:40,659::task::579::TaskManager.Task::(_updateState) Task=`f9f35640-ec00-4c9f-b7f4-2d1d7c3ac0fc`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:11:40,659::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:11:40,659::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:11:40,659::task::1168::TaskManager.Task::(prepare) Task=`f9f35640-ec00-4c9f-b7f4-2d1d7c3ac0fc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:11:40,660::task::579::TaskManager.Task::(_updateState) Task=`f9f35640-ec00-4c9f-b7f4-2d1d7c3ac0fc`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:11:40,660::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:11:40,660::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:11:40,660::task::974::TaskManager.Task::(_decref) Task=`f9f35640-ec00-4c9f-b7f4-2d1d7c3ac0fc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:40,861::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:41,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:11:41,156::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:11:41,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:11:41,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:41,157::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:11:41,159::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-287676::DEBUG::2014-01-16 17:11:41,179::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287676::DEBUG::2014-01-16 17:11:41,179::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287676::DEBUG::2014-01-16 17:11:41,179::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287676::DEBUG::2014-01-16 17:11:41,179::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287676::DEBUG::2014-01-16 17:11:41,179::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287676::DEBUG::2014-01-16 17:11:41,180::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '2.35', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.46', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '1.53', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:11:41,862::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:42,159::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:42,863::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 17:11:42,878::task::579::TaskManager.Task::(_updateState) Task=`43970a68-d34f-478a-920e-ec8cdd592ece`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:11:42,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:11:42,878::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:11:42,878::task::1168::TaskManager.Task::(prepare) Task=`43970a68-d34f-478a-920e-ec8cdd592ece`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:11:42,879::task::579::TaskManager.Task::(_updateState) Task=`43970a68-d34f-478a-920e-ec8cdd592ece`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:11:42,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:11:42,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:11:42,879::task::974::TaskManager.Task::(_decref) Task=`43970a68-d34f-478a-920e-ec8cdd592ece`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:43,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:11:43,161::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:11:43,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16393::DEBUG::2014-01-16 17:11:43,737::task::579::TaskManager.Task::(_updateState) Task=`ccb74257-36b3-47aa-bd29-df4b6ed79202`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:11:43,737::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:11:43,738::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:11:43,738::task::1168::TaskManager.Task::(prepare) Task=`ccb74257-36b3-47aa-bd29-df4b6ed79202`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:11:43,738::task::579::TaskManager.Task::(_updateState) Task=`ccb74257-36b3-47aa-bd29-df4b6ed79202`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:11:43,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:11:43,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:11:43,738::task::974::TaskManager.Task::(_decref) Task=`ccb74257-36b3-47aa-bd29-df4b6ed79202`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:11:43,916::task::579::TaskManager.Task::(_updateState) Task=`d8c2881d-ad80-4051-99d1-c048154831c5`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:11:43,917::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:11:43,917::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:11:43,917::task::1168::TaskManager.Task::(prepare) Task=`d8c2881d-ad80-4051-99d1-c048154831c5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:11:43,917::task::579::TaskManager.Task::(_updateState) Task=`d8c2881d-ad80-4051-99d1-c048154831c5`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:11:43,917::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:11:43,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:11:43,918::task::974::TaskManager.Task::(_decref) Task=`d8c2881d-ad80-4051-99d1-c048154831c5`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:11:43,935::task::579::TaskManager.Task::(_updateState) Task=`7ee7cd65-4471-4c0d-a76d-cd5c5b0c1475`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:11:43,935::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:11:43,936::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:11:43,936::task::1168::TaskManager.Task::(prepare) Task=`7ee7cd65-4471-4c0d-a76d-cd5c5b0c1475`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:11:43,936::task::579::TaskManager.Task::(_updateState) Task=`7ee7cd65-4471-4c0d-a76d-cd5c5b0c1475`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:11:43,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:11:43,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:11:43,936::task::974::TaskManager.Task::(_decref) Task=`7ee7cd65-4471-4c0d-a76d-cd5c5b0c1475`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:44,162::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:11:44,163::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:11:44,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287678::DEBUG::2014-01-16 17:11:44,413::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287678::DEBUG::2014-01-16 17:11:44,413::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287678::DEBUG::2014-01-16 17:11:44,413::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287678::DEBUG::2014-01-16 17:11:44,413::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287678::DEBUG::2014-01-16 17:11:44,414::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287678::DEBUG::2014-01-16 17:11:44,415::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '2.35', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.69', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '1.53', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:11:44,627::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:11:44,644::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275637 s, 1.3 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 17:11:44,668::task::579::TaskManager.Task::(_updateState) Task=`dda3a282-6fd7-42a0-8913-c7c5b833bcd4`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:11:44,668::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:11:44,669::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:11:44,669::task::1168::TaskManager.Task::(prepare) Task=`dda3a282-6fd7-42a0-8913-c7c5b833bcd4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:11:44,669::task::579::TaskManager.Task::(_updateState) Task=`dda3a282-6fd7-42a0-8913-c7c5b833bcd4`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:11:44,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:11:44,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:11:44,670::task::974::TaskManager.Task::(_decref) Task=`dda3a282-6fd7-42a0-8913-c7c5b833bcd4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:44,864::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-12152::DEBUG::2014-01-16 17:11:44,878::task::579::TaskManager.Task::(_updateState) Task=`de3c9577-0a1d-48be-9f5e-bb2c2cd86024`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:11:44,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:11:44,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:11:44,879::task::1168::TaskManager.Task::(prepare) Task=`de3c9577-0a1d-48be-9f5e-bb2c2cd86024`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:11:44,879::task::579::TaskManager.Task::(_updateState) Task=`de3c9577-0a1d-48be-9f5e-bb2c2cd86024`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:11:44,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:11:44,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:11:44,879::task::974::TaskManager.Task::(_decref) Task=`de3c9577-0a1d-48be-9f5e-bb2c2cd86024`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:45,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:11:45,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:11:45,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:11:45,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:11:46,139::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:11:46,158::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000345365 s, 11.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:11:46,165::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:46,866::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:46,868::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:11:46,868::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:11:46,869::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:47,166::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:11:47,167::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:11:47,167::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287680::DEBUG::2014-01-16 17:11:47,518::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287680::DEBUG::2014-01-16 17:11:47,518::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287680::DEBUG::2014-01-16 17:11:47,518::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287680::DEBUG::2014-01-16 17:11:47,519::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287680::DEBUG::2014-01-16 17:11:47,519::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287680::DEBUG::2014-01-16 17:11:47,520::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.80', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:11:48,168::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:11:48,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:49,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:11:50,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287682::DEBUG::2014-01-16 17:11:50,616::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287682::DEBUG::2014-01-16 17:11:50,617::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287682::DEBUG::2014-01-16 17:11:50,617::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287682::DEBUG::2014-01-16 17:11:50,617::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287682::DEBUG::2014-01-16 17:11:50,617::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287682::DEBUG::2014-01-16 17:11:50,618::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.89', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:11:50,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:51,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:11:51,682::task::579::TaskManager.Task::(_updateState) Task=`ae24bd1c-74e0-434f-b637-62947625dca3`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:11:51,683::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:11:51,683::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:11:51,683::task::1168::TaskManager.Task::(prepare) Task=`ae24bd1c-74e0-434f-b637-62947625dca3`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:11:51,683::task::579::TaskManager.Task::(_updateState) Task=`ae24bd1c-74e0-434f-b637-62947625dca3`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:11:51,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:11:51,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:11:51,684::task::974::TaskManager.Task::(_decref) Task=`ae24bd1c-74e0-434f-b637-62947625dca3`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:11:51,684::task::579::TaskManager.Task::(_updateState) Task=`871ecfaf-442e-4e55-bb6e-aba435c2eb58`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:11:51,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:11:51,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:11:51,685::task::1168::TaskManager.Task::(prepare) Task=`871ecfaf-442e-4e55-bb6e-aba435c2eb58`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:11:51,685::task::579::TaskManager.Task::(_updateState) Task=`871ecfaf-442e-4e55-bb6e-aba435c2eb58`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:11:51,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:11:51,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:11:51,685::task::974::TaskManager.Task::(_decref) Task=`871ecfaf-442e-4e55-bb6e-aba435c2eb58`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:11:51,685::task::579::TaskManager.Task::(_updateState) Task=`1cea89e9-39d2-4861-b4dc-331c830cd8ae`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:11:51,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:11:51,686::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:11:51,686::task::1168::TaskManager.Task::(prepare) Task=`1cea89e9-39d2-4861-b4dc-331c830cd8ae`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:11:51,686::task::579::TaskManager.Task::(_updateState) Task=`1cea89e9-39d2-4861-b4dc-331c830cd8ae`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:11:51,686::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:11:51,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:11:51,686::task::974::TaskManager.Task::(_decref) Task=`1cea89e9-39d2-4861-b4dc-331c830cd8ae`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:11:51,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:52,172::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:11:52,327::task::579::TaskManager.Task::(_updateState) Task=`0070a344-7f64-4c01-956a-b67d0c67737a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:11:52,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:11:52,327::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:11:52,327::task::1168::TaskManager.Task::(prepare) Task=`0070a344-7f64-4c01-956a-b67d0c67737a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:11:52,327::task::579::TaskManager.Task::(_updateState) Task=`0070a344-7f64-4c01-956a-b67d0c67737a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:11:52,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:11:52,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:11:52,328::task::974::TaskManager.Task::(_decref) Task=`0070a344-7f64-4c01-956a-b67d0c67737a`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 17:11:52,564::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:52,565::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:52,566::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:52,566::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:11:52,567::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >Thread-189817::DEBUG::2014-01-16 17:11:52,875::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:53,172::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:11:53,173::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287688::DEBUG::2014-01-16 17:11:53,673::task::579::TaskManager.Task::(_updateState) Task=`ce4515d1-1cb3-41b7-bf96-3875ffe4b690`::moving from state init -> state preparing >Thread-287688::INFO::2014-01-16 17:11:53,674::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287688::INFO::2014-01-16 17:11:53,674::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275637', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345365', 'lastCheck': '7.5', 'valid': True}} >Thread-287688::DEBUG::2014-01-16 17:11:53,674::task::1168::TaskManager.Task::(prepare) Task=`ce4515d1-1cb3-41b7-bf96-3875ffe4b690`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275637', 'lastCheck': '9.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345365', 'lastCheck': '7.5', 'valid': True}} >Thread-287688::DEBUG::2014-01-16 17:11:53,674::task::579::TaskManager.Task::(_updateState) Task=`ce4515d1-1cb3-41b7-bf96-3875ffe4b690`::moving from state preparing -> state finished >Thread-287688::DEBUG::2014-01-16 17:11:53,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287688::DEBUG::2014-01-16 17:11:53,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287688::DEBUG::2014-01-16 17:11:53,675::task::974::TaskManager.Task::(_decref) Task=`ce4515d1-1cb3-41b7-bf96-3875ffe4b690`::ref 0 aborting False >Thread-287689::DEBUG::2014-01-16 17:11:53,737::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287689::DEBUG::2014-01-16 17:11:53,737::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287689::DEBUG::2014-01-16 17:11:53,737::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287689::DEBUG::2014-01-16 17:11:53,737::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-01-16 17:11:54,174::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287683::DEBUG::2014-01-16 17:11:54,565::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287684::DEBUG::2014-01-16 17:11:54,566::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287685::DEBUG::2014-01-16 17:11:54,566::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287686::DEBUG::2014-01-16 17:11:54,567::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287687::DEBUG::2014-01-16 17:11:54,568::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-20::DEBUG::2014-01-16 17:11:54,652::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:11:54,669::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000298875 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:11:54,876::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:55,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:11:56,165::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:11:56,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:11:56,185::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000231614 s, 17.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:11:56,878::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:11:56,879::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:57,183::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287691::DEBUG::2014-01-16 17:11:57,226::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287691::DEBUG::2014-01-16 17:11:57,226::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc stats not available >Thread-287691::DEBUG::2014-01-16 17:11:57,227::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287691::DEBUG::2014-01-16 17:11:57,227::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdc latency not available >Thread-287691::DEBUG::2014-01-16 17:11:57,227::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287691::DEBUG::2014-01-16 17:11:57,228::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '26690', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '-5962595591667866208', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.50', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-221160::DEBUG::2014-01-16 17:11:57,484::task::579::TaskManager.Task::(_updateState) Task=`2c1f406d-679e-42c3-8a60-d26cfb3a7072`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:11:57,484::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:11:57,485::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:11:57,485::task::1168::TaskManager.Task::(prepare) Task=`2c1f406d-679e-42c3-8a60-d26cfb3a7072`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:11:57,485::task::579::TaskManager.Task::(_updateState) Task=`2c1f406d-679e-42c3-8a60-d26cfb3a7072`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:11:57,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:11:57,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:11:57,485::task::974::TaskManager.Task::(_decref) Task=`2c1f406d-679e-42c3-8a60-d26cfb3a7072`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:11:58,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:11:58,184::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:11:58,184::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287692::DEBUG::2014-01-16 17:11:58,667::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [6cecbdae] >Thread-287692::INFO::2014-01-16 17:11:58,667::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-287692::DEBUG::2014-01-16 17:11:58,668::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-287692::INFO::2014-01-16 17:11:58,668::vm::4423::vm.Vm::(releaseVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Release VM resources >Thread-287692::DEBUG::2014-01-16 17:11:58,677::sampling::292::vm.Vm::(stop) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Stop statistics collection >Thread-287692::DEBUG::2014-01-16 17:11:58,678::vmChannels::205::vds::(unregister) Delete fileno 62 from listener. >Thread-287658::DEBUG::2014-01-16 17:11:58,678::sampling::323::vm.Vm::(run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Stats thread finished >libvirtEventLoop::DEBUG::2014-01-16 17:11:59,146::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::event Stopped detail 1 opaque None >libvirtEventLoop::INFO::2014-01-16 17:11:59,147::vm::2197::vm.Vm::(_onQemuDeath) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::underlying process disconnected >Thread-287692::WARNING::2014-01-16 17:11:59,146::clientIF::364::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7f455016ccd0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7f455016ccd0>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial><boot order="1"/></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7f455016ccd0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7f455016ccd0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7f455016ccd0>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False bootOrder:1 cache:none conf:{'status': 'Up', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'pid': '26690', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5928', 'displaySecurePort': u'5929', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'custom': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'alias': u'scsi0', 'specParams': {}, 'deviceId': 'd64f7684-c3ce-44b5-b72d-9878704e9bfc', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'deviceId': '062b5e0e-cd14-451b-9a09-a0f8a0f0f0fe', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'bootOrder': u'1', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '94db6d62-6a07-4203-9d13-7d4340a6355f', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '42949672960', 'alias': u'virtio-disk0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'readonly': 'False', 'shared': 'false', 'truesize': '42949672960', 'type': 'disk', 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'reqsize': '0', 'format': 'raw', 'deviceId': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c', 'device': 'disk', 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'specParams': {}, 'volumeChain': [{'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}]}, {'target': 1048576, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '2968ded5-39b3-4eaa-9838-d3be56872ba7', 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'pbajenez-RHEL_6.5', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7f455016ccd0>> device:cdrom deviceId:94db6d62-6a07-4203-9d13-7d4340a6355f drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7f455016ccd0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7f455016ccd0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7f455016ccd0>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7f455016ccd0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7f455016ccd0>> log:<logUtils.SimpleLogAdapter instance at 0x7f45504442d8> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': ''} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912 >Traceback (most recent call last): > File "/usr/share/vdsm/clientIF.py", line 358, in teardownVolumePath > res = self.irs.teardownImage(drive['domainID'], > File "/usr/share/vdsm/vm.py", line 1406, in __getitem__ > raise KeyError(key) >KeyError: 'domainID' >Thread-287692::DEBUG::2014-01-16 17:11:59,149::task::579::TaskManager.Task::(_updateState) Task=`0833b9af-c287-43ad-b7d3-5623d78fc8c3`::moving from state init -> state preparing >Thread-287692::INFO::2014-01-16 17:11:59,149::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID=None) >Thread-287692::DEBUG::2014-01-16 17:11:59,150::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02`ReqID=`290ccfca-f8ea-49dc-9d63-d36d33626c85`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage' >Thread-287692::DEBUG::2014-01-16 17:11:59,150::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' for lock type 'shared' >Thread-287692::DEBUG::2014-01-16 17:11:59,150::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' is free. Now locking as 'shared' (1 active user) >Thread-287692::DEBUG::2014-01-16 17:11:59,150::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02`ReqID=`290ccfca-f8ea-49dc-9d63-d36d33626c85`::Granted request >Thread-287692::DEBUG::2014-01-16 17:11:59,151::task::811::TaskManager.Task::(resourceAcquired) Task=`0833b9af-c287-43ad-b7d3-5623d78fc8c3`::_resourcesAcquired: Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (shared) >Thread-287692::DEBUG::2014-01-16 17:11:59,151::task::974::TaskManager.Task::(_decref) Task=`0833b9af-c287-43ad-b7d3-5623d78fc8c3`::ref 1 aborting False >Thread-287692::DEBUG::2014-01-16 17:11:59,151::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-287692::DEBUG::2014-01-16 17:11:59,152::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:11:59,169::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:11:59,185::vmChannels::112::vds::(_do_del_channels) fileno 62 was removed from listener. >VM Channels Listener::DEBUG::2014-01-16 17:11:59,185::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:11:59,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287692::DEBUG::2014-01-16 17:11:59,392::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287692::DEBUG::2014-01-16 17:11:59,712::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287692::DEBUG::2014-01-16 17:11:59,713::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287692::DEBUG::2014-01-16 17:11:59,716::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/8688815d-b239-43d4-8688-813810a9b6b6' (cwd None) >Thread-287692::DEBUG::2014-01-16 17:11:59,934::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287692::DEBUG::2014-01-16 17:11:59,935::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-287692::DEBUG::2014-01-16 17:11:59,935::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-287692::INFO::2014-01-16 17:11:59,936::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-287692::DEBUG::2014-01-16 17:11:59,936::task::1168::TaskManager.Task::(prepare) Task=`0833b9af-c287-43ad-b7d3-5623d78fc8c3`::finished: None >Thread-287692::DEBUG::2014-01-16 17:11:59,936::task::579::TaskManager.Task::(_updateState) Task=`0833b9af-c287-43ad-b7d3-5623d78fc8c3`::moving from state preparing -> state finished >Thread-287692::DEBUG::2014-01-16 17:11:59,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': < ResourceRef 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', isValid: 'True' obj: 'None'>} >Thread-287692::DEBUG::2014-01-16 17:11:59,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287692::DEBUG::2014-01-16 17:11:59,937::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' >Thread-287692::DEBUG::2014-01-16 17:11:59,937::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (0 active users) >Thread-287692::DEBUG::2014-01-16 17:11:59,937::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' is free, finding out if anyone is waiting for it. >Thread-287692::DEBUG::2014-01-16 17:11:59,938::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', Clearing records. >Thread-287692::DEBUG::2014-01-16 17:11:59,938::task::974::TaskManager.Task::(_decref) Task=`0833b9af-c287-43ad-b7d3-5623d78fc8c3`::ref 0 aborting False >Thread-287692::DEBUG::2014-01-16 17:11:59,940::task::579::TaskManager.Task::(_updateState) Task=`e1a24b0a-1052-4e36-b722-bf2aad9b1508`::moving from state init -> state preparing >Thread-287692::INFO::2014-01-16 17:11:59,940::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='10bce6b5-ab25-452b-a8e2-24309deae8b7') >Thread-287692::INFO::2014-01-16 17:11:59,956::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-287692::DEBUG::2014-01-16 17:11:59,957::task::1168::TaskManager.Task::(prepare) Task=`e1a24b0a-1052-4e36-b722-bf2aad9b1508`::finished: None >Thread-287692::DEBUG::2014-01-16 17:11:59,957::task::579::TaskManager.Task::(_updateState) Task=`e1a24b0a-1052-4e36-b722-bf2aad9b1508`::moving from state preparing -> state finished >Thread-287692::DEBUG::2014-01-16 17:11:59,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287692::DEBUG::2014-01-16 17:11:59,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287692::DEBUG::2014-01-16 17:11:59,957::task::974::TaskManager.Task::(_decref) Task=`e1a24b0a-1052-4e36-b722-bf2aad9b1508`::ref 0 aborting False >Thread-287692::DEBUG::2014-01-16 17:11:59,958::vm::4471::vm.Vm::(deleteVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Total desktops after destroy of 10bce6b5-ab25-452b-a8e2-24309deae8b7 is 31 >Thread-287692::DEBUG::2014-01-16 17:11:59,959::BindingXMLRPC::991::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2014-01-16 17:11:59,960::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '10bce6b5-ab25-452b-a8e2-24309deae8b7' >libvirtEventLoop::DEBUG::2014-01-16 17:11:59,962::vm::2615::vm.Vm::(setDownStatus) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2014-01-16 17:11:59,963::sampling::292::vm.Vm::(stop) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-01-16 17:11:59,964::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '10bce6b5-ab25-452b-a8e2-24309deae8b7' >VM Channels Listener::DEBUG::2014-01-16 17:12:00,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:12:00,187::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:12:00,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:01,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >Thread-189817::DEBUG::2014-01-16 17:12:01,189::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:01,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:02,195::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:12:02,196::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:02,197::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:12:02,197::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:12:02,200::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:03,198::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:03,201::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:04,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:12:04,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:12:04,200::task::579::TaskManager.Task::(_updateState) Task=`eedd338d-0d6d-4974-9ff3-9530279acf50`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:12:04,200::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:12:04,200::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:12:04,201::task::1168::TaskManager.Task::(prepare) Task=`eedd338d-0d6d-4974-9ff3-9530279acf50`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:12:04,201::task::579::TaskManager.Task::(_updateState) Task=`eedd338d-0d6d-4974-9ff3-9530279acf50`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:12:04,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:12:04,201::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:12:04,201::task::974::TaskManager.Task::(_decref) Task=`eedd338d-0d6d-4974-9ff3-9530279acf50`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:12:04,678::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:12:04,695::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291354 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:12:05,200::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:12:05,201::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:05,203::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:12:06,191::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:12:06,212::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:12:06,215::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:12:06,217::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:12:06,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:12:06,223::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000221424 s, 18.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:07,204::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:07,205::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:07,225::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:12:07,225::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:12:07,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:08,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:12:08,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:12:08,248::task::579::TaskManager.Task::(_updateState) Task=`56d73a46-b0d7-466e-8c71-4ec01b3b1d7b`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:12:08,248::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:12:08,250::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:12:08,250::task::1168::TaskManager.Task::(prepare) Task=`56d73a46-b0d7-466e-8c71-4ec01b3b1d7b`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:12:08,250::task::579::TaskManager.Task::(_updateState) Task=`56d73a46-b0d7-466e-8c71-4ec01b3b1d7b`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:12:08,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:12:08,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:12:08,251::task::974::TaskManager.Task::(_decref) Task=`56d73a46-b0d7-466e-8c71-4ec01b3b1d7b`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:12:08,254::task::579::TaskManager.Task::(_updateState) Task=`b5cc346b-575d-4cfc-b3e9-013e62efffd8`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:12:08,254::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:12:08,255::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:12:08,255::task::1168::TaskManager.Task::(prepare) Task=`b5cc346b-575d-4cfc-b3e9-013e62efffd8`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:12:08,256::task::579::TaskManager.Task::(_updateState) Task=`b5cc346b-575d-4cfc-b3e9-013e62efffd8`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:12:08,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:12:08,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:12:08,256::task::974::TaskManager.Task::(_decref) Task=`b5cc346b-575d-4cfc-b3e9-013e62efffd8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:09,213::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:09,228::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:12:09,228::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:12:09,228::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:12:09,228::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287696::DEBUG::2014-01-16 17:12:09,577::task::579::TaskManager.Task::(_updateState) Task=`05695d8d-5eda-4440-83a7-508669702848`::moving from state init -> state preparing >Thread-287696::INFO::2014-01-16 17:12:09,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287696::INFO::2014-01-16 17:12:09,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291354', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221424', 'lastCheck': '3.4', 'valid': True}} >Thread-287696::DEBUG::2014-01-16 17:12:09,578::task::1168::TaskManager.Task::(prepare) Task=`05695d8d-5eda-4440-83a7-508669702848`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000291354', 'lastCheck': '4.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221424', 'lastCheck': '3.4', 'valid': True}} >Thread-287696::DEBUG::2014-01-16 17:12:09,578::task::579::TaskManager.Task::(_updateState) Task=`05695d8d-5eda-4440-83a7-508669702848`::moving from state preparing -> state finished >Thread-287696::DEBUG::2014-01-16 17:12:09,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287696::DEBUG::2014-01-16 17:12:09,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287696::DEBUG::2014-01-16 17:12:09,579::task::974::TaskManager.Task::(_decref) Task=`05695d8d-5eda-4440-83a7-508669702848`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:12:10,169::task::579::TaskManager.Task::(_updateState) Task=`63ae8079-ddf5-4108-b7c1-174eeb1aa411`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:12:10,169::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:12:10,171::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:12:10,171::task::1168::TaskManager.Task::(prepare) Task=`63ae8079-ddf5-4108-b7c1-174eeb1aa411`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:12:10,171::task::579::TaskManager.Task::(_updateState) Task=`63ae8079-ddf5-4108-b7c1-174eeb1aa411`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:12:10,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:12:10,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:12:10,171::task::974::TaskManager.Task::(_decref) Task=`63ae8079-ddf5-4108-b7c1-174eeb1aa411`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:12:10,171::task::579::TaskManager.Task::(_updateState) Task=`4e780bfc-025c-461b-9a65-c3ada60a178b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:12:10,172::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:12:10,172::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:12:10,172::task::1168::TaskManager.Task::(prepare) Task=`4e780bfc-025c-461b-9a65-c3ada60a178b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:12:10,172::task::579::TaskManager.Task::(_updateState) Task=`4e780bfc-025c-461b-9a65-c3ada60a178b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:12:10,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:12:10,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:12:10,173::task::974::TaskManager.Task::(_decref) Task=`4e780bfc-025c-461b-9a65-c3ada60a178b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:10,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:11,214::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:11,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >Thread-256178::DEBUG::2014-01-16 17:12:11,231::task::579::TaskManager.Task::(_updateState) Task=`3714c503-7775-4918-a39e-ef546310febd`::moving from state init -> state preparing >VM Channels Listener::DEBUG::2014-01-16 17:12:11,231::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >Thread-256178::INFO::2014-01-16 17:12:11,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >VM Channels Listener::DEBUG::2014-01-16 17:12:11,232::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:12:11,233::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::INFO::2014-01-16 17:12:11,233::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >VM Channels Listener::DEBUG::2014-01-16 17:12:11,233::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >Thread-256178::DEBUG::2014-01-16 17:12:11,234::task::1168::TaskManager.Task::(prepare) Task=`3714c503-7775-4918-a39e-ef546310febd`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:12:11,234::task::579::TaskManager.Task::(_updateState) Task=`3714c503-7775-4918-a39e-ef546310febd`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:12:11,234::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:12:11,234::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:12:11,235::task::974::TaskManager.Task::(_decref) Task=`3714c503-7775-4918-a39e-ef546310febd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:11,235::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:12:11,235::task::579::TaskManager.Task::(_updateState) Task=`f7a616f4-9145-4d5c-b90b-73e5b90d8678`::moving from state init -> state preparing >Thread-256178::DEBUG::2014-01-16 17:12:11,236::task::579::TaskManager.Task::(_updateState) Task=`70d14d67-b88c-46db-8737-347617ecbf8f`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:12:11,236::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-256178::INFO::2014-01-16 17:12:11,237::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-131629::INFO::2014-01-16 17:12:11,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-256178::INFO::2014-01-16 17:12:11,238::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-131629::DEBUG::2014-01-16 17:12:11,238::task::1168::TaskManager.Task::(prepare) Task=`f7a616f4-9145-4d5c-b90b-73e5b90d8678`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-256178::DEBUG::2014-01-16 17:12:11,238::task::1168::TaskManager.Task::(prepare) Task=`70d14d67-b88c-46db-8737-347617ecbf8f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-131629::DEBUG::2014-01-16 17:12:11,239::task::579::TaskManager.Task::(_updateState) Task=`f7a616f4-9145-4d5c-b90b-73e5b90d8678`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:12:11,239::task::579::TaskManager.Task::(_updateState) Task=`70d14d67-b88c-46db-8737-347617ecbf8f`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:12:11,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:12:11,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:12:11,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:12:11,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:12:11,241::task::974::TaskManager.Task::(_decref) Task=`f7a616f4-9145-4d5c-b90b-73e5b90d8678`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:12:11,241::task::974::TaskManager.Task::(_decref) Task=`70d14d67-b88c-46db-8737-347617ecbf8f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:12,215::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:12,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:13,217::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:13,238::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:12:13,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:12:13,239::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:14,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:12:14,240::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:12:14,241::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:12:14,703::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:12:14,720::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000326853 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:15,219::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:15,242::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:12:15,242::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:12:15,242::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:12:15,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:12:15,245::task::579::TaskManager.Task::(_updateState) Task=`f372e11d-2ac4-42e6-a0d5-9c2a9acf1b27`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:12:15,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:12:15,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:12:15,246::task::1168::TaskManager.Task::(prepare) Task=`f372e11d-2ac4-42e6-a0d5-9c2a9acf1b27`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:12:15,246::task::579::TaskManager.Task::(_updateState) Task=`f372e11d-2ac4-42e6-a0d5-9c2a9acf1b27`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:12:15,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:12:15,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:12:15,247::task::974::TaskManager.Task::(_decref) Task=`f372e11d-2ac4-42e6-a0d5-9c2a9acf1b27`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:12:15,256::task::579::TaskManager.Task::(_updateState) Task=`2213b680-0955-4d32-a7b7-b4d6787644c4`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:12:15,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:12:15,257::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:12:15,257::task::1168::TaskManager.Task::(prepare) Task=`2213b680-0955-4d32-a7b7-b4d6787644c4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:12:15,257::task::579::TaskManager.Task::(_updateState) Task=`2213b680-0955-4d32-a7b7-b4d6787644c4`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:12:15,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:12:15,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:12:15,258::task::974::TaskManager.Task::(_decref) Task=`2213b680-0955-4d32-a7b7-b4d6787644c4`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:12:16,229::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:12:16,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:12:16,280::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000260791 s, 15.7 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:12:16,377::task::579::TaskManager.Task::(_updateState) Task=`8872b804-c8f3-4065-aeff-4a2197a815e8`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:12:16,377::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:12:16,377::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:12:16,377::task::1168::TaskManager.Task::(prepare) Task=`8872b804-c8f3-4065-aeff-4a2197a815e8`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:12:16,378::task::579::TaskManager.Task::(_updateState) Task=`8872b804-c8f3-4065-aeff-4a2197a815e8`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:12:16,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:12:16,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:12:16,378::task::974::TaskManager.Task::(_decref) Task=`8872b804-c8f3-4065-aeff-4a2197a815e8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:17,220::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:17,221::task::579::TaskManager.Task::(_updateState) Task=`8e08a503-1eb2-4b37-a229-f9f0cf7e6e3e`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:12:17,221::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:12:17,222::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:12:17,222::task::1168::TaskManager.Task::(prepare) Task=`8e08a503-1eb2-4b37-a229-f9f0cf7e6e3e`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:12:17,222::task::579::TaskManager.Task::(_updateState) Task=`8e08a503-1eb2-4b37-a229-f9f0cf7e6e3e`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:12:17,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:12:17,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:12:17,223::task::974::TaskManager.Task::(_decref) Task=`8e08a503-1eb2-4b37-a229-f9f0cf7e6e3e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:17,224::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:12:17,225::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:12:17,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:17,228::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:17,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 17:12:17,239::task::579::TaskManager.Task::(_updateState) Task=`1f51fb34-f85b-4fb1-9fc7-8fb7bc27dc57`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:12:17,240::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:12:17,240::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:12:17,240::task::1168::TaskManager.Task::(prepare) Task=`1f51fb34-f85b-4fb1-9fc7-8fb7bc27dc57`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:12:17,240::task::579::TaskManager.Task::(_updateState) Task=`1f51fb34-f85b-4fb1-9fc7-8fb7bc27dc57`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:12:17,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:12:17,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:12:17,241::task::974::TaskManager.Task::(_decref) Task=`1f51fb34-f85b-4fb1-9fc7-8fb7bc27dc57`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:12:17,241::task::579::TaskManager.Task::(_updateState) Task=`3f748904-cf7e-447e-99c4-d645bc178979`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:12:17,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:12:17,242::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:12:17,242::task::1168::TaskManager.Task::(prepare) Task=`3f748904-cf7e-447e-99c4-d645bc178979`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:12:17,242::task::579::TaskManager.Task::(_updateState) Task=`3f748904-cf7e-447e-99c4-d645bc178979`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:12:17,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:12:17,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:12:17,242::task::974::TaskManager.Task::(_decref) Task=`3f748904-cf7e-447e-99c4-d645bc178979`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:17,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:12:17,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:12:17,265::task::579::TaskManager.Task::(_updateState) Task=`1078e79e-9797-46c0-bac6-a2d3863b1769`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:12:17,265::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:12:17,266::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:12:17,266::task::1168::TaskManager.Task::(prepare) Task=`1078e79e-9797-46c0-bac6-a2d3863b1769`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:12:17,266::task::579::TaskManager.Task::(_updateState) Task=`1078e79e-9797-46c0-bac6-a2d3863b1769`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:12:17,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:12:17,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:12:17,268::task::974::TaskManager.Task::(_decref) Task=`1078e79e-9797-46c0-bac6-a2d3863b1769`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:18,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:19,231::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:19,259::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:12:19,764::task::579::TaskManager.Task::(_updateState) Task=`4fc6dea3-7cfc-4d07-a204-d1e6f95a4446`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:12:19,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:12:19,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:12:19,766::task::1168::TaskManager.Task::(prepare) Task=`4fc6dea3-7cfc-4d07-a204-d1e6f95a4446`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:12:19,766::task::579::TaskManager.Task::(_updateState) Task=`4fc6dea3-7cfc-4d07-a204-d1e6f95a4446`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:12:19,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:12:19,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:12:19,766::task::974::TaskManager.Task::(_decref) Task=`4fc6dea3-7cfc-4d07-a204-d1e6f95a4446`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:20,260::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:21,233::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:21,260::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:12:21,277::task::579::TaskManager.Task::(_updateState) Task=`8779646c-e4b7-402a-868d-d838dd35d3e3`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:12:21,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:12:21,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:12:21,278::task::1168::TaskManager.Task::(prepare) Task=`8779646c-e4b7-402a-868d-d838dd35d3e3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:12:21,278::task::579::TaskManager.Task::(_updateState) Task=`8779646c-e4b7-402a-868d-d838dd35d3e3`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:12:21,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:12:21,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:12:21,279::task::974::TaskManager.Task::(_decref) Task=`8779646c-e4b7-402a-868d-d838dd35d3e3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:22,234::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:12:22,248::task::579::TaskManager.Task::(_updateState) Task=`564b8688-984b-4b94-9bb7-489bf1357040`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:12:22,248::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:12:22,248::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:12:22,248::task::1168::TaskManager.Task::(prepare) Task=`564b8688-984b-4b94-9bb7-489bf1357040`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:12:22,248::task::579::TaskManager.Task::(_updateState) Task=`564b8688-984b-4b94-9bb7-489bf1357040`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:12:22,249::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:12:22,249::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:12:22,249::task::974::TaskManager.Task::(_decref) Task=`564b8688-984b-4b94-9bb7-489bf1357040`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:12:22,249::task::579::TaskManager.Task::(_updateState) Task=`7514a873-17ea-4b0c-becc-cb7298b76862`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:12:22,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:12:22,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:12:22,250::task::1168::TaskManager.Task::(prepare) Task=`7514a873-17ea-4b0c-becc-cb7298b76862`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:12:22,250::task::579::TaskManager.Task::(_updateState) Task=`7514a873-17ea-4b0c-becc-cb7298b76862`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:12:22,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:12:22,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:12:22,250::task::974::TaskManager.Task::(_decref) Task=`7514a873-17ea-4b0c-becc-cb7298b76862`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:12:22,250::task::579::TaskManager.Task::(_updateState) Task=`dec60706-1a63-476b-ad5f-6b49338a067b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:12:22,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:12:22,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:12:22,251::task::1168::TaskManager.Task::(prepare) Task=`dec60706-1a63-476b-ad5f-6b49338a067b`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:12:22,251::task::579::TaskManager.Task::(_updateState) Task=`dec60706-1a63-476b-ad5f-6b49338a067b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:12:22,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:12:22,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:12:22,251::task::974::TaskManager.Task::(_decref) Task=`dec60706-1a63-476b-ad5f-6b49338a067b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:22,262::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:23,236::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:23,262::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:12:23,263::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:24,264::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:12:24,285::task::579::TaskManager.Task::(_updateState) Task=`6335005c-8b0b-43bd-85cf-e4ab5e5efd20`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:12:24,285::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:12:24,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:12:24,286::task::1168::TaskManager.Task::(prepare) Task=`6335005c-8b0b-43bd-85cf-e4ab5e5efd20`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:12:24,286::task::579::TaskManager.Task::(_updateState) Task=`6335005c-8b0b-43bd-85cf-e4ab5e5efd20`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:12:24,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:12:24,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:12:24,286::task::974::TaskManager.Task::(_decref) Task=`6335005c-8b0b-43bd-85cf-e4ab5e5efd20`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:12:24,727::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:12:24,744::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000273834 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:25,237::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:25,265::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287702::DEBUG::2014-01-16 17:12:25,477::task::579::TaskManager.Task::(_updateState) Task=`79527de8-cbb7-4526-9b6f-7bc19b8ed9a8`::moving from state init -> state preparing >Thread-287702::INFO::2014-01-16 17:12:25,477::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287702::INFO::2014-01-16 17:12:25,477::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273834', 'lastCheck': '0.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260791', 'lastCheck': '9.2', 'valid': True}} >Thread-287702::DEBUG::2014-01-16 17:12:25,478::task::1168::TaskManager.Task::(prepare) Task=`79527de8-cbb7-4526-9b6f-7bc19b8ed9a8`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000273834', 'lastCheck': '0.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260791', 'lastCheck': '9.2', 'valid': True}} >Thread-287702::DEBUG::2014-01-16 17:12:25,478::task::579::TaskManager.Task::(_updateState) Task=`79527de8-cbb7-4526-9b6f-7bc19b8ed9a8`::moving from state preparing -> state finished >Thread-287702::DEBUG::2014-01-16 17:12:25,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287702::DEBUG::2014-01-16 17:12:25,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287702::DEBUG::2014-01-16 17:12:25,478::task::974::TaskManager.Task::(_decref) Task=`79527de8-cbb7-4526-9b6f-7bc19b8ed9a8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:26,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:12:26,288::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:12:26,308::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000201778 s, 20.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:27,239::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:27,241::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 17:12:27,262::task::579::TaskManager.Task::(_updateState) Task=`999fd3c0-5b65-4e9e-84ac-839bf50377b9`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:12:27,262::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:12:27,263::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:12:27,263::task::1168::TaskManager.Task::(prepare) Task=`999fd3c0-5b65-4e9e-84ac-839bf50377b9`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:12:27,263::task::579::TaskManager.Task::(_updateState) Task=`999fd3c0-5b65-4e9e-84ac-839bf50377b9`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:12:27,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:12:27,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:12:27,264::task::974::TaskManager.Task::(_decref) Task=`999fd3c0-5b65-4e9e-84ac-839bf50377b9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:27,267::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:28,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:12:28,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:12:28,268::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:29,242::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:29,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:12:29,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:30,270::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:12:30,271::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:12:30,271::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:31,244::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:31,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:12:31,272::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:12:31,896::task::579::TaskManager.Task::(_updateState) Task=`833cd5b2-e141-4bf9-8b3f-92b9c455cb68`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:12:31,897::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:12:31,897::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:12:31,897::task::1168::TaskManager.Task::(prepare) Task=`833cd5b2-e141-4bf9-8b3f-92b9c455cb68`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:12:31,897::task::579::TaskManager.Task::(_updateState) Task=`833cd5b2-e141-4bf9-8b3f-92b9c455cb68`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:12:31,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:12:31,898::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:12:31,898::task::974::TaskManager.Task::(_decref) Task=`833cd5b2-e141-4bf9-8b3f-92b9c455cb68`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:32,246::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:12:32,246::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:12:32,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:32,273::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:12:32,273::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:33,249::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:33,274::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:34,275::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:12:34,276::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:12:34,752::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:12:34,769::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000284737 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:35,251::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:35,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:12:35,277::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:12:35,740::task::579::TaskManager.Task::(_updateState) Task=`7790f029-1f06-4136-b3fa-51d4cc97ba0c`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:12:35,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:12:35,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:12:35,741::task::1168::TaskManager.Task::(prepare) Task=`7790f029-1f06-4136-b3fa-51d4cc97ba0c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:12:35,741::task::579::TaskManager.Task::(_updateState) Task=`7790f029-1f06-4136-b3fa-51d4cc97ba0c`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:12:35,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:12:35,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:12:35,741::task::974::TaskManager.Task::(_decref) Task=`7790f029-1f06-4136-b3fa-51d4cc97ba0c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:12:35,743::task::579::TaskManager.Task::(_updateState) Task=`795acd2d-c671-479a-bf09-eec6eff5791c`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:12:35,743::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:12:35,744::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:12:35,744::task::1168::TaskManager.Task::(prepare) Task=`795acd2d-c671-479a-bf09-eec6eff5791c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:12:35,744::task::579::TaskManager.Task::(_updateState) Task=`795acd2d-c671-479a-bf09-eec6eff5791c`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:12:35,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:12:35,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:12:35,744::task::974::TaskManager.Task::(_decref) Task=`795acd2d-c671-479a-bf09-eec6eff5791c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:36,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:12:36,279::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:12:36,279::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:12:36,279::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:12:36,316::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:12:36,334::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000204199 s, 20.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:37,252::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:37,254::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:37,279::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:12:37,280::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:12:37,280::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:38,280::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:12:38,281::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:12:38,300::task::579::TaskManager.Task::(_updateState) Task=`04bf0df5-d3ca-4ec4-a14c-8ddbcc436d4b`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:12:38,301::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:12:38,301::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:12:38,301::task::1168::TaskManager.Task::(prepare) Task=`04bf0df5-d3ca-4ec4-a14c-8ddbcc436d4b`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:12:38,301::task::579::TaskManager.Task::(_updateState) Task=`04bf0df5-d3ca-4ec4-a14c-8ddbcc436d4b`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:12:38,301::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:12:38,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:12:38,302::task::974::TaskManager.Task::(_decref) Task=`04bf0df5-d3ca-4ec4-a14c-8ddbcc436d4b`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:12:38,302::task::579::TaskManager.Task::(_updateState) Task=`26b07e8a-87c8-40ce-838f-60b5a0b0287d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:12:38,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:12:38,303::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:12:38,303::task::1168::TaskManager.Task::(prepare) Task=`26b07e8a-87c8-40ce-838f-60b5a0b0287d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:12:38,303::task::579::TaskManager.Task::(_updateState) Task=`26b07e8a-87c8-40ce-838f-60b5a0b0287d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:12:38,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:12:38,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:12:38,303::task::974::TaskManager.Task::(_decref) Task=`26b07e8a-87c8-40ce-838f-60b5a0b0287d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:39,255::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:39,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:12:39,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:12:39,282::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:12:39,282::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:40,282::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:41,257::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:41,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:12:41,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:12:41,284::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:12:41,284::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:41,284::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:12:41,285::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:12:41,351::task::579::TaskManager.Task::(_updateState) Task=`261e713d-79af-4936-b28e-11f2625becd9`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:12:41,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:12:41,352::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:12:41,352::task::1168::TaskManager.Task::(prepare) Task=`261e713d-79af-4936-b28e-11f2625becd9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:12:41,352::task::579::TaskManager.Task::(_updateState) Task=`261e713d-79af-4936-b28e-11f2625becd9`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:12:41,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:12:41,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:12:41,353::task::974::TaskManager.Task::(_decref) Task=`261e713d-79af-4936-b28e-11f2625becd9`::ref 0 aborting False >Thread-287708::DEBUG::2014-01-16 17:12:41,396::task::579::TaskManager.Task::(_updateState) Task=`de921f30-0398-4f19-a936-a3db5bfe4e34`::moving from state init -> state preparing >Thread-287708::INFO::2014-01-16 17:12:41,397::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287708::INFO::2014-01-16 17:12:41,397::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284737', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000204199', 'lastCheck': '5.1', 'valid': True}} >Thread-287708::DEBUG::2014-01-16 17:12:41,397::task::1168::TaskManager.Task::(prepare) Task=`de921f30-0398-4f19-a936-a3db5bfe4e34`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284737', 'lastCheck': '6.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000204199', 'lastCheck': '5.1', 'valid': True}} >Thread-287708::DEBUG::2014-01-16 17:12:41,397::task::579::TaskManager.Task::(_updateState) Task=`de921f30-0398-4f19-a936-a3db5bfe4e34`::moving from state preparing -> state finished >Thread-287708::DEBUG::2014-01-16 17:12:41,397::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287708::DEBUG::2014-01-16 17:12:41,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287708::DEBUG::2014-01-16 17:12:41,398::task::974::TaskManager.Task::(_decref) Task=`de921f30-0398-4f19-a936-a3db5bfe4e34`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:42,259::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:42,285::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:43,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:43,287::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >Thread-3168::DEBUG::2014-01-16 17:12:43,287::task::579::TaskManager.Task::(_updateState) Task=`9f4e6297-ebbd-4b90-a47f-88749215b4be`::moving from state init -> state preparing >VM Channels Listener::DEBUG::2014-01-16 17:12:43,287::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >Thread-3168::INFO::2014-01-16 17:12:43,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >VM Channels Listener::DEBUG::2014-01-16 17:12:43,288::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::INFO::2014-01-16 17:12:43,289::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:12:43,289::task::1168::TaskManager.Task::(prepare) Task=`9f4e6297-ebbd-4b90-a47f-88749215b4be`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:12:43,289::task::579::TaskManager.Task::(_updateState) Task=`9f4e6297-ebbd-4b90-a47f-88749215b4be`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:12:43,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:12:43,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:12:43,290::task::974::TaskManager.Task::(_decref) Task=`9f4e6297-ebbd-4b90-a47f-88749215b4be`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:44,290::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:12:44,290::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:12:44,290::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 17:12:44,322::task::579::TaskManager.Task::(_updateState) Task=`3b7ef285-738f-4b06-8b2b-e9296c26df2c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:12:44,322::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:12:44,323::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:12:44,323::task::1168::TaskManager.Task::(prepare) Task=`3b7ef285-738f-4b06-8b2b-e9296c26df2c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:12:44,323::task::579::TaskManager.Task::(_updateState) Task=`3b7ef285-738f-4b06-8b2b-e9296c26df2c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:12:44,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:12:44,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:12:44,324::task::974::TaskManager.Task::(_decref) Task=`3b7ef285-738f-4b06-8b2b-e9296c26df2c`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:12:44,326::task::579::TaskManager.Task::(_updateState) Task=`5d377792-3bbc-4a2a-bad6-9938a389acd2`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:12:44,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:12:44,327::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:12:44,327::task::1168::TaskManager.Task::(prepare) Task=`5d377792-3bbc-4a2a-bad6-9938a389acd2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:12:44,327::task::579::TaskManager.Task::(_updateState) Task=`5d377792-3bbc-4a2a-bad6-9938a389acd2`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:12:44,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:12:44,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:12:44,328::task::974::TaskManager.Task::(_decref) Task=`5d377792-3bbc-4a2a-bad6-9938a389acd2`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:12:44,329::task::579::TaskManager.Task::(_updateState) Task=`07eba140-1b7f-4b82-bd37-8a47e59c6f72`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:12:44,329::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:12:44,330::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:12:44,330::task::1168::TaskManager.Task::(prepare) Task=`07eba140-1b7f-4b82-bd37-8a47e59c6f72`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:12:44,330::task::579::TaskManager.Task::(_updateState) Task=`07eba140-1b7f-4b82-bd37-8a47e59c6f72`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:12:44,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:12:44,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:12:44,330::task::974::TaskManager.Task::(_decref) Task=`07eba140-1b7f-4b82-bd37-8a47e59c6f72`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:12:44,776::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:12:44,793::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000282828 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:45,262::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:45,291::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:12:45,292::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:12:45,292::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:12:45,292::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:12:45,318::task::579::TaskManager.Task::(_updateState) Task=`edd65345-6937-4b84-9cd3-225b88ef2ec9`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:12:45,318::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:12:45,319::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:12:45,319::task::1168::TaskManager.Task::(prepare) Task=`edd65345-6937-4b84-9cd3-225b88ef2ec9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:12:45,319::task::579::TaskManager.Task::(_updateState) Task=`edd65345-6937-4b84-9cd3-225b88ef2ec9`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:12:45,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:12:45,319::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:12:45,319::task::974::TaskManager.Task::(_decref) Task=`edd65345-6937-4b84-9cd3-225b88ef2ec9`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:12:45,340::task::579::TaskManager.Task::(_updateState) Task=`2666be26-a34b-40d0-a906-9e40140b7e72`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:12:45,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:12:45,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:12:45,341::task::1168::TaskManager.Task::(prepare) Task=`2666be26-a34b-40d0-a906-9e40140b7e72`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:12:45,341::task::579::TaskManager.Task::(_updateState) Task=`2666be26-a34b-40d0-a906-9e40140b7e72`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:12:45,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:12:45,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:12:45,342::task::974::TaskManager.Task::(_decref) Task=`2666be26-a34b-40d0-a906-9e40140b7e72`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:46,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:12:46,343::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:12:46,366::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00018416 s, 22.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:47,264::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:47,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:12:47,267::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:12:47,268::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:47,294::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:12:47,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:48,296::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:49,269::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:49,297::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:50,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:51,271::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:51,299::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:12:51,968::task::579::TaskManager.Task::(_updateState) Task=`03856087-4f06-42bb-b23e-824bc2f0b401`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:12:51,968::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:12:51,969::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:12:51,969::task::1168::TaskManager.Task::(prepare) Task=`03856087-4f06-42bb-b23e-824bc2f0b401`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:12:51,969::task::579::TaskManager.Task::(_updateState) Task=`03856087-4f06-42bb-b23e-824bc2f0b401`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:12:51,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:12:51,969::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:12:51,969::task::974::TaskManager.Task::(_decref) Task=`03856087-4f06-42bb-b23e-824bc2f0b401`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:12:51,970::task::579::TaskManager.Task::(_updateState) Task=`27ab2ce6-821f-463b-886c-b1c73fd4efe8`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:12:51,970::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:12:51,970::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:12:51,970::task::1168::TaskManager.Task::(prepare) Task=`27ab2ce6-821f-463b-886c-b1c73fd4efe8`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:12:51,970::task::579::TaskManager.Task::(_updateState) Task=`27ab2ce6-821f-463b-886c-b1c73fd4efe8`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:12:51,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:12:51,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:12:51,971::task::974::TaskManager.Task::(_decref) Task=`27ab2ce6-821f-463b-886c-b1c73fd4efe8`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:12:51,971::task::579::TaskManager.Task::(_updateState) Task=`9ed91b55-fe66-4d27-b79a-efa5e0c60d80`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:12:51,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:12:51,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:12:51,972::task::1168::TaskManager.Task::(prepare) Task=`9ed91b55-fe66-4d27-b79a-efa5e0c60d80`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:12:51,972::task::579::TaskManager.Task::(_updateState) Task=`9ed91b55-fe66-4d27-b79a-efa5e0c60d80`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:12:51,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:12:51,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:12:51,972::task::974::TaskManager.Task::(_decref) Task=`9ed91b55-fe66-4d27-b79a-efa5e0c60d80`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:52,273::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:52,300::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:12:52,505::task::579::TaskManager.Task::(_updateState) Task=`6184c108-5879-425d-8d75-e9d095be082f`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:12:52,506::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:12:52,506::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:12:52,506::task::1168::TaskManager.Task::(prepare) Task=`6184c108-5879-425d-8d75-e9d095be082f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:12:52,506::task::579::TaskManager.Task::(_updateState) Task=`6184c108-5879-425d-8d75-e9d095be082f`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:12:52,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:12:52,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:12:52,507::task::974::TaskManager.Task::(_decref) Task=`6184c108-5879-425d-8d75-e9d095be082f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:12:53,274::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:53,301::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:12:53,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:54,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:12:54,800::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:12:54,816::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000345858 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:55,276::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:55,303::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:12:56,304::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:12:56,374::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:12:56,392::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000205618 s, 19.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:12:57,278::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:12:57,279::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:57,305::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:12:57,675::task::579::TaskManager.Task::(_updateState) Task=`9aa279de-9325-403b-9b8b-42b88377e2cb`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:12:57,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:12:57,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:12:57,676::task::1168::TaskManager.Task::(prepare) Task=`9aa279de-9325-403b-9b8b-42b88377e2cb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:12:57,676::task::579::TaskManager.Task::(_updateState) Task=`9aa279de-9325-403b-9b8b-42b88377e2cb`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:12:57,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:12:57,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:12:57,676::task::974::TaskManager.Task::(_decref) Task=`9aa279de-9325-403b-9b8b-42b88377e2cb`::ref 0 aborting False >Thread-287714::DEBUG::2014-01-16 17:12:57,872::task::579::TaskManager.Task::(_updateState) Task=`01067491-5b7a-450c-b99e-155ba58136f6`::moving from state init -> state preparing >Thread-287714::INFO::2014-01-16 17:12:57,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287714::INFO::2014-01-16 17:12:57,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000345858', 'lastCheck': '3.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000205618', 'lastCheck': '1.5', 'valid': True}} >Thread-287714::DEBUG::2014-01-16 17:12:57,873::task::1168::TaskManager.Task::(prepare) Task=`01067491-5b7a-450c-b99e-155ba58136f6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000345858', 'lastCheck': '3.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000205618', 'lastCheck': '1.5', 'valid': True}} >Thread-287714::DEBUG::2014-01-16 17:12:57,873::task::579::TaskManager.Task::(_updateState) Task=`01067491-5b7a-450c-b99e-155ba58136f6`::moving from state preparing -> state finished >Thread-287714::DEBUG::2014-01-16 17:12:57,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287714::DEBUG::2014-01-16 17:12:57,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287714::DEBUG::2014-01-16 17:12:57,874::task::974::TaskManager.Task::(_decref) Task=`01067491-5b7a-450c-b99e-155ba58136f6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:12:58,307::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:12:58,307::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:12:58,307::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:12:59,281::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:12:59,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:12:59,308::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:00,309::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:13:00,309::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:13:00,310::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:01,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:01,311::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:13:01,311::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:02,284::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:13:02,285::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:13:02,286::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:02,312::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:13:02,312::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:03,287::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:03,313::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:04,315::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:13:04,315::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:13:04,419::task::579::TaskManager.Task::(_updateState) Task=`284cd5c5-891f-474c-9b21-f00124480d52`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:13:04,419::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:13:04,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:13:04,419::task::1168::TaskManager.Task::(prepare) Task=`284cd5c5-891f-474c-9b21-f00124480d52`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:13:04,420::task::579::TaskManager.Task::(_updateState) Task=`284cd5c5-891f-474c-9b21-f00124480d52`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:13:04,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:13:04,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:13:04,420::task::974::TaskManager.Task::(_decref) Task=`284cd5c5-891f-474c-9b21-f00124480d52`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:13:04,826::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:13:04,845::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000251861 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:05,288::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:05,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:13:05,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:06,317::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:13:06,318::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:13:06,318::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:13:06,318::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:13:06,403::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:13:06,423::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235954 s, 17.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:07,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:07,291::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:07,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:13:07,320::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:13:07,320::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:08,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:13:08,321::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:13:08,330::task::579::TaskManager.Task::(_updateState) Task=`29a172af-be8a-445b-9747-19c2a2884b43`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:13:08,330::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:13:08,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:13:08,331::task::1168::TaskManager.Task::(prepare) Task=`29a172af-be8a-445b-9747-19c2a2884b43`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:13:08,331::task::579::TaskManager.Task::(_updateState) Task=`29a172af-be8a-445b-9747-19c2a2884b43`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:13:08,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:13:08,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:13:08,332::task::974::TaskManager.Task::(_decref) Task=`29a172af-be8a-445b-9747-19c2a2884b43`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:13:08,334::task::579::TaskManager.Task::(_updateState) Task=`40b7cc71-3787-44d7-b493-475c327b4cfd`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:13:08,335::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:13:08,336::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:13:08,336::task::1168::TaskManager.Task::(prepare) Task=`40b7cc71-3787-44d7-b493-475c327b4cfd`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:13:08,336::task::579::TaskManager.Task::(_updateState) Task=`40b7cc71-3787-44d7-b493-475c327b4cfd`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:13:08,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:13:08,337::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:13:08,337::task::974::TaskManager.Task::(_decref) Task=`40b7cc71-3787-44d7-b493-475c327b4cfd`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:09,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:09,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:13:09,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:13:09,323::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:13:09,323::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:13:10,280::task::579::TaskManager.Task::(_updateState) Task=`dae14bb8-9972-4498-a491-9c7c8503573e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:13:10,281::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:13:10,282::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:13:10,282::task::1168::TaskManager.Task::(prepare) Task=`dae14bb8-9972-4498-a491-9c7c8503573e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:13:10,283::task::579::TaskManager.Task::(_updateState) Task=`dae14bb8-9972-4498-a491-9c7c8503573e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:13:10,283::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:13:10,283::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:13:10,283::task::974::TaskManager.Task::(_decref) Task=`dae14bb8-9972-4498-a491-9c7c8503573e`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:13:10,283::task::579::TaskManager.Task::(_updateState) Task=`efd470c9-9254-4729-983c-9148b00dc288`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:13:10,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:13:10,284::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:13:10,284::task::1168::TaskManager.Task::(prepare) Task=`efd470c9-9254-4729-983c-9148b00dc288`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:13:10,284::task::579::TaskManager.Task::(_updateState) Task=`efd470c9-9254-4729-983c-9148b00dc288`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:13:10,284::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:13:10,284::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:13:10,284::task::974::TaskManager.Task::(_decref) Task=`efd470c9-9254-4729-983c-9148b00dc288`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:10,325::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:11,294::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:11,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:13:11,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:13:11,326::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:13:11,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:11,327::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:13:11,327::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:13:11,436::task::579::TaskManager.Task::(_updateState) Task=`5cdd03f0-4106-4f40-b736-f4aa5412b546`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:13:11,436::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:13:11,436::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:13:11,436::task::1168::TaskManager.Task::(prepare) Task=`5cdd03f0-4106-4f40-b736-f4aa5412b546`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:13:11,437::task::579::TaskManager.Task::(_updateState) Task=`5cdd03f0-4106-4f40-b736-f4aa5412b546`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:13:11,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:13:11,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:13:11,437::task::974::TaskManager.Task::(_decref) Task=`5cdd03f0-4106-4f40-b736-f4aa5412b546`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:13:11,477::task::579::TaskManager.Task::(_updateState) Task=`f0b375da-5b77-49d5-b95e-302f17428135`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:13:11,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:13:11,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:13:11,478::task::1168::TaskManager.Task::(prepare) Task=`f0b375da-5b77-49d5-b95e-302f17428135`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:13:11,478::task::579::TaskManager.Task::(_updateState) Task=`f0b375da-5b77-49d5-b95e-302f17428135`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:13:11,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:13:11,478::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:13:11,479::task::974::TaskManager.Task::(_decref) Task=`f0b375da-5b77-49d5-b95e-302f17428135`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:13:11,479::task::579::TaskManager.Task::(_updateState) Task=`b9f42b97-3408-4595-b1d1-67bc7ed73ddf`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:13:11,479::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:13:11,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:13:11,479::task::1168::TaskManager.Task::(prepare) Task=`b9f42b97-3408-4595-b1d1-67bc7ed73ddf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:13:11,479::task::579::TaskManager.Task::(_updateState) Task=`b9f42b97-3408-4595-b1d1-67bc7ed73ddf`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:13:11,480::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:13:11,480::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:13:11,480::task::974::TaskManager.Task::(_decref) Task=`b9f42b97-3408-4595-b1d1-67bc7ed73ddf`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:12,295::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:12,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:13,297::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:13,328::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:13:13,328::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:13:13,328::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287720::DEBUG::2014-01-16 17:13:14,091::task::579::TaskManager.Task::(_updateState) Task=`1077aafb-95b0-4f4c-bf54-a16f11209778`::moving from state init -> state preparing >Thread-287720::INFO::2014-01-16 17:13:14,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287720::INFO::2014-01-16 17:13:14,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251861', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235954', 'lastCheck': '7.7', 'valid': True}} >Thread-287720::DEBUG::2014-01-16 17:13:14,092::task::1168::TaskManager.Task::(prepare) Task=`1077aafb-95b0-4f4c-bf54-a16f11209778`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000251861', 'lastCheck': '9.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235954', 'lastCheck': '7.7', 'valid': True}} >Thread-287720::DEBUG::2014-01-16 17:13:14,092::task::579::TaskManager.Task::(_updateState) Task=`1077aafb-95b0-4f4c-bf54-a16f11209778`::moving from state preparing -> state finished >Thread-287720::DEBUG::2014-01-16 17:13:14,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287720::DEBUG::2014-01-16 17:13:14,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287720::DEBUG::2014-01-16 17:13:14,093::task::974::TaskManager.Task::(_decref) Task=`1077aafb-95b0-4f4c-bf54-a16f11209778`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:14,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:13:14,330::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:13:14,330::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:13:14,855::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:13:14,872::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00028311 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:15,299::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:15,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:13:15,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:13:15,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:13:15,332::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:13:15,401::task::579::TaskManager.Task::(_updateState) Task=`ee121182-0eb8-457b-b612-c5264738e421`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:13:15,401::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:13:15,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:13:15,402::task::1168::TaskManager.Task::(prepare) Task=`ee121182-0eb8-457b-b612-c5264738e421`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:13:15,402::task::579::TaskManager.Task::(_updateState) Task=`ee121182-0eb8-457b-b612-c5264738e421`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:13:15,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:13:15,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:13:15,403::task::974::TaskManager.Task::(_decref) Task=`ee121182-0eb8-457b-b612-c5264738e421`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:13:15,452::task::579::TaskManager.Task::(_updateState) Task=`e7ce3d53-1128-40bf-a7d0-6a2959a21b71`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:13:15,453::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:13:15,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:13:15,453::task::1168::TaskManager.Task::(prepare) Task=`e7ce3d53-1128-40bf-a7d0-6a2959a21b71`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:13:15,453::task::579::TaskManager.Task::(_updateState) Task=`e7ce3d53-1128-40bf-a7d0-6a2959a21b71`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:13:15,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:13:15,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:13:15,454::task::974::TaskManager.Task::(_decref) Task=`e7ce3d53-1128-40bf-a7d0-6a2959a21b71`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:16,332::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:13:16,430::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:13:16,447::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000247752 s, 16.5 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:13:16,540::task::579::TaskManager.Task::(_updateState) Task=`9e8e30d9-26b2-4032-bd3f-36a3acf42471`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:13:16,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:13:16,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:13:16,541::task::1168::TaskManager.Task::(prepare) Task=`9e8e30d9-26b2-4032-bd3f-36a3acf42471`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:13:16,541::task::579::TaskManager.Task::(_updateState) Task=`9e8e30d9-26b2-4032-bd3f-36a3acf42471`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:13:16,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:13:16,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:13:16,542::task::974::TaskManager.Task::(_decref) Task=`9e8e30d9-26b2-4032-bd3f-36a3acf42471`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:17,301::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:17,302::task::579::TaskManager.Task::(_updateState) Task=`f843321a-dc4d-4662-801f-5e376f06249f`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:13:17,302::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:13:17,302::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:13:17,302::task::1168::TaskManager.Task::(prepare) Task=`f843321a-dc4d-4662-801f-5e376f06249f`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:13:17,303::task::579::TaskManager.Task::(_updateState) Task=`f843321a-dc4d-4662-801f-5e376f06249f`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:13:17,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:13:17,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:13:17,303::task::974::TaskManager.Task::(_decref) Task=`f843321a-dc4d-4662-801f-5e376f06249f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:17,305::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:13:17,305::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:13:17,307::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:17,309::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:17,310::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:17,333::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:13:17,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:13:17,465::task::579::TaskManager.Task::(_updateState) Task=`2f394ab5-7846-4b83-9155-b686df5e5362`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:13:17,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:13:17,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:13:17,466::task::1168::TaskManager.Task::(prepare) Task=`2f394ab5-7846-4b83-9155-b686df5e5362`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:13:17,466::task::579::TaskManager.Task::(_updateState) Task=`2f394ab5-7846-4b83-9155-b686df5e5362`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:13:17,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:13:17,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:13:17,467::task::974::TaskManager.Task::(_decref) Task=`2f394ab5-7846-4b83-9155-b686df5e5362`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:13:17,483::task::579::TaskManager.Task::(_updateState) Task=`f71c2ebc-21a8-4d06-9201-83afbd48fd7d`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:13:17,483::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:13:17,483::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:13:17,484::task::1168::TaskManager.Task::(prepare) Task=`f71c2ebc-21a8-4d06-9201-83afbd48fd7d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:13:17,484::task::579::TaskManager.Task::(_updateState) Task=`f71c2ebc-21a8-4d06-9201-83afbd48fd7d`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:13:17,484::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:13:17,484::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:13:17,484::task::974::TaskManager.Task::(_decref) Task=`f71c2ebc-21a8-4d06-9201-83afbd48fd7d`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:13:17,485::task::579::TaskManager.Task::(_updateState) Task=`6c95c0ce-7167-40dd-8fe3-64afb8226c8d`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:13:17,485::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:13:17,485::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:13:17,485::task::1168::TaskManager.Task::(prepare) Task=`6c95c0ce-7167-40dd-8fe3-64afb8226c8d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:13:17,485::task::579::TaskManager.Task::(_updateState) Task=`6c95c0ce-7167-40dd-8fe3-64afb8226c8d`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:13:17,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:13:17,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:13:17,486::task::974::TaskManager.Task::(_decref) Task=`6c95c0ce-7167-40dd-8fe3-64afb8226c8d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:18,335::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:19,312::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:19,336::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:13:19,856::task::579::TaskManager.Task::(_updateState) Task=`8ac5618a-bb1d-4a97-afee-04eedc8d475b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:13:19,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:13:19,858::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:13:19,858::task::1168::TaskManager.Task::(prepare) Task=`8ac5618a-bb1d-4a97-afee-04eedc8d475b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:13:19,858::task::579::TaskManager.Task::(_updateState) Task=`8ac5618a-bb1d-4a97-afee-04eedc8d475b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:13:19,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:13:19,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:13:19,859::task::974::TaskManager.Task::(_decref) Task=`8ac5618a-bb1d-4a97-afee-04eedc8d475b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:20,337::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:21,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:21,339::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:13:21,473::task::579::TaskManager.Task::(_updateState) Task=`3fcc84e3-b6b7-448e-8ebd-54a432126bb2`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:13:21,473::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:13:21,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:13:21,474::task::1168::TaskManager.Task::(prepare) Task=`3fcc84e3-b6b7-448e-8ebd-54a432126bb2`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:13:21,474::task::579::TaskManager.Task::(_updateState) Task=`3fcc84e3-b6b7-448e-8ebd-54a432126bb2`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:13:21,474::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:13:21,474::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:13:21,474::task::974::TaskManager.Task::(_decref) Task=`3fcc84e3-b6b7-448e-8ebd-54a432126bb2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:22,315::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:22,339::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:13:22,823::task::579::TaskManager.Task::(_updateState) Task=`30e023dd-13df-40c4-ad8f-8edbfa5bad35`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:13:22,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:13:22,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:13:22,824::task::1168::TaskManager.Task::(prepare) Task=`30e023dd-13df-40c4-ad8f-8edbfa5bad35`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:13:22,824::task::579::TaskManager.Task::(_updateState) Task=`30e023dd-13df-40c4-ad8f-8edbfa5bad35`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:13:22,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:13:22,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:13:22,824::task::974::TaskManager.Task::(_decref) Task=`30e023dd-13df-40c4-ad8f-8edbfa5bad35`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:13:22,825::task::579::TaskManager.Task::(_updateState) Task=`c1cb978d-7e82-4eaa-9788-155ac77d3a0b`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:13:22,825::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:13:22,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:13:22,825::task::1168::TaskManager.Task::(prepare) Task=`c1cb978d-7e82-4eaa-9788-155ac77d3a0b`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:13:22,825::task::579::TaskManager.Task::(_updateState) Task=`c1cb978d-7e82-4eaa-9788-155ac77d3a0b`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:13:22,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:13:22,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:13:22,826::task::974::TaskManager.Task::(_decref) Task=`c1cb978d-7e82-4eaa-9788-155ac77d3a0b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:13:22,826::task::579::TaskManager.Task::(_updateState) Task=`f876845a-d2e6-4189-861d-3286c7c87178`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:13:22,826::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:13:22,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:13:22,827::task::1168::TaskManager.Task::(prepare) Task=`f876845a-d2e6-4189-861d-3286c7c87178`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:13:22,827::task::579::TaskManager.Task::(_updateState) Task=`f876845a-d2e6-4189-861d-3286c7c87178`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:13:22,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:13:22,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:13:22,827::task::974::TaskManager.Task::(_decref) Task=`f876845a-d2e6-4189-861d-3286c7c87178`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:23,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:23,340::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:13:23,341::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:24,342::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:13:24,469::task::579::TaskManager.Task::(_updateState) Task=`32924a88-e513-4b58-a09e-5b88dffa3f2b`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:13:24,469::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:13:24,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:13:24,470::task::1168::TaskManager.Task::(prepare) Task=`32924a88-e513-4b58-a09e-5b88dffa3f2b`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:13:24,470::task::579::TaskManager.Task::(_updateState) Task=`32924a88-e513-4b58-a09e-5b88dffa3f2b`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:13:24,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:13:24,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:13:24,470::task::974::TaskManager.Task::(_decref) Task=`32924a88-e513-4b58-a09e-5b88dffa3f2b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:13:24,882::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:13:24,902::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00027849 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:25,318::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:25,344::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:26,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:13:26,453::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:13:26,469::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000251101 s, 16.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:27,320::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:27,322::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 17:13:27,339::task::579::TaskManager.Task::(_updateState) Task=`2a600911-a54e-4897-8784-48b00362716d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:13:27,339::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:13:27,340::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:13:27,340::task::1168::TaskManager.Task::(prepare) Task=`2a600911-a54e-4897-8784-48b00362716d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:13:27,341::task::579::TaskManager.Task::(_updateState) Task=`2a600911-a54e-4897-8784-48b00362716d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:13:27,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:13:27,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:13:27,341::task::974::TaskManager.Task::(_decref) Task=`2a600911-a54e-4897-8784-48b00362716d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:27,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:28,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:13:28,347::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:13:28,347::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:29,323::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:29,348::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:13:29,348::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287726::DEBUG::2014-01-16 17:13:30,076::task::579::TaskManager.Task::(_updateState) Task=`f2cab98c-4b43-4b5c-ba9b-d774ffe8ef14`::moving from state init -> state preparing >Thread-287726::INFO::2014-01-16 17:13:30,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287726::INFO::2014-01-16 17:13:30,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027849', 'lastCheck': '5.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251101', 'lastCheck': '3.6', 'valid': True}} >Thread-287726::DEBUG::2014-01-16 17:13:30,077::task::1168::TaskManager.Task::(prepare) Task=`f2cab98c-4b43-4b5c-ba9b-d774ffe8ef14`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027849', 'lastCheck': '5.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251101', 'lastCheck': '3.6', 'valid': True}} >Thread-287726::DEBUG::2014-01-16 17:13:30,077::task::579::TaskManager.Task::(_updateState) Task=`f2cab98c-4b43-4b5c-ba9b-d774ffe8ef14`::moving from state preparing -> state finished >Thread-287726::DEBUG::2014-01-16 17:13:30,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287726::DEBUG::2014-01-16 17:13:30,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287726::DEBUG::2014-01-16 17:13:30,077::task::974::TaskManager.Task::(_decref) Task=`f2cab98c-4b43-4b5c-ba9b-d774ffe8ef14`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:30,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:13:30,355::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:13:30,355::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:31,325::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:31,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:13:31,357::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:13:32,073::task::579::TaskManager.Task::(_updateState) Task=`884fbec8-4710-4109-b238-dfb46d691724`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:13:32,073::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:13:32,073::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:13:32,073::task::1168::TaskManager.Task::(prepare) Task=`884fbec8-4710-4109-b238-dfb46d691724`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:13:32,074::task::579::TaskManager.Task::(_updateState) Task=`884fbec8-4710-4109-b238-dfb46d691724`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:13:32,074::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:13:32,074::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:13:32,074::task::974::TaskManager.Task::(_decref) Task=`884fbec8-4710-4109-b238-dfb46d691724`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:32,328::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:13:32,328::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:13:32,334::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:32,358::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:13:32,358::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:33,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:33,359::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:34,360::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:13:34,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:13:34,910::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:13:34,927::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308343 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:35,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:35,361::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:13:35,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:13:35,922::task::579::TaskManager.Task::(_updateState) Task=`4bf02851-e5ae-4ab7-a329-97cd8ab1676e`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:13:35,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:13:35,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:13:35,923::task::1168::TaskManager.Task::(prepare) Task=`4bf02851-e5ae-4ab7-a329-97cd8ab1676e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:13:35,923::task::579::TaskManager.Task::(_updateState) Task=`4bf02851-e5ae-4ab7-a329-97cd8ab1676e`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:13:35,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:13:35,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:13:35,923::task::974::TaskManager.Task::(_decref) Task=`4bf02851-e5ae-4ab7-a329-97cd8ab1676e`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:13:35,930::task::579::TaskManager.Task::(_updateState) Task=`11f0370c-fe17-430e-bb40-925581f2fe49`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:13:35,930::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:13:35,930::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:13:35,930::task::1168::TaskManager.Task::(prepare) Task=`11f0370c-fe17-430e-bb40-925581f2fe49`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:13:35,931::task::579::TaskManager.Task::(_updateState) Task=`11f0370c-fe17-430e-bb40-925581f2fe49`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:13:35,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:13:35,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:13:35,931::task::974::TaskManager.Task::(_decref) Task=`11f0370c-fe17-430e-bb40-925581f2fe49`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:36,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:13:36,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:13:36,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:13:36,362::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:13:36,475::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:13:36,492::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00023248 s, 17.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:37,341::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:37,343::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:37,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:13:37,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:13:37,364::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:38,365::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:13:38,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:13:38,671::task::579::TaskManager.Task::(_updateState) Task=`26ef8f8b-a895-4ad1-a50a-98ba19bbbd61`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:13:38,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:13:38,672::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:13:38,672::task::1168::TaskManager.Task::(prepare) Task=`26ef8f8b-a895-4ad1-a50a-98ba19bbbd61`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:13:38,672::task::579::TaskManager.Task::(_updateState) Task=`26ef8f8b-a895-4ad1-a50a-98ba19bbbd61`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:13:38,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:13:38,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:13:38,673::task::974::TaskManager.Task::(_decref) Task=`26ef8f8b-a895-4ad1-a50a-98ba19bbbd61`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:13:38,673::task::579::TaskManager.Task::(_updateState) Task=`1c253924-9156-447d-9140-8d510b01d2a6`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:13:38,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:13:38,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:13:38,675::task::1168::TaskManager.Task::(prepare) Task=`1c253924-9156-447d-9140-8d510b01d2a6`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:13:38,675::task::579::TaskManager.Task::(_updateState) Task=`1c253924-9156-447d-9140-8d510b01d2a6`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:13:38,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:13:38,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:13:38,675::task::974::TaskManager.Task::(_decref) Task=`1c253924-9156-447d-9140-8d510b01d2a6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:39,344::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:39,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:13:39,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:13:39,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:13:39,367::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:40,368::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:41,345::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:41,369::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:13:41,370::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:13:41,370::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:13:41,370::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:41,370::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:13:41,372::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:13:41,535::task::579::TaskManager.Task::(_updateState) Task=`a9af3d05-087f-4c25-8c67-414c2edbd81d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:13:41,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:13:41,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:13:41,536::task::1168::TaskManager.Task::(prepare) Task=`a9af3d05-087f-4c25-8c67-414c2edbd81d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:13:41,536::task::579::TaskManager.Task::(_updateState) Task=`a9af3d05-087f-4c25-8c67-414c2edbd81d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:13:41,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:13:41,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:13:41,537::task::974::TaskManager.Task::(_decref) Task=`a9af3d05-087f-4c25-8c67-414c2edbd81d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:42,346::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:42,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:43,348::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:43,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:13:43,375::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:13:43,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:13:43,454::task::579::TaskManager.Task::(_updateState) Task=`c859d24c-136c-48be-a203-70d5fe60727f`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:13:43,454::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:13:43,454::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:13:43,454::task::1168::TaskManager.Task::(prepare) Task=`c859d24c-136c-48be-a203-70d5fe60727f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:13:43,455::task::579::TaskManager.Task::(_updateState) Task=`c859d24c-136c-48be-a203-70d5fe60727f`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:13:43,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:13:43,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:13:43,455::task::974::TaskManager.Task::(_decref) Task=`c859d24c-136c-48be-a203-70d5fe60727f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:44,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:13:44,376::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:13:44,376::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 17:13:44,540::task::579::TaskManager.Task::(_updateState) Task=`dd92a1d6-1485-40b7-b120-3a15008bf485`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:13:44,540::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:13:44,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:13:44,541::task::1168::TaskManager.Task::(prepare) Task=`dd92a1d6-1485-40b7-b120-3a15008bf485`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:13:44,541::task::579::TaskManager.Task::(_updateState) Task=`dd92a1d6-1485-40b7-b120-3a15008bf485`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:13:44,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:13:44,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:13:44,542::task::974::TaskManager.Task::(_decref) Task=`dd92a1d6-1485-40b7-b120-3a15008bf485`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:13:44,546::task::579::TaskManager.Task::(_updateState) Task=`0d85a54a-3aea-4fe2-8560-e7e38af67cdd`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:13:44,547::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:13:44,547::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:13:44,547::task::1168::TaskManager.Task::(prepare) Task=`0d85a54a-3aea-4fe2-8560-e7e38af67cdd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:13:44,547::task::579::TaskManager.Task::(_updateState) Task=`0d85a54a-3aea-4fe2-8560-e7e38af67cdd`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:13:44,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:13:44,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:13:44,548::task::974::TaskManager.Task::(_decref) Task=`0d85a54a-3aea-4fe2-8560-e7e38af67cdd`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:13:44,551::task::579::TaskManager.Task::(_updateState) Task=`fef95d7d-38e7-4a0d-8796-c8fc5493442a`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:13:44,551::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:13:44,552::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:13:44,552::task::1168::TaskManager.Task::(prepare) Task=`fef95d7d-38e7-4a0d-8796-c8fc5493442a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:13:44,552::task::579::TaskManager.Task::(_updateState) Task=`fef95d7d-38e7-4a0d-8796-c8fc5493442a`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:13:44,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:13:44,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:13:44,552::task::974::TaskManager.Task::(_decref) Task=`fef95d7d-38e7-4a0d-8796-c8fc5493442a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:13:44,934::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:13:44,953::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00030535 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:45,349::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:45,377::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:13:45,378::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:13:45,378::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:13:45,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:13:45,491::task::579::TaskManager.Task::(_updateState) Task=`f385f5e3-b503-493c-889a-ff5712a397c4`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:13:45,492::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:13:45,492::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:13:45,492::task::1168::TaskManager.Task::(prepare) Task=`f385f5e3-b503-493c-889a-ff5712a397c4`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:13:45,492::task::579::TaskManager.Task::(_updateState) Task=`f385f5e3-b503-493c-889a-ff5712a397c4`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:13:45,493::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:13:45,493::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:13:45,493::task::974::TaskManager.Task::(_decref) Task=`f385f5e3-b503-493c-889a-ff5712a397c4`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:13:45,510::task::579::TaskManager.Task::(_updateState) Task=`3277de62-65a1-48b0-af24-7c6212674fb5`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:13:45,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:13:45,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:13:45,511::task::1168::TaskManager.Task::(prepare) Task=`3277de62-65a1-48b0-af24-7c6212674fb5`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:13:45,511::task::579::TaskManager.Task::(_updateState) Task=`3277de62-65a1-48b0-af24-7c6212674fb5`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:13:45,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:13:45,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:13:45,512::task::974::TaskManager.Task::(_decref) Task=`3277de62-65a1-48b0-af24-7c6212674fb5`::ref 0 aborting False >Thread-287732::DEBUG::2014-01-16 17:13:46,103::task::579::TaskManager.Task::(_updateState) Task=`d68a3c38-93a9-4572-8cc5-5f38034e934b`::moving from state init -> state preparing >Thread-287732::INFO::2014-01-16 17:13:46,104::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287732::INFO::2014-01-16 17:13:46,104::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030535', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023248', 'lastCheck': '9.6', 'valid': True}} >Thread-287732::DEBUG::2014-01-16 17:13:46,104::task::1168::TaskManager.Task::(prepare) Task=`d68a3c38-93a9-4572-8cc5-5f38034e934b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030535', 'lastCheck': '1.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023248', 'lastCheck': '9.6', 'valid': True}} >Thread-287732::DEBUG::2014-01-16 17:13:46,104::task::579::TaskManager.Task::(_updateState) Task=`d68a3c38-93a9-4572-8cc5-5f38034e934b`::moving from state preparing -> state finished >Thread-287732::DEBUG::2014-01-16 17:13:46,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287732::DEBUG::2014-01-16 17:13:46,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287732::DEBUG::2014-01-16 17:13:46,105::task::974::TaskManager.Task::(_decref) Task=`d68a3c38-93a9-4572-8cc5-5f38034e934b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:46,379::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:13:46,498::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:13:46,516::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000261459 s, 15.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:47,351::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:47,353::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:13:47,353::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:13:47,355::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:47,380::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:13:47,380::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:48,382::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:49,356::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:49,384::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:50,385::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:51,357::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:51,386::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:13:52,253::task::579::TaskManager.Task::(_updateState) Task=`7f41cc24-1eb3-437d-a0d5-6d24af68938c`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:13:52,253::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:13:52,253::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:13:52,253::task::1168::TaskManager.Task::(prepare) Task=`7f41cc24-1eb3-437d-a0d5-6d24af68938c`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:13:52,253::task::579::TaskManager.Task::(_updateState) Task=`7f41cc24-1eb3-437d-a0d5-6d24af68938c`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:13:52,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:13:52,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:13:52,254::task::974::TaskManager.Task::(_decref) Task=`7f41cc24-1eb3-437d-a0d5-6d24af68938c`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:13:52,254::task::579::TaskManager.Task::(_updateState) Task=`698b0542-55db-4259-9743-10902fb48a22`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:13:52,254::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:13:52,255::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:13:52,255::task::1168::TaskManager.Task::(prepare) Task=`698b0542-55db-4259-9743-10902fb48a22`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:13:52,255::task::579::TaskManager.Task::(_updateState) Task=`698b0542-55db-4259-9743-10902fb48a22`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:13:52,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:13:52,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:13:52,255::task::974::TaskManager.Task::(_decref) Task=`698b0542-55db-4259-9743-10902fb48a22`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:13:52,256::task::579::TaskManager.Task::(_updateState) Task=`d623759e-5f83-4e18-bfca-c13b64fdee71`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:13:52,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:13:52,256::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:13:52,256::task::1168::TaskManager.Task::(prepare) Task=`d623759e-5f83-4e18-bfca-c13b64fdee71`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:13:52,256::task::579::TaskManager.Task::(_updateState) Task=`d623759e-5f83-4e18-bfca-c13b64fdee71`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:13:52,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:13:52,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:13:52,257::task::974::TaskManager.Task::(_decref) Task=`d623759e-5f83-4e18-bfca-c13b64fdee71`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:52,358::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:52,387::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:13:52,666::task::579::TaskManager.Task::(_updateState) Task=`cdd5c8ee-9c1f-4fe5-b0bb-45db3881c3c4`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:13:52,666::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:13:52,666::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:13:52,667::task::1168::TaskManager.Task::(prepare) Task=`cdd5c8ee-9c1f-4fe5-b0bb-45db3881c3c4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:13:52,667::task::579::TaskManager.Task::(_updateState) Task=`cdd5c8ee-9c1f-4fe5-b0bb-45db3881c3c4`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:13:52,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:13:52,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:13:52,667::task::974::TaskManager.Task::(_decref) Task=`cdd5c8ee-9c1f-4fe5-b0bb-45db3881c3c4`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:13:53,360::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:53,388::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:13:53,388::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:54,390::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:13:54,961::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:13:54,977::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000332569 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:55,361::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:55,391::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:13:56,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:13:56,522::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:13:56,539::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000274411 s, 14.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:13:57,363::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:13:57,364::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:57,394::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:13:57,855::task::579::TaskManager.Task::(_updateState) Task=`cd36792e-6fd1-4665-bfe1-38cb8baecb85`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:13:57,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:13:57,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:13:57,856::task::1168::TaskManager.Task::(prepare) Task=`cd36792e-6fd1-4665-bfe1-38cb8baecb85`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:13:57,856::task::579::TaskManager.Task::(_updateState) Task=`cd36792e-6fd1-4665-bfe1-38cb8baecb85`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:13:57,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:13:57,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:13:57,856::task::974::TaskManager.Task::(_decref) Task=`cd36792e-6fd1-4665-bfe1-38cb8baecb85`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:13:58,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:13:58,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:13:58,395::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:13:59,365::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:13:59,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:13:59,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:00,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:14:00,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:14:00,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:01,366::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:01,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:14:01,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287738::DEBUG::2014-01-16 17:14:01,859::task::579::TaskManager.Task::(_updateState) Task=`d2e40d9c-8f87-4561-bf38-b045fe0fd3f6`::moving from state init -> state preparing >Thread-287738::INFO::2014-01-16 17:14:01,859::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287738::INFO::2014-01-16 17:14:01,859::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332569', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274411', 'lastCheck': '5.3', 'valid': True}} >Thread-287738::DEBUG::2014-01-16 17:14:01,860::task::1168::TaskManager.Task::(prepare) Task=`d2e40d9c-8f87-4561-bf38-b045fe0fd3f6`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000332569', 'lastCheck': '6.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274411', 'lastCheck': '5.3', 'valid': True}} >Thread-287738::DEBUG::2014-01-16 17:14:01,860::task::579::TaskManager.Task::(_updateState) Task=`d2e40d9c-8f87-4561-bf38-b045fe0fd3f6`::moving from state preparing -> state finished >Thread-287738::DEBUG::2014-01-16 17:14:01,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287738::DEBUG::2014-01-16 17:14:01,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287738::DEBUG::2014-01-16 17:14:01,860::task::974::TaskManager.Task::(_decref) Task=`d2e40d9c-8f87-4561-bf38-b045fe0fd3f6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:02,368::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:14:02,369::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:14:02,370::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:02,399::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:14:02,400::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:03,371::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:03,401::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:04,402::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:14:04,402::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:14:04,600::task::579::TaskManager.Task::(_updateState) Task=`d3a548e5-6036-4012-a989-6aa6299a45cc`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:14:04,600::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:14:04,600::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:14:04,601::task::1168::TaskManager.Task::(prepare) Task=`d3a548e5-6036-4012-a989-6aa6299a45cc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:14:04,601::task::579::TaskManager.Task::(_updateState) Task=`d3a548e5-6036-4012-a989-6aa6299a45cc`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:14:04,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:14:04,601::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:14:04,601::task::974::TaskManager.Task::(_decref) Task=`d3a548e5-6036-4012-a989-6aa6299a45cc`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:14:04,985::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:14:05,002::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266661 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:05,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:05,403::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:14:05,404::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:06,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:14:06,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:14:06,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:14:06,406::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:14:06,545::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:14:06,562::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218504 s, 18.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:07,377::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:07,378::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:07,407::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:14:07,407::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:14:07,408::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:14:08,403::task::579::TaskManager.Task::(_updateState) Task=`12d79597-10da-4d1a-a5c1-3efc8b22c87a`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:14:08,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:14:08,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:14:08,405::task::1168::TaskManager.Task::(prepare) Task=`12d79597-10da-4d1a-a5c1-3efc8b22c87a`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:14:08,405::task::579::TaskManager.Task::(_updateState) Task=`12d79597-10da-4d1a-a5c1-3efc8b22c87a`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:14:08,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:14:08,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:14:08,405::task::974::TaskManager.Task::(_decref) Task=`12d79597-10da-4d1a-a5c1-3efc8b22c87a`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:14:08,410::task::579::TaskManager.Task::(_updateState) Task=`997a6c5a-48d5-44ad-8de8-b164274c8591`::moving from state init -> state preparing >VM Channels Listener::DEBUG::2014-01-16 17:14:08,410::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:14:08,412::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251782::INFO::2014-01-16 17:14:08,412::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:14:08,414::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:14:08,414::task::1168::TaskManager.Task::(prepare) Task=`997a6c5a-48d5-44ad-8de8-b164274c8591`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:14:08,414::task::579::TaskManager.Task::(_updateState) Task=`997a6c5a-48d5-44ad-8de8-b164274c8591`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:14:08,414::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:14:08,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:14:08,415::task::974::TaskManager.Task::(_decref) Task=`997a6c5a-48d5-44ad-8de8-b164274c8591`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:09,379::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:09,414::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:14:09,414::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:14:09,415::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:14:09,415::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:14:10,376::task::579::TaskManager.Task::(_updateState) Task=`1e55b3bc-25f9-4787-9068-ccc1004aefc8`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:14:10,376::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:14:10,376::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:14:10,377::task::1168::TaskManager.Task::(prepare) Task=`1e55b3bc-25f9-4787-9068-ccc1004aefc8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:14:10,377::task::579::TaskManager.Task::(_updateState) Task=`1e55b3bc-25f9-4787-9068-ccc1004aefc8`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:14:10,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:14:10,377::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:14:10,377::task::974::TaskManager.Task::(_decref) Task=`1e55b3bc-25f9-4787-9068-ccc1004aefc8`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:14:10,377::task::579::TaskManager.Task::(_updateState) Task=`eff86a45-1c78-4fd9-bc8c-5267afa362d8`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:14:10,378::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:14:10,378::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:14:10,378::task::1168::TaskManager.Task::(prepare) Task=`eff86a45-1c78-4fd9-bc8c-5267afa362d8`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:14:10,378::task::579::TaskManager.Task::(_updateState) Task=`eff86a45-1c78-4fd9-bc8c-5267afa362d8`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:14:10,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:14:10,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:14:10,378::task::974::TaskManager.Task::(_decref) Task=`eff86a45-1c78-4fd9-bc8c-5267afa362d8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:10,416::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:11,381::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:11,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:14:11,417::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:14:11,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:14:11,418::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:11,418::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:14:11,419::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:14:11,635::task::579::TaskManager.Task::(_updateState) Task=`1f2220a0-adf7-449a-b4d7-00e5c5bf826c`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:14:11,635::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:14:11,636::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:14:11,636::task::1168::TaskManager.Task::(prepare) Task=`1f2220a0-adf7-449a-b4d7-00e5c5bf826c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:14:11,636::task::579::TaskManager.Task::(_updateState) Task=`1f2220a0-adf7-449a-b4d7-00e5c5bf826c`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:14:11,636::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:14:11,636::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:14:11,636::task::974::TaskManager.Task::(_decref) Task=`1f2220a0-adf7-449a-b4d7-00e5c5bf826c`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:14:11,706::task::579::TaskManager.Task::(_updateState) Task=`23c62fdf-6680-44ef-9b5a-97aace0098aa`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:14:11,706::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:14:11,706::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:14:11,706::task::1168::TaskManager.Task::(prepare) Task=`23c62fdf-6680-44ef-9b5a-97aace0098aa`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:14:11,707::task::579::TaskManager.Task::(_updateState) Task=`23c62fdf-6680-44ef-9b5a-97aace0098aa`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:14:11,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:14:11,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:14:11,707::task::974::TaskManager.Task::(_decref) Task=`23c62fdf-6680-44ef-9b5a-97aace0098aa`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:14:11,707::task::579::TaskManager.Task::(_updateState) Task=`e9c901ee-4393-412e-85dc-8b1ddbad44fb`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:14:11,707::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:14:11,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:14:11,708::task::1168::TaskManager.Task::(prepare) Task=`e9c901ee-4393-412e-85dc-8b1ddbad44fb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:14:11,708::task::579::TaskManager.Task::(_updateState) Task=`e9c901ee-4393-412e-85dc-8b1ddbad44fb`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:14:11,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:14:11,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:14:11,708::task::974::TaskManager.Task::(_decref) Task=`e9c901ee-4393-412e-85dc-8b1ddbad44fb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:12,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:12,420::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:13,383::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:13,420::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:14:13,421::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:14:13,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:14,422::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:14:14,422::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:14:14,422::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:14:15,010::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:14:15,027::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000285503 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:15,385::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:15,423::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:14:15,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:14:15,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:14:15,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:14:15,552::task::579::TaskManager.Task::(_updateState) Task=`fb6c5085-a4eb-4eb1-9c7b-720ae3f42cf5`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:14:15,553::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:14:15,553::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:14:15,553::task::1168::TaskManager.Task::(prepare) Task=`fb6c5085-a4eb-4eb1-9c7b-720ae3f42cf5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:14:15,554::task::579::TaskManager.Task::(_updateState) Task=`fb6c5085-a4eb-4eb1-9c7b-720ae3f42cf5`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:14:15,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:14:15,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:14:15,554::task::974::TaskManager.Task::(_decref) Task=`fb6c5085-a4eb-4eb1-9c7b-720ae3f42cf5`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:14:15,633::task::579::TaskManager.Task::(_updateState) Task=`c1b2935e-3edd-41f0-8652-39ca32cbcc64`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:14:15,634::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:14:15,634::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:14:15,634::task::1168::TaskManager.Task::(prepare) Task=`c1b2935e-3edd-41f0-8652-39ca32cbcc64`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:14:15,634::task::579::TaskManager.Task::(_updateState) Task=`c1b2935e-3edd-41f0-8652-39ca32cbcc64`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:14:15,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:14:15,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:14:15,635::task::974::TaskManager.Task::(_decref) Task=`c1b2935e-3edd-41f0-8652-39ca32cbcc64`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:16,425::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:14:16,567::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:14:16,585::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000371611 s, 11.0 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:14:16,712::task::579::TaskManager.Task::(_updateState) Task=`b1b10449-16ff-4ee3-977d-2379a49c9494`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:14:16,713::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:14:16,713::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:14:16,713::task::1168::TaskManager.Task::(prepare) Task=`b1b10449-16ff-4ee3-977d-2379a49c9494`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:14:16,713::task::579::TaskManager.Task::(_updateState) Task=`b1b10449-16ff-4ee3-977d-2379a49c9494`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:14:16,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:14:16,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:14:16,714::task::974::TaskManager.Task::(_decref) Task=`b1b10449-16ff-4ee3-977d-2379a49c9494`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:17,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:17,387::task::579::TaskManager.Task::(_updateState) Task=`a6506042-2a7f-4629-b38a-2ed92c3f4365`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:14:17,387::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:14:17,388::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:14:17,388::task::1168::TaskManager.Task::(prepare) Task=`a6506042-2a7f-4629-b38a-2ed92c3f4365`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:14:17,388::task::579::TaskManager.Task::(_updateState) Task=`a6506042-2a7f-4629-b38a-2ed92c3f4365`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:14:17,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:14:17,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:14:17,389::task::974::TaskManager.Task::(_decref) Task=`a6506042-2a7f-4629-b38a-2ed92c3f4365`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:17,391::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:14:17,391::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:14:17,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:17,395::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:17,396::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:17,425::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:14:17,426::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287744::DEBUG::2014-01-16 17:14:17,608::task::579::TaskManager.Task::(_updateState) Task=`17ccc010-dcc6-432d-a36a-062de898f8a0`::moving from state init -> state preparing >Thread-287744::INFO::2014-01-16 17:14:17,608::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287744::INFO::2014-01-16 17:14:17,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000285503', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371611', 'lastCheck': '1.0', 'valid': True}} >Thread-287744::DEBUG::2014-01-16 17:14:17,609::task::1168::TaskManager.Task::(prepare) Task=`17ccc010-dcc6-432d-a36a-062de898f8a0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000285503', 'lastCheck': '2.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371611', 'lastCheck': '1.0', 'valid': True}} >Thread-287744::DEBUG::2014-01-16 17:14:17,609::task::579::TaskManager.Task::(_updateState) Task=`17ccc010-dcc6-432d-a36a-062de898f8a0`::moving from state preparing -> state finished >Thread-287744::DEBUG::2014-01-16 17:14:17,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287744::DEBUG::2014-01-16 17:14:17,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287744::DEBUG::2014-01-16 17:14:17,610::task::974::TaskManager.Task::(_decref) Task=`17ccc010-dcc6-432d-a36a-062de898f8a0`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 17:14:17,646::task::579::TaskManager.Task::(_updateState) Task=`5672c7fe-0cad-4c09-b8f7-d9896433c23d`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:14:17,646::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:14:17,647::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:14:17,647::task::1168::TaskManager.Task::(prepare) Task=`5672c7fe-0cad-4c09-b8f7-d9896433c23d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:14:17,647::task::579::TaskManager.Task::(_updateState) Task=`5672c7fe-0cad-4c09-b8f7-d9896433c23d`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:14:17,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:14:17,647::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:14:17,647::task::974::TaskManager.Task::(_decref) Task=`5672c7fe-0cad-4c09-b8f7-d9896433c23d`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:14:17,703::task::579::TaskManager.Task::(_updateState) Task=`c7e53757-a43c-4d66-bef5-4e5e23284db7`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:14:17,706::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:14:17,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:14:17,709::task::1168::TaskManager.Task::(prepare) Task=`c7e53757-a43c-4d66-bef5-4e5e23284db7`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:14:17,711::task::579::TaskManager.Task::(_updateState) Task=`c7e53757-a43c-4d66-bef5-4e5e23284db7`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:14:17,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:14:17,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:14:17,716::task::974::TaskManager.Task::(_decref) Task=`c7e53757-a43c-4d66-bef5-4e5e23284db7`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:14:17,719::task::579::TaskManager.Task::(_updateState) Task=`8fe34051-1408-480f-8cab-4465eaf8f49b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:14:17,721::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:14:17,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:14:17,725::task::1168::TaskManager.Task::(prepare) Task=`8fe34051-1408-480f-8cab-4465eaf8f49b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:14:17,727::task::579::TaskManager.Task::(_updateState) Task=`8fe34051-1408-480f-8cab-4465eaf8f49b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:14:17,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:14:17,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:14:17,732::task::974::TaskManager.Task::(_decref) Task=`8fe34051-1408-480f-8cab-4465eaf8f49b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:18,427::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:19,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:19,428::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:14:19,969::task::579::TaskManager.Task::(_updateState) Task=`11d6fdb4-a0c2-4e7e-9809-77e222b09c05`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:14:19,970::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:14:19,970::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:14:19,970::task::1168::TaskManager.Task::(prepare) Task=`11d6fdb4-a0c2-4e7e-9809-77e222b09c05`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:14:19,970::task::579::TaskManager.Task::(_updateState) Task=`11d6fdb4-a0c2-4e7e-9809-77e222b09c05`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:14:19,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:14:19,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:14:19,971::task::974::TaskManager.Task::(_decref) Task=`11d6fdb4-a0c2-4e7e-9809-77e222b09c05`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:20,429::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:21,398::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:21,431::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:14:21,673::task::579::TaskManager.Task::(_updateState) Task=`7fc19074-e2ee-48d5-ba83-a22f2f24a150`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:14:21,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:14:21,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:14:21,674::task::1168::TaskManager.Task::(prepare) Task=`7fc19074-e2ee-48d5-ba83-a22f2f24a150`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:14:21,674::task::579::TaskManager.Task::(_updateState) Task=`7fc19074-e2ee-48d5-ba83-a22f2f24a150`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:14:21,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:14:21,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:14:21,674::task::974::TaskManager.Task::(_decref) Task=`7fc19074-e2ee-48d5-ba83-a22f2f24a150`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:22,399::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:22,431::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:23,401::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:14:23,413::task::579::TaskManager.Task::(_updateState) Task=`60cabd02-b5d9-49bb-9292-5012d9cd3a6d`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:14:23,413::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:14:23,413::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:14:23,414::task::1168::TaskManager.Task::(prepare) Task=`60cabd02-b5d9-49bb-9292-5012d9cd3a6d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:14:23,414::task::579::TaskManager.Task::(_updateState) Task=`60cabd02-b5d9-49bb-9292-5012d9cd3a6d`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:14:23,414::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:14:23,414::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:14:23,414::task::974::TaskManager.Task::(_decref) Task=`60cabd02-b5d9-49bb-9292-5012d9cd3a6d`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:14:23,414::task::579::TaskManager.Task::(_updateState) Task=`6b62450b-98a6-4110-af56-e51b7e1dc8cc`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:14:23,415::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:14:23,415::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:14:23,415::task::1168::TaskManager.Task::(prepare) Task=`6b62450b-98a6-4110-af56-e51b7e1dc8cc`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:14:23,415::task::579::TaskManager.Task::(_updateState) Task=`6b62450b-98a6-4110-af56-e51b7e1dc8cc`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:14:23,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:14:23,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:14:23,416::task::974::TaskManager.Task::(_decref) Task=`6b62450b-98a6-4110-af56-e51b7e1dc8cc`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:14:23,416::task::579::TaskManager.Task::(_updateState) Task=`fbc05d6e-878a-4fa6-b498-732e6d453519`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:14:23,416::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:14:23,416::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:14:23,416::task::1168::TaskManager.Task::(prepare) Task=`fbc05d6e-878a-4fa6-b498-732e6d453519`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:14:23,417::task::579::TaskManager.Task::(_updateState) Task=`fbc05d6e-878a-4fa6-b498-732e6d453519`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:14:23,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:14:23,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:14:23,417::task::974::TaskManager.Task::(_decref) Task=`fbc05d6e-878a-4fa6-b498-732e6d453519`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:23,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:14:23,433::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:24,433::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:14:24,660::task::579::TaskManager.Task::(_updateState) Task=`f1459a62-fcbb-48ea-97b8-6a87905b6de3`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:14:24,660::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:14:24,660::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:14:24,660::task::1168::TaskManager.Task::(prepare) Task=`f1459a62-fcbb-48ea-97b8-6a87905b6de3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:14:24,661::task::579::TaskManager.Task::(_updateState) Task=`f1459a62-fcbb-48ea-97b8-6a87905b6de3`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:14:24,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:14:24,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:14:24,661::task::974::TaskManager.Task::(_decref) Task=`f1459a62-fcbb-48ea-97b8-6a87905b6de3`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:14:25,035::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:14:25,053::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00034217 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:25,402::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:25,435::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:26,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:14:26,591::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:14:26,608::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000300567 s, 13.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:27,404::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:27,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 17:14:27,410::task::579::TaskManager.Task::(_updateState) Task=`c9003a17-b6d4-4cfe-8c96-e5c6623a4604`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:14:27,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:14:27,411::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:14:27,411::task::1168::TaskManager.Task::(prepare) Task=`c9003a17-b6d4-4cfe-8c96-e5c6623a4604`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:14:27,411::task::579::TaskManager.Task::(_updateState) Task=`c9003a17-b6d4-4cfe-8c96-e5c6623a4604`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:14:27,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:14:27,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:14:27,412::task::974::TaskManager.Task::(_decref) Task=`c9003a17-b6d4-4cfe-8c96-e5c6623a4604`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:27,437::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:28,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:14:28,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:14:28,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:29,406::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:29,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:14:29,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:30,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:14:30,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:14:30,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:31,407::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:31,443::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:14:31,443::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:14:32,238::task::579::TaskManager.Task::(_updateState) Task=`635b86ce-1181-48a9-949e-b12e50ecd961`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:14:32,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:14:32,239::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:14:32,239::task::1168::TaskManager.Task::(prepare) Task=`635b86ce-1181-48a9-949e-b12e50ecd961`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:14:32,239::task::579::TaskManager.Task::(_updateState) Task=`635b86ce-1181-48a9-949e-b12e50ecd961`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:14:32,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:14:32,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:14:32,240::task::974::TaskManager.Task::(_decref) Task=`635b86ce-1181-48a9-949e-b12e50ecd961`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:32,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:14:32,409::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:14:32,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:32,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:14:32,445::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:33,412::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:33,446::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287750::DEBUG::2014-01-16 17:14:33,705::task::579::TaskManager.Task::(_updateState) Task=`eda730d4-3173-4914-a8bc-493fa6ce201e`::moving from state init -> state preparing >Thread-287750::INFO::2014-01-16 17:14:33,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287750::INFO::2014-01-16 17:14:33,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034217', 'lastCheck': '8.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300567', 'lastCheck': '7.1', 'valid': True}} >Thread-287750::DEBUG::2014-01-16 17:14:33,706::task::1168::TaskManager.Task::(prepare) Task=`eda730d4-3173-4914-a8bc-493fa6ce201e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034217', 'lastCheck': '8.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300567', 'lastCheck': '7.1', 'valid': True}} >Thread-287750::DEBUG::2014-01-16 17:14:33,706::task::579::TaskManager.Task::(_updateState) Task=`eda730d4-3173-4914-a8bc-493fa6ce201e`::moving from state preparing -> state finished >Thread-287750::DEBUG::2014-01-16 17:14:33,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287750::DEBUG::2014-01-16 17:14:33,706::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287750::DEBUG::2014-01-16 17:14:33,706::task::974::TaskManager.Task::(_decref) Task=`eda730d4-3173-4914-a8bc-493fa6ce201e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:34,448::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:14:34,448::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:14:35,061::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:14:35,077::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000337711 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:35,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:35,449::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:14:35,449::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:14:36,105::task::579::TaskManager.Task::(_updateState) Task=`2f969e60-a943-4c90-b126-b032fbb1ce75`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:14:36,106::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:14:36,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:14:36,106::task::1168::TaskManager.Task::(prepare) Task=`2f969e60-a943-4c90-b126-b032fbb1ce75`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:14:36,107::task::579::TaskManager.Task::(_updateState) Task=`2f969e60-a943-4c90-b126-b032fbb1ce75`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:14:36,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:14:36,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:14:36,107::task::974::TaskManager.Task::(_decref) Task=`2f969e60-a943-4c90-b126-b032fbb1ce75`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:14:36,113::task::579::TaskManager.Task::(_updateState) Task=`a6229dcc-e397-4821-ad3c-88733a3913fa`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:14:36,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:14:36,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:14:36,114::task::1168::TaskManager.Task::(prepare) Task=`a6229dcc-e397-4821-ad3c-88733a3913fa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:14:36,114::task::579::TaskManager.Task::(_updateState) Task=`a6229dcc-e397-4821-ad3c-88733a3913fa`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:14:36,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:14:36,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:14:36,114::task::974::TaskManager.Task::(_decref) Task=`a6229dcc-e397-4821-ad3c-88733a3913fa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:36,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:14:36,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:14:36,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:14:36,452::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:14:36,614::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:14:36,630::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00026227 s, 15.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:37,416::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:37,417::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:37,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:14:37,453::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:14:37,453::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:38,454::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:14:38,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:14:39,034::task::579::TaskManager.Task::(_updateState) Task=`a0acd1ab-1c69-47a0-a6e4-5ec628c8c880`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:14:39,035::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:14:39,035::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:14:39,035::task::1168::TaskManager.Task::(prepare) Task=`a0acd1ab-1c69-47a0-a6e4-5ec628c8c880`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:14:39,035::task::579::TaskManager.Task::(_updateState) Task=`a0acd1ab-1c69-47a0-a6e4-5ec628c8c880`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:14:39,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:14:39,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:14:39,036::task::974::TaskManager.Task::(_decref) Task=`a0acd1ab-1c69-47a0-a6e4-5ec628c8c880`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:14:39,036::task::579::TaskManager.Task::(_updateState) Task=`05b2bf5c-8836-4380-acc8-336eb7c87b43`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:14:39,036::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:14:39,036::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:14:39,037::task::1168::TaskManager.Task::(prepare) Task=`05b2bf5c-8836-4380-acc8-336eb7c87b43`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:14:39,037::task::579::TaskManager.Task::(_updateState) Task=`05b2bf5c-8836-4380-acc8-336eb7c87b43`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:14:39,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:14:39,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:14:39,037::task::974::TaskManager.Task::(_decref) Task=`05b2bf5c-8836-4380-acc8-336eb7c87b43`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:39,418::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:39,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:14:39,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:14:39,456::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:14:39,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:40,458::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:41,420::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:41,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:14:41,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:14:41,459::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:14:41,459::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:41,460::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:14:41,460::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:14:41,721::task::579::TaskManager.Task::(_updateState) Task=`b1c53e70-b1b3-40a4-986e-79eaf5f24aa5`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:14:41,721::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:14:41,721::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:14:41,721::task::1168::TaskManager.Task::(prepare) Task=`b1c53e70-b1b3-40a4-986e-79eaf5f24aa5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:14:41,722::task::579::TaskManager.Task::(_updateState) Task=`b1c53e70-b1b3-40a4-986e-79eaf5f24aa5`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:14:41,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:14:41,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:14:41,722::task::974::TaskManager.Task::(_decref) Task=`b1c53e70-b1b3-40a4-986e-79eaf5f24aa5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:42,421::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:42,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:43,422::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:43,461::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:14:43,462::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:14:43,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:14:43,624::task::579::TaskManager.Task::(_updateState) Task=`76817d97-c988-4251-8eec-cc73442e8391`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:14:43,624::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:14:43,625::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:14:43,625::task::1168::TaskManager.Task::(prepare) Task=`76817d97-c988-4251-8eec-cc73442e8391`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:14:43,625::task::579::TaskManager.Task::(_updateState) Task=`76817d97-c988-4251-8eec-cc73442e8391`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:14:43,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:14:43,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:14:43,625::task::974::TaskManager.Task::(_decref) Task=`76817d97-c988-4251-8eec-cc73442e8391`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:44,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:14:44,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:14:44,464::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 17:14:44,722::task::579::TaskManager.Task::(_updateState) Task=`871b2a0f-7f08-48eb-a4df-f63a76b8411c`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:14:44,722::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:14:44,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:14:44,723::task::1168::TaskManager.Task::(prepare) Task=`871b2a0f-7f08-48eb-a4df-f63a76b8411c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:14:44,723::task::579::TaskManager.Task::(_updateState) Task=`871b2a0f-7f08-48eb-a4df-f63a76b8411c`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:14:44,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:14:44,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:14:44,723::task::974::TaskManager.Task::(_decref) Task=`871b2a0f-7f08-48eb-a4df-f63a76b8411c`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:14:44,730::task::579::TaskManager.Task::(_updateState) Task=`1a970068-1712-4239-bfb8-910ed1f54014`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:14:44,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:14:44,730::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:14:44,731::task::1168::TaskManager.Task::(prepare) Task=`1a970068-1712-4239-bfb8-910ed1f54014`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:14:44,731::task::579::TaskManager.Task::(_updateState) Task=`1a970068-1712-4239-bfb8-910ed1f54014`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:14:44,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:14:44,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:14:44,731::task::974::TaskManager.Task::(_decref) Task=`1a970068-1712-4239-bfb8-910ed1f54014`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:14:44,734::task::579::TaskManager.Task::(_updateState) Task=`84bbdecb-ae3e-4e7c-b7cf-5ee092bc4b45`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:14:44,734::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:14:44,734::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:14:44,735::task::1168::TaskManager.Task::(prepare) Task=`84bbdecb-ae3e-4e7c-b7cf-5ee092bc4b45`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:14:44,735::task::579::TaskManager.Task::(_updateState) Task=`84bbdecb-ae3e-4e7c-b7cf-5ee092bc4b45`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:14:44,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:14:44,735::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:14:44,735::task::974::TaskManager.Task::(_decref) Task=`84bbdecb-ae3e-4e7c-b7cf-5ee092bc4b45`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:14:45,087::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:14:45,107::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000280726 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:45,424::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:45,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:14:45,465::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:14:45,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:14:45,466::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:14:45,653::task::579::TaskManager.Task::(_updateState) Task=`980954c8-9c96-4a6b-833a-2d737ea6c8a9`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:14:45,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:14:45,653::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:14:45,654::task::1168::TaskManager.Task::(prepare) Task=`980954c8-9c96-4a6b-833a-2d737ea6c8a9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:14:45,654::task::579::TaskManager.Task::(_updateState) Task=`980954c8-9c96-4a6b-833a-2d737ea6c8a9`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:14:45,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:14:45,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:14:45,654::task::974::TaskManager.Task::(_decref) Task=`980954c8-9c96-4a6b-833a-2d737ea6c8a9`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:14:45,671::task::579::TaskManager.Task::(_updateState) Task=`05d8eaf7-7222-4bcf-9c8d-f669dce1ce93`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:14:45,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:14:45,672::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:14:45,672::task::1168::TaskManager.Task::(prepare) Task=`05d8eaf7-7222-4bcf-9c8d-f669dce1ce93`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:14:45,672::task::579::TaskManager.Task::(_updateState) Task=`05d8eaf7-7222-4bcf-9c8d-f669dce1ce93`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:14:45,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:14:45,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:14:45,673::task::974::TaskManager.Task::(_decref) Task=`05d8eaf7-7222-4bcf-9c8d-f669dce1ce93`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:46,467::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:14:46,636::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:14:46,653::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000256103 s, 16.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:47,425::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:47,427::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:14:47,427::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:14:47,429::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:47,468::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:14:47,468::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:48,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287756::DEBUG::2014-01-16 17:14:49,416::task::579::TaskManager.Task::(_updateState) Task=`b69a1a2e-f0a7-4e30-8687-e7fc279ad67c`::moving from state init -> state preparing >Thread-287756::INFO::2014-01-16 17:14:49,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287756::INFO::2014-01-16 17:14:49,416::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000280726', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256103', 'lastCheck': '2.8', 'valid': True}} >Thread-287756::DEBUG::2014-01-16 17:14:49,417::task::1168::TaskManager.Task::(prepare) Task=`b69a1a2e-f0a7-4e30-8687-e7fc279ad67c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000280726', 'lastCheck': '4.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256103', 'lastCheck': '2.8', 'valid': True}} >Thread-287756::DEBUG::2014-01-16 17:14:49,417::task::579::TaskManager.Task::(_updateState) Task=`b69a1a2e-f0a7-4e30-8687-e7fc279ad67c`::moving from state preparing -> state finished >Thread-287756::DEBUG::2014-01-16 17:14:49,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287756::DEBUG::2014-01-16 17:14:49,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287756::DEBUG::2014-01-16 17:14:49,417::task::974::TaskManager.Task::(_decref) Task=`b69a1a2e-f0a7-4e30-8687-e7fc279ad67c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:49,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:49,470::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:50,471::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:51,431::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:51,472::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:52,433::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:52,473::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:14:52,529::task::579::TaskManager.Task::(_updateState) Task=`6933212e-cea6-4e51-a843-69a189931a61`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:14:52,529::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:14:52,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:14:52,530::task::1168::TaskManager.Task::(prepare) Task=`6933212e-cea6-4e51-a843-69a189931a61`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:14:52,530::task::579::TaskManager.Task::(_updateState) Task=`6933212e-cea6-4e51-a843-69a189931a61`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:14:52,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:14:52,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:14:52,531::task::974::TaskManager.Task::(_decref) Task=`6933212e-cea6-4e51-a843-69a189931a61`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:14:52,531::task::579::TaskManager.Task::(_updateState) Task=`c5d94141-c44b-4979-8459-0f5583cb6dfd`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:14:52,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:14:52,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:14:52,532::task::1168::TaskManager.Task::(prepare) Task=`c5d94141-c44b-4979-8459-0f5583cb6dfd`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:14:52,532::task::579::TaskManager.Task::(_updateState) Task=`c5d94141-c44b-4979-8459-0f5583cb6dfd`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:14:52,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:14:52,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:14:52,533::task::974::TaskManager.Task::(_decref) Task=`c5d94141-c44b-4979-8459-0f5583cb6dfd`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:14:52,533::task::579::TaskManager.Task::(_updateState) Task=`7fef3b90-f98a-4b4a-903b-8bca4c909a24`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:14:52,533::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:14:52,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:14:52,534::task::1168::TaskManager.Task::(prepare) Task=`7fef3b90-f98a-4b4a-903b-8bca4c909a24`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:14:52,534::task::579::TaskManager.Task::(_updateState) Task=`7fef3b90-f98a-4b4a-903b-8bca4c909a24`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:14:52,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:14:52,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:14:52,534::task::974::TaskManager.Task::(_decref) Task=`7fef3b90-f98a-4b4a-903b-8bca4c909a24`::ref 0 aborting False >Thread-16244::DEBUG::2014-01-16 17:14:52,838::task::579::TaskManager.Task::(_updateState) Task=`c6ba0fae-ddd3-40fc-ac6d-8c5c649bcd83`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:14:52,838::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:14:52,838::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:14:52,839::task::1168::TaskManager.Task::(prepare) Task=`c6ba0fae-ddd3-40fc-ac6d-8c5c649bcd83`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:14:52,839::task::579::TaskManager.Task::(_updateState) Task=`c6ba0fae-ddd3-40fc-ac6d-8c5c649bcd83`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:14:52,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:14:52,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:14:52,840::task::974::TaskManager.Task::(_decref) Task=`c6ba0fae-ddd3-40fc-ac6d-8c5c649bcd83`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:14:53,434::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:53,474::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:14:53,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:54,476::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:14:55,114::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:14:55,131::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002816 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:55,436::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:55,477::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:14:56,478::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:14:56,658::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:14:56,675::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000229941 s, 17.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:14:57,437::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:14:57,438::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:57,479::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:14:58,035::task::579::TaskManager.Task::(_updateState) Task=`84e5b993-8690-46ce-b60f-83b224e4efd2`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:14:58,036::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:14:58,036::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:14:58,036::task::1168::TaskManager.Task::(prepare) Task=`84e5b993-8690-46ce-b60f-83b224e4efd2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:14:58,036::task::579::TaskManager.Task::(_updateState) Task=`84e5b993-8690-46ce-b60f-83b224e4efd2`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:14:58,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:14:58,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:14:58,037::task::974::TaskManager.Task::(_decref) Task=`84e5b993-8690-46ce-b60f-83b224e4efd2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:14:58,481::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:14:58,481::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:14:58,481::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:14:59,439::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:14:59,483::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:14:59,483::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:00,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:15:00,485::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:15:00,485::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:01,440::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:01,485::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:15:01,486::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:02,442::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:15:02,443::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:15:02,444::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:02,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:15:02,487::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:03,445::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:03,488::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:04,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:15:04,490::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:15:04,783::task::579::TaskManager.Task::(_updateState) Task=`7925ee94-f70d-4fcb-96df-e877ca5142ed`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:15:04,784::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:15:04,784::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:15:04,784::task::1168::TaskManager.Task::(prepare) Task=`7925ee94-f70d-4fcb-96df-e877ca5142ed`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:15:04,784::task::579::TaskManager.Task::(_updateState) Task=`7925ee94-f70d-4fcb-96df-e877ca5142ed`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:15:04,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:15:04,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:15:04,784::task::974::TaskManager.Task::(_decref) Task=`7925ee94-f70d-4fcb-96df-e877ca5142ed`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:15:05,139::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:15:05,156::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000295689 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:05,447::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:05,491::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:15:05,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287762::DEBUG::2014-01-16 17:15:05,508::task::579::TaskManager.Task::(_updateState) Task=`9d9e0ee7-1f57-4fe7-b5e7-3714f79830be`::moving from state init -> state preparing >Thread-287762::INFO::2014-01-16 17:15:05,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287762::INFO::2014-01-16 17:15:05,509::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295689', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229941', 'lastCheck': '8.8', 'valid': True}} >Thread-287762::DEBUG::2014-01-16 17:15:05,509::task::1168::TaskManager.Task::(prepare) Task=`9d9e0ee7-1f57-4fe7-b5e7-3714f79830be`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295689', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229941', 'lastCheck': '8.8', 'valid': True}} >Thread-287762::DEBUG::2014-01-16 17:15:05,509::task::579::TaskManager.Task::(_updateState) Task=`9d9e0ee7-1f57-4fe7-b5e7-3714f79830be`::moving from state preparing -> state finished >Thread-287762::DEBUG::2014-01-16 17:15:05,509::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287762::DEBUG::2014-01-16 17:15:05,509::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287762::DEBUG::2014-01-16 17:15:05,509::task::974::TaskManager.Task::(_decref) Task=`9d9e0ee7-1f57-4fe7-b5e7-3714f79830be`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:06,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:15:06,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:15:06,493::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:15:06,493::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:15:06,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:06,703::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213207 s, 19.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:07,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:07,449::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:07,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:15:07,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:15:07,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:15:08,479::task::579::TaskManager.Task::(_updateState) Task=`28adff63-fa10-44eb-89f4-597eb039e1af`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:15:08,479::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:15:08,480::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:15:08,480::task::1168::TaskManager.Task::(prepare) Task=`28adff63-fa10-44eb-89f4-597eb039e1af`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:15:08,480::task::579::TaskManager.Task::(_updateState) Task=`28adff63-fa10-44eb-89f4-597eb039e1af`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:15:08,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:15:08,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:15:08,481::task::974::TaskManager.Task::(_decref) Task=`28adff63-fa10-44eb-89f4-597eb039e1af`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:15:08,491::task::579::TaskManager.Task::(_updateState) Task=`d840cdad-9334-4c07-aa55-6836c790f10d`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:15:08,491::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:15:08,492::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:15:08,492::task::1168::TaskManager.Task::(prepare) Task=`d840cdad-9334-4c07-aa55-6836c790f10d`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:15:08,492::task::579::TaskManager.Task::(_updateState) Task=`d840cdad-9334-4c07-aa55-6836c790f10d`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:15:08,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:15:08,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:15:08,492::task::974::TaskManager.Task::(_decref) Task=`d840cdad-9334-4c07-aa55-6836c790f10d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:08,496::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:15:08,496::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:09,450::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:09,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:15:09,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:15:09,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:15:09,498::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:15:10,471::task::579::TaskManager.Task::(_updateState) Task=`c0165b1b-c9f6-4d41-9ee3-460448ab93b6`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:15:10,472::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:15:10,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:15:10,473::task::1168::TaskManager.Task::(prepare) Task=`c0165b1b-c9f6-4d41-9ee3-460448ab93b6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:15:10,473::task::579::TaskManager.Task::(_updateState) Task=`c0165b1b-c9f6-4d41-9ee3-460448ab93b6`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:15:10,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:15:10,474::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:15:10,474::task::974::TaskManager.Task::(_decref) Task=`c0165b1b-c9f6-4d41-9ee3-460448ab93b6`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:15:10,474::task::579::TaskManager.Task::(_updateState) Task=`ea98d64b-ad4c-4324-a6d5-39827c35731a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:15:10,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:15:10,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:15:10,474::task::1168::TaskManager.Task::(prepare) Task=`ea98d64b-ad4c-4324-a6d5-39827c35731a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:15:10,475::task::579::TaskManager.Task::(_updateState) Task=`ea98d64b-ad4c-4324-a6d5-39827c35731a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:15:10,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:15:10,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:15:10,475::task::974::TaskManager.Task::(_decref) Task=`ea98d64b-ad4c-4324-a6d5-39827c35731a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:10,499::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:11,452::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:11,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:15:11,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:15:11,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:15:11,501::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:11,501::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:15:11,502::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:15:11,820::task::579::TaskManager.Task::(_updateState) Task=`f5f79a33-e7c3-40be-9da8-df8ee981ddfa`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:15:11,820::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:15:11,821::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:15:11,821::task::1168::TaskManager.Task::(prepare) Task=`f5f79a33-e7c3-40be-9da8-df8ee981ddfa`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:15:11,821::task::579::TaskManager.Task::(_updateState) Task=`f5f79a33-e7c3-40be-9da8-df8ee981ddfa`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:15:11,821::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:15:11,821::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:15:11,821::task::974::TaskManager.Task::(_decref) Task=`f5f79a33-e7c3-40be-9da8-df8ee981ddfa`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:15:11,932::task::579::TaskManager.Task::(_updateState) Task=`7c81fd57-774d-48b5-9695-5e92138ca817`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:15:11,932::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:15:11,932::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:15:11,933::task::1168::TaskManager.Task::(prepare) Task=`7c81fd57-774d-48b5-9695-5e92138ca817`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:15:11,933::task::579::TaskManager.Task::(_updateState) Task=`7c81fd57-774d-48b5-9695-5e92138ca817`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:15:11,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:15:11,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:15:11,933::task::974::TaskManager.Task::(_decref) Task=`7c81fd57-774d-48b5-9695-5e92138ca817`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:15:11,933::task::579::TaskManager.Task::(_updateState) Task=`03952309-f98e-450e-afaf-6197d43f1918`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:15:11,934::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:15:11,934::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:15:11,934::task::1168::TaskManager.Task::(prepare) Task=`03952309-f98e-450e-afaf-6197d43f1918`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:15:11,934::task::579::TaskManager.Task::(_updateState) Task=`03952309-f98e-450e-afaf-6197d43f1918`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:15:11,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:15:11,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:15:11,935::task::974::TaskManager.Task::(_decref) Task=`03952309-f98e-450e-afaf-6197d43f1918`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:12,453::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:12,502::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:13,455::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:13,504::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:15:13,504::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:15:13,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:14,505::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:15:14,506::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:15:14,506::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:15:15,164::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:15:15,180::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000295864 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:15,456::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:15,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:15:15,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:15:15,507::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:15:15,508::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:15:15,689::task::579::TaskManager.Task::(_updateState) Task=`6c966170-ae86-4d58-a0b2-e5e3d2d151a4`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:15:15,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:15:15,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:15:15,690::task::1168::TaskManager.Task::(prepare) Task=`6c966170-ae86-4d58-a0b2-e5e3d2d151a4`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:15:15,690::task::579::TaskManager.Task::(_updateState) Task=`6c966170-ae86-4d58-a0b2-e5e3d2d151a4`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:15:15,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:15:15,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:15:15,690::task::974::TaskManager.Task::(_decref) Task=`6c966170-ae86-4d58-a0b2-e5e3d2d151a4`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:15:15,810::task::579::TaskManager.Task::(_updateState) Task=`d0e39c02-d6b8-416f-ab7b-7730e4221b4d`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:15:15,810::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:15:15,810::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:15:15,811::task::1168::TaskManager.Task::(prepare) Task=`d0e39c02-d6b8-416f-ab7b-7730e4221b4d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:15:15,811::task::579::TaskManager.Task::(_updateState) Task=`d0e39c02-d6b8-416f-ab7b-7730e4221b4d`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:15:15,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:15:15,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:15:15,811::task::974::TaskManager.Task::(_decref) Task=`d0e39c02-d6b8-416f-ab7b-7730e4221b4d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:16,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:15:16,706::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:15:16,706::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:15:16,707::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:15:16,707::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:15:16,710::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:16,725::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000226003 s, 9.1 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:15:16,726::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000226003 s, 9.1 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:15:16,726::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:15:16,726::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:15:16,727::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:15:16,727::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:15:16,728::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:15:16,728::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:15:16,731::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:15:16,731::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:15:16,732::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::DEBUG::2014-01-16 17:15:16,892::task::579::TaskManager.Task::(_updateState) Task=`678d05cf-3a99-4dcf-a768-8c1fcd129caf`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:15:16,893::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-22::DEBUG::2014-01-16 17:15:16,966::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:15:16,968::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:15:16,969::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:15:16,970::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:15:16,970::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:15:16,970::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-184546::INFO::2014-01-16 17:15:16,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:15:16,973::task::1168::TaskManager.Task::(prepare) Task=`678d05cf-3a99-4dcf-a768-8c1fcd129caf`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:15:16,974::task::579::TaskManager.Task::(_updateState) Task=`678d05cf-3a99-4dcf-a768-8c1fcd129caf`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:15:16,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-01-16 17:15:16,975::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::DEBUG::2014-01-16 17:15:16,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:15:16,994::task::974::TaskManager.Task::(_decref) Task=`678d05cf-3a99-4dcf-a768-8c1fcd129caf`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:15:17,150::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:15:17,152::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:17,168::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000221618 s, 18.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:17,458::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:17,459::task::579::TaskManager.Task::(_updateState) Task=`72c90f31-9fa6-429a-ad45-67a51ec3ec45`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:15:17,459::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:15:17,459::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:15:17,459::task::1168::TaskManager.Task::(prepare) Task=`72c90f31-9fa6-429a-ad45-67a51ec3ec45`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:15:17,460::task::579::TaskManager.Task::(_updateState) Task=`72c90f31-9fa6-429a-ad45-67a51ec3ec45`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:15:17,460::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:15:17,460::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:15:17,460::task::974::TaskManager.Task::(_decref) Task=`72c90f31-9fa6-429a-ad45-67a51ec3ec45`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:17,462::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:15:17,462::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:15:17,464::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:17,465::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:17,466::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:17,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:15:17,510::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:15:17,830::task::579::TaskManager.Task::(_updateState) Task=`9931fe21-3ab0-4f47-b9bd-f45e76ab0bd0`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:15:17,830::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:15:17,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:15:17,831::task::1168::TaskManager.Task::(prepare) Task=`9931fe21-3ab0-4f47-b9bd-f45e76ab0bd0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:15:17,831::task::579::TaskManager.Task::(_updateState) Task=`9931fe21-3ab0-4f47-b9bd-f45e76ab0bd0`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:15:17,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:15:17,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:15:17,831::task::974::TaskManager.Task::(_decref) Task=`9931fe21-3ab0-4f47-b9bd-f45e76ab0bd0`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:15:17,954::task::579::TaskManager.Task::(_updateState) Task=`2676c47a-17f8-4b9b-a0b0-5d886a0affa5`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:15:17,954::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:15:17,955::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:15:17,955::task::1168::TaskManager.Task::(prepare) Task=`2676c47a-17f8-4b9b-a0b0-5d886a0affa5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:15:17,955::task::579::TaskManager.Task::(_updateState) Task=`2676c47a-17f8-4b9b-a0b0-5d886a0affa5`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:15:17,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:15:17,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:15:17,955::task::974::TaskManager.Task::(_decref) Task=`2676c47a-17f8-4b9b-a0b0-5d886a0affa5`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:15:17,955::task::579::TaskManager.Task::(_updateState) Task=`59ba93e0-b52d-4b50-ba0d-0edc8c29e59e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:15:17,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:15:17,956::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:15:17,956::task::1168::TaskManager.Task::(prepare) Task=`59ba93e0-b52d-4b50-ba0d-0edc8c29e59e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:15:17,956::task::579::TaskManager.Task::(_updateState) Task=`59ba93e0-b52d-4b50-ba0d-0edc8c29e59e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:15:17,956::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:15:17,956::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:15:17,956::task::974::TaskManager.Task::(_decref) Task=`59ba93e0-b52d-4b50-ba0d-0edc8c29e59e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:18,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:19,468::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:19,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:15:20,054::task::579::TaskManager.Task::(_updateState) Task=`8de9ac4d-8556-4b73-ba1a-a5484e989778`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:15:20,055::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:15:20,055::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:15:20,056::task::1168::TaskManager.Task::(prepare) Task=`8de9ac4d-8556-4b73-ba1a-a5484e989778`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:15:20,056::task::579::TaskManager.Task::(_updateState) Task=`8de9ac4d-8556-4b73-ba1a-a5484e989778`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:15:20,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:15:20,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:15:20,056::task::974::TaskManager.Task::(_decref) Task=`8de9ac4d-8556-4b73-ba1a-a5484e989778`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:20,513::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287768::DEBUG::2014-01-16 17:15:21,294::task::579::TaskManager.Task::(_updateState) Task=`cfcd5a6e-dc71-4ee1-aa1e-477e35253d06`::moving from state init -> state preparing >Thread-287768::INFO::2014-01-16 17:15:21,294::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287768::INFO::2014-01-16 17:15:21,294::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295864', 'lastCheck': '6.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221618', 'lastCheck': '4.1', 'valid': True}} >Thread-287768::DEBUG::2014-01-16 17:15:21,294::task::1168::TaskManager.Task::(prepare) Task=`cfcd5a6e-dc71-4ee1-aa1e-477e35253d06`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295864', 'lastCheck': '6.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221618', 'lastCheck': '4.1', 'valid': True}} >Thread-287768::DEBUG::2014-01-16 17:15:21,295::task::579::TaskManager.Task::(_updateState) Task=`cfcd5a6e-dc71-4ee1-aa1e-477e35253d06`::moving from state preparing -> state finished >Thread-287768::DEBUG::2014-01-16 17:15:21,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287768::DEBUG::2014-01-16 17:15:21,295::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287768::DEBUG::2014-01-16 17:15:21,295::task::974::TaskManager.Task::(_decref) Task=`cfcd5a6e-dc71-4ee1-aa1e-477e35253d06`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:21,469::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:21,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:15:21,852::task::579::TaskManager.Task::(_updateState) Task=`4babae90-a771-481f-af2b-2cfed8cb05cf`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:15:21,853::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:15:21,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:15:21,854::task::1168::TaskManager.Task::(prepare) Task=`4babae90-a771-481f-af2b-2cfed8cb05cf`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:15:21,854::task::579::TaskManager.Task::(_updateState) Task=`4babae90-a771-481f-af2b-2cfed8cb05cf`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:15:21,854::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:15:21,854::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:15:21,854::task::974::TaskManager.Task::(_decref) Task=`4babae90-a771-481f-af2b-2cfed8cb05cf`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:22,470::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:22,516::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:23,471::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:23,517::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:15:23,518::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:15:23,988::task::579::TaskManager.Task::(_updateState) Task=`5defd83c-8802-4462-a14b-fcf98df32180`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:15:23,988::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:15:23,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:15:23,988::task::1168::TaskManager.Task::(prepare) Task=`5defd83c-8802-4462-a14b-fcf98df32180`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:15:23,988::task::579::TaskManager.Task::(_updateState) Task=`5defd83c-8802-4462-a14b-fcf98df32180`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:15:23,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:15:23,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:15:23,989::task::974::TaskManager.Task::(_decref) Task=`5defd83c-8802-4462-a14b-fcf98df32180`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:15:23,989::task::579::TaskManager.Task::(_updateState) Task=`3bec8dca-5dc7-4e5d-9ebc-2aecf7230157`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:15:23,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:15:23,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:15:23,990::task::1168::TaskManager.Task::(prepare) Task=`3bec8dca-5dc7-4e5d-9ebc-2aecf7230157`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:15:23,990::task::579::TaskManager.Task::(_updateState) Task=`3bec8dca-5dc7-4e5d-9ebc-2aecf7230157`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:15:23,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:15:23,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:15:23,990::task::974::TaskManager.Task::(_decref) Task=`3bec8dca-5dc7-4e5d-9ebc-2aecf7230157`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:15:23,990::task::579::TaskManager.Task::(_updateState) Task=`f35334cc-7dc7-4f36-bbcb-796a5e5c0e4e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:15:23,991::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:15:23,991::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:15:23,991::task::1168::TaskManager.Task::(prepare) Task=`f35334cc-7dc7-4f36-bbcb-796a5e5c0e4e`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:15:23,991::task::579::TaskManager.Task::(_updateState) Task=`f35334cc-7dc7-4f36-bbcb-796a5e5c0e4e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:15:23,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:15:23,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:15:23,991::task::974::TaskManager.Task::(_decref) Task=`f35334cc-7dc7-4f36-bbcb-796a5e5c0e4e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:24,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:15:24,833::task::579::TaskManager.Task::(_updateState) Task=`ccf533b8-cf0a-4b25-8978-3d668b4372f6`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:15:24,833::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:15:24,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:15:24,834::task::1168::TaskManager.Task::(prepare) Task=`ccf533b8-cf0a-4b25-8978-3d668b4372f6`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:15:24,834::task::579::TaskManager.Task::(_updateState) Task=`ccf533b8-cf0a-4b25-8978-3d668b4372f6`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:15:24,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:15:24,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:15:24,834::task::974::TaskManager.Task::(_decref) Task=`ccf533b8-cf0a-4b25-8978-3d668b4372f6`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:15:25,189::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:15:25,206::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000292157 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:25,473::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:25,520::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:26,521::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:15:27,174::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:27,191::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000254181 s, 16.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:27,474::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:27,476::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-15207::DEBUG::2014-01-16 17:15:27,480::task::579::TaskManager.Task::(_updateState) Task=`a7242083-a39e-4c90-b83a-2c28c4c9b96e`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:15:27,481::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:15:27,482::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:15:27,482::task::1168::TaskManager.Task::(prepare) Task=`a7242083-a39e-4c90-b83a-2c28c4c9b96e`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:15:27,482::task::579::TaskManager.Task::(_updateState) Task=`a7242083-a39e-4c90-b83a-2c28c4c9b96e`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:15:27,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:15:27,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:15:27,483::task::974::TaskManager.Task::(_decref) Task=`a7242083-a39e-4c90-b83a-2c28c4c9b96e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:27,523::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:28,529::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:15:28,529::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:15:28,529::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:29,477::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:29,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:15:29,531::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:30,531::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:15:30,531::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:15:30,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:31,478::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:31,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:15:31,533::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:15:32,402::task::579::TaskManager.Task::(_updateState) Task=`3daaa113-f277-40d5-af83-4c54d5187fa1`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:15:32,403::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:15:32,403::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:15:32,403::task::1168::TaskManager.Task::(prepare) Task=`3daaa113-f277-40d5-af83-4c54d5187fa1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:15:32,403::task::579::TaskManager.Task::(_updateState) Task=`3daaa113-f277-40d5-af83-4c54d5187fa1`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:15:32,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:15:32,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:15:32,404::task::974::TaskManager.Task::(_decref) Task=`3daaa113-f277-40d5-af83-4c54d5187fa1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:32,480::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:15:32,481::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:15:32,482::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:32,535::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:15:32,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:33,483::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:33,536::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:34,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:15:34,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:15:35,213::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:15:35,230::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000302625 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:35,485::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:35,539::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:15:35,539::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:15:36,294::task::579::TaskManager.Task::(_updateState) Task=`3984bf74-04a1-4e78-9d63-e7e4056d38f1`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:15:36,295::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:15:36,295::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:15:36,295::task::1168::TaskManager.Task::(prepare) Task=`3984bf74-04a1-4e78-9d63-e7e4056d38f1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:15:36,295::task::579::TaskManager.Task::(_updateState) Task=`3984bf74-04a1-4e78-9d63-e7e4056d38f1`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:15:36,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:15:36,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:15:36,296::task::974::TaskManager.Task::(_decref) Task=`3984bf74-04a1-4e78-9d63-e7e4056d38f1`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:15:36,298::task::579::TaskManager.Task::(_updateState) Task=`0a8f8e0e-e501-4cd6-9620-22ca110e04c7`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:15:36,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:15:36,298::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:15:36,298::task::1168::TaskManager.Task::(prepare) Task=`0a8f8e0e-e501-4cd6-9620-22ca110e04c7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:15:36,298::task::579::TaskManager.Task::(_updateState) Task=`0a8f8e0e-e501-4cd6-9620-22ca110e04c7`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:15:36,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:15:36,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:15:36,299::task::974::TaskManager.Task::(_decref) Task=`0a8f8e0e-e501-4cd6-9620-22ca110e04c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:36,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:15:36,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:15:36,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:15:36,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287774::DEBUG::2014-01-16 17:15:37,108::task::579::TaskManager.Task::(_updateState) Task=`8dfa66bb-e148-4fe5-8d64-ad622e4450e5`::moving from state init -> state preparing >Thread-287774::INFO::2014-01-16 17:15:37,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287774::INFO::2014-01-16 17:15:37,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000302625', 'lastCheck': '1.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254181', 'lastCheck': '9.9', 'valid': True}} >Thread-287774::DEBUG::2014-01-16 17:15:37,109::task::1168::TaskManager.Task::(prepare) Task=`8dfa66bb-e148-4fe5-8d64-ad622e4450e5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000302625', 'lastCheck': '1.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254181', 'lastCheck': '9.9', 'valid': True}} >Thread-287774::DEBUG::2014-01-16 17:15:37,109::task::579::TaskManager.Task::(_updateState) Task=`8dfa66bb-e148-4fe5-8d64-ad622e4450e5`::moving from state preparing -> state finished >Thread-287774::DEBUG::2014-01-16 17:15:37,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287774::DEBUG::2014-01-16 17:15:37,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287774::DEBUG::2014-01-16 17:15:37,110::task::974::TaskManager.Task::(_decref) Task=`8dfa66bb-e148-4fe5-8d64-ad622e4450e5`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:15:37,196::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:37,214::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000244508 s, 16.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:37,487::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:37,488::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:37,542::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:15:37,543::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:15:37,543::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:38,544::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:15:38,545::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:15:39,423::task::579::TaskManager.Task::(_updateState) Task=`36153723-80e6-4ba0-abd6-9e3ce6585905`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:15:39,424::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:15:39,424::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:15:39,424::task::1168::TaskManager.Task::(prepare) Task=`36153723-80e6-4ba0-abd6-9e3ce6585905`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:15:39,424::task::579::TaskManager.Task::(_updateState) Task=`36153723-80e6-4ba0-abd6-9e3ce6585905`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:15:39,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:15:39,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:15:39,425::task::974::TaskManager.Task::(_decref) Task=`36153723-80e6-4ba0-abd6-9e3ce6585905`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:15:39,425::task::579::TaskManager.Task::(_updateState) Task=`8df211f9-5810-4add-94ef-4047abceb2ee`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:15:39,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:15:39,426::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:15:39,426::task::1168::TaskManager.Task::(prepare) Task=`8df211f9-5810-4add-94ef-4047abceb2ee`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:15:39,426::task::579::TaskManager.Task::(_updateState) Task=`8df211f9-5810-4add-94ef-4047abceb2ee`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:15:39,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:15:39,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:15:39,426::task::974::TaskManager.Task::(_decref) Task=`8df211f9-5810-4add-94ef-4047abceb2ee`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:39,489::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:39,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:15:39,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:15:39,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:15:39,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:40,547::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:41,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:41,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:15:41,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:15:41,549::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:15:41,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:41,549::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:15:41,550::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:15:41,909::task::579::TaskManager.Task::(_updateState) Task=`2d97db63-4bfe-43ff-9f4f-f3976e4fe0d6`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:15:41,910::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:15:41,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:15:41,910::task::1168::TaskManager.Task::(prepare) Task=`2d97db63-4bfe-43ff-9f4f-f3976e4fe0d6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:15:41,910::task::579::TaskManager.Task::(_updateState) Task=`2d97db63-4bfe-43ff-9f4f-f3976e4fe0d6`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:15:41,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:15:41,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:15:41,911::task::974::TaskManager.Task::(_decref) Task=`2d97db63-4bfe-43ff-9f4f-f3976e4fe0d6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:15:42,492::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:42,552::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:43,494::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:43,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:15:43,553::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:15:43,553::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:15:43,782::task::579::TaskManager.Task::(_updateState) Task=`308531ab-ef7a-4b34-bc15-fdb2c5b9268e`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:15:43,782::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:15:43,783::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:15:43,783::task::1168::TaskManager.Task::(prepare) Task=`308531ab-ef7a-4b34-bc15-fdb2c5b9268e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:15:43,783::task::579::TaskManager.Task::(_updateState) Task=`308531ab-ef7a-4b34-bc15-fdb2c5b9268e`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:15:43,783::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:15:43,783::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:15:43,783::task::974::TaskManager.Task::(_decref) Task=`308531ab-ef7a-4b34-bc15-fdb2c5b9268e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:44,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:15:44,555::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:15:44,555::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 17:15:44,900::task::579::TaskManager.Task::(_updateState) Task=`b628d911-4131-4ee0-bae5-801d410e3552`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:15:44,900::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:15:44,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:15:44,901::task::1168::TaskManager.Task::(prepare) Task=`b628d911-4131-4ee0-bae5-801d410e3552`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:15:44,901::task::579::TaskManager.Task::(_updateState) Task=`b628d911-4131-4ee0-bae5-801d410e3552`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:15:44,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:15:44,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:15:44,901::task::974::TaskManager.Task::(_decref) Task=`b628d911-4131-4ee0-bae5-801d410e3552`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:15:44,914::task::579::TaskManager.Task::(_updateState) Task=`de6e1704-c1f3-4f57-945b-33e444fbe282`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:15:44,914::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:15:44,914::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:15:44,915::task::1168::TaskManager.Task::(prepare) Task=`de6e1704-c1f3-4f57-945b-33e444fbe282`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:15:44,915::task::579::TaskManager.Task::(_updateState) Task=`de6e1704-c1f3-4f57-945b-33e444fbe282`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:15:44,915::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:15:44,915::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:15:44,915::task::974::TaskManager.Task::(_decref) Task=`de6e1704-c1f3-4f57-945b-33e444fbe282`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:15:44,923::task::579::TaskManager.Task::(_updateState) Task=`2639f164-f1ed-4803-9cb5-49808ad57cc0`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:15:44,924::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:15:44,924::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:15:44,924::task::1168::TaskManager.Task::(prepare) Task=`2639f164-f1ed-4803-9cb5-49808ad57cc0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:15:44,924::task::579::TaskManager.Task::(_updateState) Task=`2639f164-f1ed-4803-9cb5-49808ad57cc0`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:15:44,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:15:44,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:15:44,925::task::974::TaskManager.Task::(_decref) Task=`2639f164-f1ed-4803-9cb5-49808ad57cc0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:15:45,238::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:15:45,254::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029211 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:45,496::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:45,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:15:45,556::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:15:45,557::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:15:45,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:15:45,814::task::579::TaskManager.Task::(_updateState) Task=`57f9c80a-10cb-4dbb-97fc-b7184c53da15`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:15:45,814::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:15:45,814::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:15:45,815::task::1168::TaskManager.Task::(prepare) Task=`57f9c80a-10cb-4dbb-97fc-b7184c53da15`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:15:45,815::task::579::TaskManager.Task::(_updateState) Task=`57f9c80a-10cb-4dbb-97fc-b7184c53da15`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:15:45,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:15:45,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:15:45,815::task::974::TaskManager.Task::(_decref) Task=`57f9c80a-10cb-4dbb-97fc-b7184c53da15`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:15:45,828::task::579::TaskManager.Task::(_updateState) Task=`44e25316-8e6d-4fda-b240-b869e8f31792`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:15:45,828::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:15:45,828::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:15:45,829::task::1168::TaskManager.Task::(prepare) Task=`44e25316-8e6d-4fda-b240-b869e8f31792`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:15:45,829::task::579::TaskManager.Task::(_updateState) Task=`44e25316-8e6d-4fda-b240-b869e8f31792`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:15:45,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:15:45,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:15:45,829::task::974::TaskManager.Task::(_decref) Task=`44e25316-8e6d-4fda-b240-b869e8f31792`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:46,558::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:15:47,220::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:47,237::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000281293 s, 14.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:47,497::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:47,499::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:15:47,500::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:15:47,501::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:47,559::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:15:47,560::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:48,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287779::DEBUG::2014-01-16 17:15:48,913::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Westmere', 'smp': '1', 'custom': {'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=518a2334-8b23-4864-b5aa-6bc0fa7649d0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512device_b7e14214-b41c-457b-90da-96677f0a573d': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=b7e14214-b41c-457b-90da-96677f0a573d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512device_b7e14214-b41c-457b-90da-96677f0a573ddevice_0a439bd1-5933-4820-97b8-828075075f9b': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=0a439bd1-5933-4820-97b8-828075075f9b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512device_b7e14214-b41c-457b-90da-96677f0a573ddevice_0a439bd1-5933-4820-97b8-828075075f9bdevice_7e71fbf0-bac6-4de5-bda0-e3ced014cb5b': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=7e71fbf0-bac6-4de5-bda0-e3ced014cb5b, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=ac4102f9-beb1-42c3-bb07-50b93059b512, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'pbajenez-RHEL_6.5', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogImVmOGUyOTk3LTlmMTAtNGM3OC04NDA5LWM2YzU0MmI0YjMxZiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpvdXRwdXQ6CiAgYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRw\ndXQubG9nJwp1c2VyOiByb290CnBhc3N3b3JkOiByZWRoYXQKcnVuY21kOgotICdzZWQgLWkgJycv\nXmRhdGFzb3VyY2VfbGlzdDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFz\nb3VyY2VfbGlzdDoKICBbIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQv\nY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '3f1f1a39-f470-47fd-957c-93c210452a4c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '062b5e0e-cd14-451b-9a09-a0f8a0f0f0fe', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '94db6d62-6a07-4203-9d13-7d4340a6355f', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'bootOrder': '1', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'specParams': {}, 'readonly': 'false', 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'optional': 'false', 'deviceId': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'address': {'bus': '0x00', ' slot': '0x05', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'd002d688-2387-4417-be6a-41fe0700e494'}, {'specParams': {}, 'deviceId': 'd64f7684-c3ce-44b5-b72d-9878704e9bfc', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [27e0074f] >Thread-287779::INFO::2014-01-16 17:15:48,916::API::648::vds::(_getNetworkIp) network None: using 0 >Thread-287779::INFO::2014-01-16 17:15:48,916::clientIF::393::vds::(createVm) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-287780::DEBUG::2014-01-16 17:15:48,920::vm::2115::vm.Vm::(_startUnderlyingVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Start >Thread-287779::DEBUG::2014-01-16 17:15:48,920::clientIF::406::vds::(createVm) Total desktops after creation of 10bce6b5-ab25-452b-a8e2-24309deae8b7 is 32 >Thread-287779::DEBUG::2014-01-16 17:15:48,921::BindingXMLRPC::991::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'custom': {'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=518a2334-8b23-4864-b5aa-6bc0fa7649d0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512device_b7e14214-b41c-457b-90da-96677f0a573d': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=b7e14214-b41c-457b-90da-96677f0a573d, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512device_b7e14214-b41c-457b-90da-96677f0a573ddevice_0a439bd1-5933-4820-97b8-828075075f9b': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=0a439bd1-5933-4820-97b8-828075075f9b, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512device_b7e14214-b41c-457b-90da-96677f0a573ddevice_0a439bd1-5933-4820-97b8-828075075f9bdevice_7e71fbf0-bac6-4de5-bda0-e3ced014cb5b': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=7e71fbf0-bac6-4de5-bda0-e3ced014cb5b, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_518a2334-8b23-4864-b5aa-6bc0fa7649d0device_ac4102f9-beb1-42c3-bb07-50b93059b512': 'VmDevice {vmId=10bce6b5-ab25-452b-a8e2-24309deae8b7, deviceId=ac4102f9-beb1-42c3-bb07-50b93059b512, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'pitReinjection': 'false', 'transparentHugePages': 'true', 'devices': [{'index': '3', 'iface': 'ide', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgInV1aWQiIDogImVmOGUyOTk3LTlmMTAtNGM3OC04NDA5LWM2YzU0MmI0YjMxZiIsCiAgIm1l\ndGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIs\nCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpvdXRwdXQ6CiAgYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRw\ndXQubG9nJwp1c2VyOiByb290CnBhc3N3b3JkOiByZWRoYXQKcnVuY21kOgotICdzZWQgLWkgJycv\nXmRhdGFzb3VyY2VfbGlzdDogL2QnJyAvZXRjL2Nsb3VkL2Nsb3VkLmNmZzsgZWNobyAnJ2RhdGFz\nb3VyY2VfbGlzdDoKICBbIk5vQ2xvdWQiLCAiQ29uZmlnRHJpdmUiXScnID4+IC9ldGMvY2xvdWQv\nY2xvdWQuY2ZnJwo=\n'}}}, 'readonly': 'true', 'deviceId': '3f1f1a39-f470-47fd-957c-93c210452a4c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'ram': '65536', 'heads': '1'}, 'type': 'video', 'deviceId': '062b5e0e-cd14-451b-9a09-a0f8a0f0f0fe', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '94db6d62-6a07-4203-9d13-7d4340a6355f', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'bootOrder': '1', 'poolID': 'b3088fcc-d291-11e1-933a-0015c5f4698c', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'specParams': {}, 'readonly': 'false', 'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'optional': 'false', 'deviceId': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'address': {'bus': '0x00', ' slot': '0x05', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'd002d688-2387-4417-be6a-41fe0700e494'}, {'specParams': {}, 'deviceId': 'd64f7684-c3ce-44b5-b72d-9878704e9bfc', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'pbajenez-RHEL_6.5', 'display': 'qxl', 'nice': '0'}} >Thread-287780::DEBUG::2014-01-16 17:15:48,921::vm::2119::vm.Vm::(_startUnderlyingVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::_ongoingCreations acquired >Thread-287780::INFO::2014-01-16 17:15:48,923::vm::2969::vm.Vm::(_run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::VM wrapper has started >Thread-287780::DEBUG::2014-01-16 17:15:48,924::task::579::TaskManager.Task::(_updateState) Task=`ea855447-2852-4891-aef7-4e292ae00a3f`::moving from state init -> state preparing >Thread-287780::INFO::2014-01-16 17:15:48,925::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287780::DEBUG::2014-01-16 17:15:48,925::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-287780::DEBUG::2014-01-16 17:15:48,926::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-287780::DEBUG::2014-01-16 17:15:49,137::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287780::DEBUG::2014-01-16 17:15:49,463::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287780::DEBUG::2014-01-16 17:15:49,465::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287780::INFO::2014-01-16 17:15:49,465::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287780::DEBUG::2014-01-16 17:15:49,465::task::1168::TaskManager.Task::(prepare) Task=`ea855447-2852-4891-aef7-4e292ae00a3f`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287780::DEBUG::2014-01-16 17:15:49,466::task::579::TaskManager.Task::(_updateState) Task=`ea855447-2852-4891-aef7-4e292ae00a3f`::moving from state preparing -> state finished >Thread-287780::DEBUG::2014-01-16 17:15:49,466::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287780::DEBUG::2014-01-16 17:15:49,466::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287780::DEBUG::2014-01-16 17:15:49,466::task::974::TaskManager.Task::(_decref) Task=`ea855447-2852-4891-aef7-4e292ae00a3f`::ref 0 aborting False >Thread-287780::INFO::2014-01-16 17:15:49,466::clientIF::352::vds::(prepareVolumePath) prepared volume path: >Thread-287780::INFO::2014-01-16 17:15:49,466::clientIF::352::vds::(prepareVolumePath) prepared volume path: >Thread-287780::DEBUG::2014-01-16 17:15:49,467::task::579::TaskManager.Task::(_updateState) Task=`870fbbc5-6293-449d-8eb3-50e52a33dc5a`::moving from state init -> state preparing >Thread-287780::INFO::2014-01-16 17:15:49,467::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', leafUUID='8688815d-b239-43d4-8688-813810a9b6b6') >Thread-287780::DEBUG::2014-01-16 17:15:49,467::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02`ReqID=`3651f87e-3a78-44b3-aa04-cf1d46bc075c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage' >Thread-287780::DEBUG::2014-01-16 17:15:49,468::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' for lock type 'shared' >Thread-287780::DEBUG::2014-01-16 17:15:49,468::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' is free. Now locking as 'shared' (1 active user) >Thread-287780::DEBUG::2014-01-16 17:15:49,468::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02`ReqID=`3651f87e-3a78-44b3-aa04-cf1d46bc075c`::Granted request >Thread-287780::DEBUG::2014-01-16 17:15:49,469::task::811::TaskManager.Task::(resourceAcquired) Task=`870fbbc5-6293-449d-8eb3-50e52a33dc5a`::_resourcesAcquired: Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 (shared) >Thread-287780::DEBUG::2014-01-16 17:15:49,469::task::974::TaskManager.Task::(_decref) Task=`870fbbc5-6293-449d-8eb3-50e52a33dc5a`::ref 1 aborting False >Thread-287780::DEBUG::2014-01-16 17:15:49,469::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-287780::DEBUG::2014-01-16 17:15:49,470::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:15:49,503::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:49,561::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287780::DEBUG::2014-01-16 17:15:49,655::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287780::DEBUG::2014-01-16 17:15:50,009::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287780::DEBUG::2014-01-16 17:15:50,010::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287780::DEBUG::2014-01-16 17:15:50,013::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/8688815d-b239-43d4-8688-813810a9b6b6' (cwd None) >Thread-287780::DEBUG::2014-01-16 17:15:50,413::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287780::DEBUG::2014-01-16 17:15:50,414::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-287780::DEBUG::2014-01-16 17:15:50,414::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-287780::WARNING::2014-01-16 17:15:50,415::fileUtils::167::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa already exists >Thread-287780::DEBUG::2014-01-16 17:15:50,415::blockSD::1068::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6 >Thread-287780::DEBUG::2014-01-16 17:15:50,415::blockSD::1040::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa >Thread-287780::DEBUG::2014-01-16 17:15:50,416::lvm::440::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-287780::DEBUG::2014-01-16 17:15:50,416::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:15:50,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287780::DEBUG::2014-01-16 17:15:50,602::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-287780::DEBUG::2014-01-16 17:15:50,913::lvm::475::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-287780::DEBUG::2014-01-16 17:15:50,914::lvm::475::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-287780::INFO::2014-01-16 17:15:50,914::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'imgVolumesInfo': [{'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}]} >Thread-287780::DEBUG::2014-01-16 17:15:50,915::task::1168::TaskManager.Task::(prepare) Task=`870fbbc5-6293-449d-8eb3-50e52a33dc5a`::finished: {'info': {'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'imgVolumesInfo': [{'domainID': 'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'volType': 'path', 'leaseOffset': 316669952, 'path': '/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6', 'volumeID': '8688815d-b239-43d4-8688-813810a9b6b6', 'leasePath': '/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/leases', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}]} >Thread-287780::DEBUG::2014-01-16 17:15:50,915::task::579::TaskManager.Task::(_updateState) Task=`870fbbc5-6293-449d-8eb3-50e52a33dc5a`::moving from state preparing -> state finished >Thread-287780::DEBUG::2014-01-16 17:15:50,915::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': < ResourceRef 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', isValid: 'True' obj: 'None'>} >Thread-287780::DEBUG::2014-01-16 17:15:50,915::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287780::DEBUG::2014-01-16 17:15:50,916::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' >Thread-287780::DEBUG::2014-01-16 17:15:50,916::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (0 active users) >Thread-287780::DEBUG::2014-01-16 17:15:50,916::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' is free, finding out if anyone is waiting for it. >Thread-287780::DEBUG::2014-01-16 17:15:50,916::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', Clearing records. >Thread-287780::DEBUG::2014-01-16 17:15:50,916::task::974::TaskManager.Task::(_decref) Task=`870fbbc5-6293-449d-8eb3-50e52a33dc5a`::ref 0 aborting False >Thread-287780::INFO::2014-01-16 17:15:50,916::clientIF::352::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6 >Thread-287780::DEBUG::2014-01-16 17:15:50,932::vm::3031::vm.Vm::(_run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>pbajenez-RHEL_6.5</name> > <uuid>10bce6b5-ab25-452b-a8e2-24309deae8b7</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu>1</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <controller model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > </controller> > <video> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/> > <model heads="1" ram="65536" type="qxl" vram="32768"/> > </video> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x05" type="pci"/> > <source dev="/rhev/data-center/mnt/blockSD/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/images/2a34e0d0-6658-4ed4-ade1-f78c3c6919fa/8688815d-b239-43d4-8688-813810a9b6b6"/> > <target bus="virtio" dev="vda"/> > <serial>2a34e0d0-6658-4ed4-ade1-f78c3c6919fa</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> > </disk> > <memballoon model="virtio"/> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.5.0.1.el6</entry> > <entry name="serial">06BD148D-3986-35A8-840D-259FB621438F</entry> > <entry name="uuid">10bce6b5-ab25-452b-a8e2-24309deae8b7</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Westmere</model> > <topology cores="1" sockets="1" threads="1"/> > </cpu> ></domain> > >libvirtEventLoop::DEBUG::2014-01-16 17:15:51,432::vm::4943::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::event Started detail 0 opaque None >Thread-189817::DEBUG::2014-01-16 17:15:51,545::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287780::DEBUG::2014-01-16 17:15:51,561::sampling::285::vm.Vm::(start) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Start statistics collection >Thread-287783::DEBUG::2014-01-16 17:15:51,561::sampling::314::vm.Vm::(run) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Stats thread started >Thread-287783::DEBUG::2014-01-16 17:15:51,562::task::579::TaskManager.Task::(_updateState) Task=`cdbdeeb1-ca8e-4615-822e-7b44a6eb0627`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:15:51,562::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:15:51,562::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:15:51,563::task::1168::TaskManager.Task::(prepare) Task=`cdbdeeb1-ca8e-4615-822e-7b44a6eb0627`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:15:51,563::task::579::TaskManager.Task::(_updateState) Task=`cdbdeeb1-ca8e-4615-822e-7b44a6eb0627`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:15:51,563::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:15:51,563::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:15:51,563::task::974::TaskManager.Task::(_decref) Task=`cdbdeeb1-ca8e-4615-822e-7b44a6eb0627`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:51,565::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287780::DEBUG::2014-01-16 17:15:51,585::vmChannels::194::vds::(register) Add fileno 62 to listener's channels. >Thread-287780::WARNING::2014-01-16 17:15:51,587::vm::3536::vm.Vm::(_readPauseCode) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::_readPauseCode unsupported by libvirt vm >Thread-287780::DEBUG::2014-01-16 17:15:51,600::vm::2136::vm.Vm::(_startUnderlyingVm) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::_ongoingCreations released >Thread-189817::DEBUG::2014-01-16 17:15:52,547::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:52,566::vmChannels::102::vds::(_do_add_channels) fileno 62 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-01-16 17:15:52,567::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:52,567::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:15:52,567::guestIF::147::vm.Vm::(_connect) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Attempting connection to /var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:15:52,568::guestIF::150::vm.Vm::(_connect) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Connected to /var/lib/libvirt/qemu/channels/10bce6b5-ab25-452b-a8e2-24309deae8b7.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:15:52,569::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 62 succeeded. >Thread-84377::DEBUG::2014-01-16 17:15:52,811::task::579::TaskManager.Task::(_updateState) Task=`677b4107-a25a-457a-8921-4ccc248c6d4a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:15:52,811::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:15:52,812::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:15:52,812::task::1168::TaskManager.Task::(prepare) Task=`677b4107-a25a-457a-8921-4ccc248c6d4a`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:15:52,812::task::579::TaskManager.Task::(_updateState) Task=`677b4107-a25a-457a-8921-4ccc248c6d4a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:15:52,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:15:52,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:15:52,812::task::974::TaskManager.Task::(_decref) Task=`677b4107-a25a-457a-8921-4ccc248c6d4a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:15:52,813::task::579::TaskManager.Task::(_updateState) Task=`378a441e-d31f-4571-96af-cb038bd8e498`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:15:52,813::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:15:52,813::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:15:52,813::task::1168::TaskManager.Task::(prepare) Task=`378a441e-d31f-4571-96af-cb038bd8e498`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:15:52,813::task::579::TaskManager.Task::(_updateState) Task=`378a441e-d31f-4571-96af-cb038bd8e498`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:15:52,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:15:52,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:15:52,814::task::974::TaskManager.Task::(_decref) Task=`378a441e-d31f-4571-96af-cb038bd8e498`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:15:52,814::task::579::TaskManager.Task::(_updateState) Task=`14e2ddb8-a71e-433a-bc99-0c4bb184eb6e`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:15:52,814::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:15:52,814::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:15:52,815::task::1168::TaskManager.Task::(prepare) Task=`14e2ddb8-a71e-433a-bc99-0c4bb184eb6e`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:15:52,815::task::579::TaskManager.Task::(_updateState) Task=`14e2ddb8-a71e-433a-bc99-0c4bb184eb6e`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:15:52,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:15:52,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:15:52,815::task::974::TaskManager.Task::(_decref) Task=`14e2ddb8-a71e-433a-bc99-0c4bb184eb6e`::ref 0 aborting False >Thread-287784::DEBUG::2014-01-16 17:15:53,021::task::579::TaskManager.Task::(_updateState) Task=`1613460c-a2d2-48de-a80d-cedcfc17d1db`::moving from state init -> state preparing >Thread-287784::INFO::2014-01-16 17:15:53,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287784::INFO::2014-01-16 17:15:53,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029211', 'lastCheck': '7.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281293', 'lastCheck': '5.8', 'valid': True}} >Thread-287784::DEBUG::2014-01-16 17:15:53,022::task::1168::TaskManager.Task::(prepare) Task=`1613460c-a2d2-48de-a80d-cedcfc17d1db`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029211', 'lastCheck': '7.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281293', 'lastCheck': '5.8', 'valid': True}} >Thread-287784::DEBUG::2014-01-16 17:15:53,022::task::579::TaskManager.Task::(_updateState) Task=`1613460c-a2d2-48de-a80d-cedcfc17d1db`::moving from state preparing -> state finished >Thread-287784::DEBUG::2014-01-16 17:15:53,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287784::DEBUG::2014-01-16 17:15:53,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287784::DEBUG::2014-01-16 17:15:53,022::task::974::TaskManager.Task::(_decref) Task=`1613460c-a2d2-48de-a80d-cedcfc17d1db`::ref 0 aborting False >Thread-16244::DEBUG::2014-01-16 17:15:53,073::task::579::TaskManager.Task::(_updateState) Task=`6bbc425a-d88f-4278-82f5-a44cb0176aa0`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:15:53,074::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:15:53,074::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:15:53,074::task::1168::TaskManager.Task::(prepare) Task=`6bbc425a-d88f-4278-82f5-a44cb0176aa0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:15:53,074::task::579::TaskManager.Task::(_updateState) Task=`6bbc425a-d88f-4278-82f5-a44cb0176aa0`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:15:53,074::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:15:53,074::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:15:53,075::task::974::TaskManager.Task::(_decref) Task=`6bbc425a-d88f-4278-82f5-a44cb0176aa0`::ref 0 aborting False >Thread-287785::DEBUG::2014-01-16 17:15:53,098::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287785::DEBUG::2014-01-16 17:15:53,098::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287785::DEBUG::2014-01-16 17:15:53,098::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287785::DEBUG::2014-01-16 17:15:53,098::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287785::DEBUG::2014-01-16 17:15:53,098::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287785::DEBUG::2014-01-16 17:15:53,098::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287785::DEBUG::2014-01-16 17:15:53,099::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-189817::DEBUG::2014-01-16 17:15:53,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:53,569::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:15:53,569::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:54,570::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:15:55,264::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:15:55,280::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000304239 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:55,549::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:55,571::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:15:56,572::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287788::DEBUG::2014-01-16 17:15:56,657::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287788::DEBUG::2014-01-16 17:15:56,658::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287788::DEBUG::2014-01-16 17:15:56,658::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287788::DEBUG::2014-01-16 17:15:56,658::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287788::DEBUG::2014-01-16 17:15:56,658::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287788::DEBUG::2014-01-16 17:15:56,658::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287788::DEBUG::2014-01-16 17:15:56,658::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287788::DEBUG::2014-01-16 17:15:56,659::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287788::DEBUG::2014-01-16 17:15:56,660::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.03', 'elapsedTime': '7', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:15:57,242::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:15:57,259::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000236062 s, 17.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:15:57,551::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:15:57,552::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:57,573::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:15:58,230::task::579::TaskManager.Task::(_updateState) Task=`c9a88842-b55c-4bca-91b6-ac8c3bb089c3`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:15:58,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:15:58,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:15:58,231::task::1168::TaskManager.Task::(prepare) Task=`c9a88842-b55c-4bca-91b6-ac8c3bb089c3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:15:58,231::task::579::TaskManager.Task::(_updateState) Task=`c9a88842-b55c-4bca-91b6-ac8c3bb089c3`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:15:58,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:15:58,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:15:58,232::task::974::TaskManager.Task::(_decref) Task=`c9a88842-b55c-4bca-91b6-ac8c3bb089c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:15:58,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:15:58,575::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:15:58,575::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:15:59,553::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:15:59,577::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:15:59,577::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287790::DEBUG::2014-01-16 17:15:59,795::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287790::DEBUG::2014-01-16 17:15:59,796::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287790::DEBUG::2014-01-16 17:15:59,796::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287790::DEBUG::2014-01-16 17:15:59,796::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287790::DEBUG::2014-01-16 17:15:59,796::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287790::DEBUG::2014-01-16 17:15:59,797::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287790::DEBUG::2014-01-16 17:15:59,797::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287790::DEBUG::2014-01-16 17:15:59,797::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287790::DEBUG::2014-01-16 17:15:59,798::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.17', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-287791::DEBUG::2014-01-16 17:16:00,358::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmSetTicket with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', 'LwtrsslC+7g+', '120', 'disconnect', {'userName': 'rhevadmin', 'userId': '88011004-16db-11e2-9b90-001a4a0cff04'}) {} flowID [d7ea114] >Thread-287791::DEBUG::2014-01-16 17:16:00,382::BindingXMLRPC::991::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >VM Channels Listener::DEBUG::2014-01-16 17:16:00,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:16:00,579::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:16:00,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:01,555::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:01,580::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:16:01,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:02,557::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:16:02,558::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:16:02,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:02,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:16:02,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287793::DEBUG::2014-01-16 17:16:02,896::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287793::DEBUG::2014-01-16 17:16:02,896::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287793::DEBUG::2014-01-16 17:16:02,896::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287793::DEBUG::2014-01-16 17:16:02,896::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287793::DEBUG::2014-01-16 17:16:02,896::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287793::DEBUG::2014-01-16 17:16:02,897::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287793::DEBUG::2014-01-16 17:16:02,897::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287793::DEBUG::2014-01-16 17:16:02,897::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287793::DEBUG::2014-01-16 17:16:02,899::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.27', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:16:03,561::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,571::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >VM Channels Listener::DEBUG::2014-01-16 17:16:03,582::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,600::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,604::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,615::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,663::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,663::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,719::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:03,720::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >VM Channels Listener::DEBUG::2014-01-16 17:16:04,582::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:16:04,582::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:16:05,102::task::579::TaskManager.Task::(_updateState) Task=`1298caf0-bf0d-42dd-9146-5208bb26276e`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:16:05,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:16:05,103::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:16:05,103::task::1168::TaskManager.Task::(prepare) Task=`1298caf0-bf0d-42dd-9146-5208bb26276e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:16:05,103::task::579::TaskManager.Task::(_updateState) Task=`1298caf0-bf0d-42dd-9146-5208bb26276e`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:16:05,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:16:05,103::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:16:05,104::task::974::TaskManager.Task::(_decref) Task=`1298caf0-bf0d-42dd-9146-5208bb26276e`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:16:05,288::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:16:05,307::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000317691 s, 1.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:05,563::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:05,583::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:16:05,583::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287795::DEBUG::2014-01-16 17:16:06,092::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287795::DEBUG::2014-01-16 17:16:06,092::vm::595::vm.Vm::(_getCpuStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-287795::DEBUG::2014-01-16 17:16:06,092::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287795::DEBUG::2014-01-16 17:16:06,092::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287795::DEBUG::2014-01-16 17:16:06,093::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287795::DEBUG::2014-01-16 17:16:06,093::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287795::DEBUG::2014-01-16 17:16:06,093::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287795::DEBUG::2014-01-16 17:16:06,093::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287795::DEBUG::2014-01-16 17:16:06,094::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.46', 'elapsedTime': '17', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:16:06,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:16:06,585::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:16:06,585::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:16:06,585::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:16:07,264::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:16:07,281::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000268936 s, 15.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:07,565::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:07,566::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:07,586::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:16:07,586::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:16:07,586::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:16:08,558::task::579::TaskManager.Task::(_updateState) Task=`2c779c44-7817-483d-b998-429d05a6486d`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:16:08,558::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:16:08,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:16:08,560::task::1168::TaskManager.Task::(prepare) Task=`2c779c44-7817-483d-b998-429d05a6486d`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:16:08,560::task::579::TaskManager.Task::(_updateState) Task=`2c779c44-7817-483d-b998-429d05a6486d`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:16:08,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:16:08,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:16:08,560::task::974::TaskManager.Task::(_decref) Task=`2c779c44-7817-483d-b998-429d05a6486d`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:16:08,577::task::579::TaskManager.Task::(_updateState) Task=`27e6bb28-7f66-4e5e-b3a7-5f1924faf281`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:16:08,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:16:08,578::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:16:08,578::task::1168::TaskManager.Task::(prepare) Task=`27e6bb28-7f66-4e5e-b3a7-5f1924faf281`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:16:08,579::task::579::TaskManager.Task::(_updateState) Task=`27e6bb28-7f66-4e5e-b3a7-5f1924faf281`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:16:08,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:16:08,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:16:08,579::task::974::TaskManager.Task::(_decref) Task=`27e6bb28-7f66-4e5e-b3a7-5f1924faf281`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:08,587::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:16:08,588::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287796::DEBUG::2014-01-16 17:16:09,175::task::579::TaskManager.Task::(_updateState) Task=`9481eafc-dec8-4fd9-b6de-a8c0d171f79f`::moving from state init -> state preparing >Thread-287796::INFO::2014-01-16 17:16:09,175::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287796::INFO::2014-01-16 17:16:09,176::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317691', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268936', 'lastCheck': '1.9', 'valid': True}} >Thread-287796::DEBUG::2014-01-16 17:16:09,176::task::1168::TaskManager.Task::(prepare) Task=`9481eafc-dec8-4fd9-b6de-a8c0d171f79f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317691', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268936', 'lastCheck': '1.9', 'valid': True}} >Thread-287796::DEBUG::2014-01-16 17:16:09,176::task::579::TaskManager.Task::(_updateState) Task=`9481eafc-dec8-4fd9-b6de-a8c0d171f79f`::moving from state preparing -> state finished >Thread-287796::DEBUG::2014-01-16 17:16:09,176::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287796::DEBUG::2014-01-16 17:16:09,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287796::DEBUG::2014-01-16 17:16:09,176::task::974::TaskManager.Task::(_decref) Task=`9481eafc-dec8-4fd9-b6de-a8c0d171f79f`::ref 0 aborting False >Thread-287797::DEBUG::2014-01-16 17:16:09,247::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287797::DEBUG::2014-01-16 17:16:09,248::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287797::DEBUG::2014-01-16 17:16:09,248::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287797::DEBUG::2014-01-16 17:16:09,248::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287797::DEBUG::2014-01-16 17:16:09,248::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287797::DEBUG::2014-01-16 17:16:09,248::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-189817::DEBUG::2014-01-16 17:16:09,567::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:09,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:16:09,589::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:16:09,589::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:16:09,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:16:10,561::task::579::TaskManager.Task::(_updateState) Task=`97ed5a36-fc18-4e04-9668-4594bedea969`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:16:10,562::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:16:10,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:16:10,563::task::1168::TaskManager.Task::(prepare) Task=`97ed5a36-fc18-4e04-9668-4594bedea969`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:16:10,563::task::579::TaskManager.Task::(_updateState) Task=`97ed5a36-fc18-4e04-9668-4594bedea969`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:16:10,563::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:16:10,563::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:16:10,563::task::974::TaskManager.Task::(_decref) Task=`97ed5a36-fc18-4e04-9668-4594bedea969`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:16:10,564::task::579::TaskManager.Task::(_updateState) Task=`3a71a109-7641-4c0c-a957-64e0e29f5089`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:16:10,564::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:16:10,564::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:16:10,564::task::1168::TaskManager.Task::(prepare) Task=`3a71a109-7641-4c0c-a957-64e0e29f5089`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:16:10,564::task::579::TaskManager.Task::(_updateState) Task=`3a71a109-7641-4c0c-a957-64e0e29f5089`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:16:10,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:16:10,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:16:10,565::task::974::TaskManager.Task::(_decref) Task=`3a71a109-7641-4c0c-a957-64e0e29f5089`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:10,590::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:11,568::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:11,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:16:11,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:16:11,592::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:16:11,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:11,592::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:16:11,594::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:16:12,017::task::579::TaskManager.Task::(_updateState) Task=`a91ebf47-e3af-4ba5-82d7-b38fda4a0b31`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:16:12,018::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:16:12,018::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:16:12,018::task::1168::TaskManager.Task::(prepare) Task=`a91ebf47-e3af-4ba5-82d7-b38fda4a0b31`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:16:12,018::task::579::TaskManager.Task::(_updateState) Task=`a91ebf47-e3af-4ba5-82d7-b38fda4a0b31`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:16:12,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:16:12,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:16:12,019::task::974::TaskManager.Task::(_decref) Task=`a91ebf47-e3af-4ba5-82d7-b38fda4a0b31`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:16:12,193::task::579::TaskManager.Task::(_updateState) Task=`1185f0df-2f75-41ad-bd05-78038992b390`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:16:12,193::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:16:12,193::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:16:12,194::task::1168::TaskManager.Task::(prepare) Task=`1185f0df-2f75-41ad-bd05-78038992b390`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:16:12,194::task::579::TaskManager.Task::(_updateState) Task=`1185f0df-2f75-41ad-bd05-78038992b390`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:16:12,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:16:12,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:16:12,194::task::974::TaskManager.Task::(_decref) Task=`1185f0df-2f75-41ad-bd05-78038992b390`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:16:12,194::task::579::TaskManager.Task::(_updateState) Task=`b8a4c653-3896-4937-ba80-951861289a6d`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:16:12,195::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:16:12,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:16:12,195::task::1168::TaskManager.Task::(prepare) Task=`b8a4c653-3896-4937-ba80-951861289a6d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:16:12,195::task::579::TaskManager.Task::(_updateState) Task=`b8a4c653-3896-4937-ba80-951861289a6d`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:16:12,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:16:12,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:16:12,195::task::974::TaskManager.Task::(_decref) Task=`b8a4c653-3896-4937-ba80-951861289a6d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:16:12,569::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:12,595::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287799::DEBUG::2014-01-16 17:16:12,711::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287799::DEBUG::2014-01-16 17:16:12,711::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287799::DEBUG::2014-01-16 17:16:12,711::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287799::DEBUG::2014-01-16 17:16:12,712::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287799::DEBUG::2014-01-16 17:16:12,712::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287799::DEBUG::2014-01-16 17:16:12,712::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287799::DEBUG::2014-01-16 17:16:12,712::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287799::DEBUG::2014-01-16 17:16:12,713::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '2.40', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.08', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '1.19', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:16:13,571::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:13,596::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:16:13,597::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:16:13,597::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:14,598::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:16:14,599::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:16:14,599::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:16:15,309::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:16:15,313::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:16:15,314::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:16:15,320::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:16:15,321::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:16:15,321::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:16:15,321::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 17:16:15,327::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:16:15,350::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000277849 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:15,572::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:15,600::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:16:15,600::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:16:15,600::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:16:15,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:16:15,845::task::579::TaskManager.Task::(_updateState) Task=`ffbfde25-afd4-42e2-b1c7-f5fb85c9b874`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:16:15,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:16:15,845::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:16:15,846::task::1168::TaskManager.Task::(prepare) Task=`ffbfde25-afd4-42e2-b1c7-f5fb85c9b874`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:16:15,846::task::579::TaskManager.Task::(_updateState) Task=`ffbfde25-afd4-42e2-b1c7-f5fb85c9b874`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:16:15,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:16:15,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:16:15,846::task::974::TaskManager.Task::(_decref) Task=`ffbfde25-afd4-42e2-b1c7-f5fb85c9b874`::ref 0 aborting False >Thread-287802::DEBUG::2014-01-16 17:16:15,914::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287802::DEBUG::2014-01-16 17:16:15,915::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287802::DEBUG::2014-01-16 17:16:15,915::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287802::DEBUG::2014-01-16 17:16:15,915::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287802::DEBUG::2014-01-16 17:16:15,915::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287802::DEBUG::2014-01-16 17:16:15,915::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287802::DEBUG::2014-01-16 17:16:15,915::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287802::DEBUG::2014-01-16 17:16:15,917::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '2.40', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.28', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '1.19', 'appsList': [], 'guestIPs': ''}]} >Thread-26403::DEBUG::2014-01-16 17:16:15,990::task::579::TaskManager.Task::(_updateState) Task=`85d4ba52-bbc1-44cd-8729-f5c0280a0afb`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:16:15,990::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:16:15,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:16:15,990::task::1168::TaskManager.Task::(prepare) Task=`85d4ba52-bbc1-44cd-8729-f5c0280a0afb`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:16:15,991::task::579::TaskManager.Task::(_updateState) Task=`85d4ba52-bbc1-44cd-8729-f5c0280a0afb`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:16:15,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:16:15,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:16:15,991::task::974::TaskManager.Task::(_decref) Task=`85d4ba52-bbc1-44cd-8729-f5c0280a0afb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:16,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:16:17,190::task::579::TaskManager.Task::(_updateState) Task=`c00e666e-400d-4e5f-bbaa-02e31c5e32ae`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:16:17,191::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:16:17,191::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:16:17,191::task::1168::TaskManager.Task::(prepare) Task=`c00e666e-400d-4e5f-bbaa-02e31c5e32ae`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:16:17,191::task::579::TaskManager.Task::(_updateState) Task=`c00e666e-400d-4e5f-bbaa-02e31c5e32ae`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:16:17,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:16:17,192::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:16:17,192::task::974::TaskManager.Task::(_decref) Task=`c00e666e-400d-4e5f-bbaa-02e31c5e32ae`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:16:17,288::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:16:17,305::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00020807 s, 19.7 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:17,574::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:17,575::task::579::TaskManager.Task::(_updateState) Task=`22eb370e-1a95-4bc0-893b-ca05722d0a28`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:16:17,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:16:17,575::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:16:17,575::task::1168::TaskManager.Task::(prepare) Task=`22eb370e-1a95-4bc0-893b-ca05722d0a28`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:16:17,576::task::579::TaskManager.Task::(_updateState) Task=`22eb370e-1a95-4bc0-893b-ca05722d0a28`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:16:17,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:16:17,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:16:17,576::task::974::TaskManager.Task::(_decref) Task=`22eb370e-1a95-4bc0-893b-ca05722d0a28`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:16:17,578::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:16:17,578::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:16:17,579::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:17,581::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:17,582::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:17,603::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:16:17,603::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:16:18,027::task::579::TaskManager.Task::(_updateState) Task=`c1b5443b-7791-47a9-abc8-76db425b2478`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:16:18,028::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:16:18,028::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:16:18,028::task::1168::TaskManager.Task::(prepare) Task=`c1b5443b-7791-47a9-abc8-76db425b2478`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:16:18,028::task::579::TaskManager.Task::(_updateState) Task=`c1b5443b-7791-47a9-abc8-76db425b2478`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:16:18,029::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:16:18,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:16:18,029::task::974::TaskManager.Task::(_decref) Task=`c1b5443b-7791-47a9-abc8-76db425b2478`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:16:18,195::task::579::TaskManager.Task::(_updateState) Task=`ade9db90-b9bb-40d0-a065-0cc394667a01`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:16:18,195::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:16:18,196::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:16:18,196::task::1168::TaskManager.Task::(prepare) Task=`ade9db90-b9bb-40d0-a065-0cc394667a01`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:16:18,196::task::579::TaskManager.Task::(_updateState) Task=`ade9db90-b9bb-40d0-a065-0cc394667a01`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:16:18,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:16:18,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:16:18,196::task::974::TaskManager.Task::(_decref) Task=`ade9db90-b9bb-40d0-a065-0cc394667a01`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:16:18,197::task::579::TaskManager.Task::(_updateState) Task=`834345b6-1d24-4515-905c-6aa5e8e9c8cf`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:16:18,197::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:16:18,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:16:18,197::task::1168::TaskManager.Task::(prepare) Task=`834345b6-1d24-4515-905c-6aa5e8e9c8cf`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:16:18,197::task::579::TaskManager.Task::(_updateState) Task=`834345b6-1d24-4515-905c-6aa5e8e9c8cf`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:16:18,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:16:18,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:16:18,198::task::974::TaskManager.Task::(_decref) Task=`834345b6-1d24-4515-905c-6aa5e8e9c8cf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:18,604::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287804::DEBUG::2014-01-16 17:16:19,037::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287804::DEBUG::2014-01-16 17:16:19,038::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287804::DEBUG::2014-01-16 17:16:19,038::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287804::DEBUG::2014-01-16 17:16:19,038::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287804::DEBUG::2014-01-16 17:16:19,038::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287804::DEBUG::2014-01-16 17:16:19,038::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287804::DEBUG::2014-01-16 17:16:19,039::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287804::DEBUG::2014-01-16 17:16:19,040::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '2.40', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.41', 'elapsedTime': '30', 'vmType': 'kvm', 'cpuSys': '1.19', 'appsList': [], 'guestIPs': ''}]} >libvirtEventLoop::DEBUG::2014-01-16 17:16:19,257::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:19,257::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:19,258::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:19,258::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:19,259::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >Thread-189817::DEBUG::2014-01-16 17:16:19,583::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:19,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:16:20,138::task::579::TaskManager.Task::(_updateState) Task=`586b2373-eda3-4ebc-a67f-2677da8fc979`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:16:20,139::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:16:20,140::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:16:20,141::task::1168::TaskManager.Task::(prepare) Task=`586b2373-eda3-4ebc-a67f-2677da8fc979`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:16:20,141::task::579::TaskManager.Task::(_updateState) Task=`586b2373-eda3-4ebc-a67f-2677da8fc979`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:16:20,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:16:20,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:16:20,141::task::974::TaskManager.Task::(_decref) Task=`586b2373-eda3-4ebc-a67f-2677da8fc979`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:20,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287805::DEBUG::2014-01-16 17:16:21,257::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287806::DEBUG::2014-01-16 17:16:21,258::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287807::DEBUG::2014-01-16 17:16:21,258::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287808::DEBUG::2014-01-16 17:16:21,259::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287809::DEBUG::2014-01-16 17:16:21,259::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-189817::DEBUG::2014-01-16 17:16:21,584::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:21,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:16:22,045::task::579::TaskManager.Task::(_updateState) Task=`96240372-4361-415f-a88d-f4a4ff22b0d4`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:16:22,046::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:16:22,046::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:16:22,046::task::1168::TaskManager.Task::(prepare) Task=`96240372-4361-415f-a88d-f4a4ff22b0d4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:16:22,046::task::579::TaskManager.Task::(_updateState) Task=`96240372-4361-415f-a88d-f4a4ff22b0d4`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:16:22,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:16:22,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:16:22,047::task::974::TaskManager.Task::(_decref) Task=`96240372-4361-415f-a88d-f4a4ff22b0d4`::ref 0 aborting False >Thread-287811::DEBUG::2014-01-16 17:16:22,140::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287811::DEBUG::2014-01-16 17:16:22,147::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287811::DEBUG::2014-01-16 17:16:22,147::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287811::DEBUG::2014-01-16 17:16:22,147::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287811::DEBUG::2014-01-16 17:16:22,148::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287811::DEBUG::2014-01-16 17:16:22,148::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287811::DEBUG::2014-01-16 17:16:22,148::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287811::DEBUG::2014-01-16 17:16:22,151::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.51', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:16:22,585::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:22,609::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:16:22,609::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:23,587::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:23,610::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:16:23,610::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:16:24,601::task::579::TaskManager.Task::(_updateState) Task=`4149d395-a488-4c48-aca9-bafc6ab96683`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:16:24,601::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:16:24,601::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:16:24,602::task::1168::TaskManager.Task::(prepare) Task=`4149d395-a488-4c48-aca9-bafc6ab96683`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:16:24,602::task::579::TaskManager.Task::(_updateState) Task=`4149d395-a488-4c48-aca9-bafc6ab96683`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:16:24,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:16:24,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:16:24,602::task::974::TaskManager.Task::(_decref) Task=`4149d395-a488-4c48-aca9-bafc6ab96683`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:16:24,603::task::579::TaskManager.Task::(_updateState) Task=`bd51bf42-91f5-4731-acda-3f2e639b4dc1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:16:24,603::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:16:24,603::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:16:24,603::task::1168::TaskManager.Task::(prepare) Task=`bd51bf42-91f5-4731-acda-3f2e639b4dc1`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:16:24,603::task::579::TaskManager.Task::(_updateState) Task=`bd51bf42-91f5-4731-acda-3f2e639b4dc1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:16:24,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:16:24,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:16:24,604::task::974::TaskManager.Task::(_decref) Task=`bd51bf42-91f5-4731-acda-3f2e639b4dc1`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:16:24,604::task::579::TaskManager.Task::(_updateState) Task=`77b051c2-8144-439b-ab22-336d6bde6a39`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:16:24,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:16:24,604::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:16:24,604::task::1168::TaskManager.Task::(prepare) Task=`77b051c2-8144-439b-ab22-336d6bde6a39`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:16:24,605::task::579::TaskManager.Task::(_updateState) Task=`77b051c2-8144-439b-ab22-336d6bde6a39`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:16:24,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:16:24,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:16:24,605::task::974::TaskManager.Task::(_decref) Task=`77b051c2-8144-439b-ab22-336d6bde6a39`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:24,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:16:25,014::task::579::TaskManager.Task::(_updateState) Task=`3120a1cf-ff56-4b64-8701-0aabd1b7f02d`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:16:25,014::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:16:25,015::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:16:25,015::task::1168::TaskManager.Task::(prepare) Task=`3120a1cf-ff56-4b64-8701-0aabd1b7f02d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:16:25,015::task::579::TaskManager.Task::(_updateState) Task=`3120a1cf-ff56-4b64-8701-0aabd1b7f02d`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:16:25,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:16:25,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:16:25,016::task::974::TaskManager.Task::(_decref) Task=`3120a1cf-ff56-4b64-8701-0aabd1b7f02d`::ref 0 aborting False >Thread-287812::DEBUG::2014-01-16 17:16:25,234::task::579::TaskManager.Task::(_updateState) Task=`be83a5da-e1e4-48fa-bc86-90639817eea2`::moving from state init -> state preparing >Thread-287812::INFO::2014-01-16 17:16:25,234::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287812::INFO::2014-01-16 17:16:25,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277849', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020807', 'lastCheck': '7.9', 'valid': True}} >Thread-287812::DEBUG::2014-01-16 17:16:25,234::task::1168::TaskManager.Task::(prepare) Task=`be83a5da-e1e4-48fa-bc86-90639817eea2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277849', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020807', 'lastCheck': '7.9', 'valid': True}} >Thread-287812::DEBUG::2014-01-16 17:16:25,234::task::579::TaskManager.Task::(_updateState) Task=`be83a5da-e1e4-48fa-bc86-90639817eea2`::moving from state preparing -> state finished >Thread-287812::DEBUG::2014-01-16 17:16:25,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287812::DEBUG::2014-01-16 17:16:25,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287812::DEBUG::2014-01-16 17:16:25,235::task::974::TaskManager.Task::(_decref) Task=`be83a5da-e1e4-48fa-bc86-90639817eea2`::ref 0 aborting False >Thread-287813::DEBUG::2014-01-16 17:16:25,351::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287813::DEBUG::2014-01-16 17:16:25,351::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287813::DEBUG::2014-01-16 17:16:25,351::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287813::DEBUG::2014-01-16 17:16:25,352::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287813::DEBUG::2014-01-16 17:16:25,352::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287813::DEBUG::2014-01-16 17:16:25,352::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-20::DEBUG::2014-01-16 17:16:25,382::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:16:25,407::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290772 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:25,588::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:25,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:26,614::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:16:27,311::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:16:27,328::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000282217 s, 14.5 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 17:16:27,563::task::579::TaskManager.Task::(_updateState) Task=`d6f218e5-40e0-40a6-801b-1c307355991d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:16:27,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:16:27,565::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:16:27,565::task::1168::TaskManager.Task::(prepare) Task=`d6f218e5-40e0-40a6-801b-1c307355991d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:16:27,565::task::579::TaskManager.Task::(_updateState) Task=`d6f218e5-40e0-40a6-801b-1c307355991d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:16:27,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:16:27,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:16:27,565::task::974::TaskManager.Task::(_decref) Task=`d6f218e5-40e0-40a6-801b-1c307355991d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:16:27,590::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:27,591::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:27,615::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287814::DEBUG::2014-01-16 17:16:28,355::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [372299a6] >Thread-287814::INFO::2014-01-16 17:16:28,355::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-287814::DEBUG::2014-01-16 17:16:28,355::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-287814::ERROR::2014-01-16 17:16:28,375::BindingXMLRPC::1003::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in vmDestroy > return vm.destroy() > File "/usr/share/vdsm/API.py", line 329, in destroy > res = v.destroy() > File "/usr/share/vdsm/vm.py", line 4485, in destroy > response = self.releaseVm() > File "/usr/share/vdsm/vm.py", line 4417, in releaseVm > supervdsm.getProxy().removeFs(drive.path) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in removeFs > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >Exception: Cannot remove Fs that does not exists in: /var/run/vdsm/payload >VM Channels Listener::DEBUG::2014-01-16 17:16:28,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:16:28,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:16:28,616::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287816::DEBUG::2014-01-16 17:16:28,855::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287816::DEBUG::2014-01-16 17:16:28,856::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287816::DEBUG::2014-01-16 17:16:28,856::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287816::DEBUG::2014-01-16 17:16:28,856::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287816::DEBUG::2014-01-16 17:16:28,856::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287816::DEBUG::2014-01-16 17:16:28,856::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287816::DEBUG::2014-01-16 17:16:28,856::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287816::DEBUG::2014-01-16 17:16:28,858::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.22', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:16:29,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:29,617::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:16:29,618::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:30,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:16:30,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:16:30,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:31,594::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:31,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:16:31,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287818::DEBUG::2014-01-16 17:16:31,994::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287818::DEBUG::2014-01-16 17:16:31,994::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287818::DEBUG::2014-01-16 17:16:31,995::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287818::DEBUG::2014-01-16 17:16:31,995::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287818::DEBUG::2014-01-16 17:16:31,995::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287818::DEBUG::2014-01-16 17:16:31,995::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287818::DEBUG::2014-01-16 17:16:31,995::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287818::DEBUG::2014-01-16 17:16:31,996::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.36', 'elapsedTime': '43', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189046::DEBUG::2014-01-16 17:16:32,592::task::579::TaskManager.Task::(_updateState) Task=`59ceec81-42ab-4053-84d4-ba8f057f9487`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:16:32,592::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:16:32,593::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:16:32,593::task::1168::TaskManager.Task::(prepare) Task=`59ceec81-42ab-4053-84d4-ba8f057f9487`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:16:32,593::task::579::TaskManager.Task::(_updateState) Task=`59ceec81-42ab-4053-84d4-ba8f057f9487`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:16:32,593::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:16:32,593::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:16:32,594::task::974::TaskManager.Task::(_decref) Task=`59ceec81-42ab-4053-84d4-ba8f057f9487`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:16:32,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:16:32,596::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:16:32,598::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:32,621::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:16:32,622::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:33,599::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:33,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:34,624::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:16:34,624::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287820::DEBUG::2014-01-16 17:16:35,095::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [7ec074b8] >Thread-287820::DEBUG::2014-01-16 17:16:35,096::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287820::DEBUG::2014-01-16 17:16:35,096::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287820::DEBUG::2014-01-16 17:16:35,096::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287820::DEBUG::2014-01-16 17:16:35,096::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287820::DEBUG::2014-01-16 17:16:35,097::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287820::DEBUG::2014-01-16 17:16:35,097::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287820::DEBUG::2014-01-16 17:16:35,098::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.46', 'elapsedTime': '46', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:16:35,416::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:16:35,440::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000308307 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:35,601::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:35,626::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:16:35,626::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-59295::DEBUG::2014-01-16 17:16:36,562::task::579::TaskManager.Task::(_updateState) Task=`2a335006-f61d-4b16-a734-45ff835b7a96`::moving from state init -> state preparing >Thread-3175::DEBUG::2014-01-16 17:16:36,562::task::579::TaskManager.Task::(_updateState) Task=`faa5f01d-93af-473e-a504-d152fbbec7e6`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:16:36,562::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-3175::INFO::2014-01-16 17:16:36,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-59295::INFO::2014-01-16 17:16:36,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::INFO::2014-01-16 17:16:36,563::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::DEBUG::2014-01-16 17:16:36,564::task::1168::TaskManager.Task::(prepare) Task=`2a335006-f61d-4b16-a734-45ff835b7a96`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 17:16:36,564::task::1168::TaskManager.Task::(prepare) Task=`faa5f01d-93af-473e-a504-d152fbbec7e6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::DEBUG::2014-01-16 17:16:36,564::task::579::TaskManager.Task::(_updateState) Task=`2a335006-f61d-4b16-a734-45ff835b7a96`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:16:36,564::task::579::TaskManager.Task::(_updateState) Task=`faa5f01d-93af-473e-a504-d152fbbec7e6`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:16:36,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:16:36,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:16:36,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:16:36,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:16:36,565::task::974::TaskManager.Task::(_decref) Task=`2a335006-f61d-4b16-a734-45ff835b7a96`::ref 0 aborting False >Thread-3175::DEBUG::2014-01-16 17:16:36,565::task::974::TaskManager.Task::(_decref) Task=`faa5f01d-93af-473e-a504-d152fbbec7e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:36,627::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:16:36,628::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:16:36,628::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:16:36,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:16:37,334::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:16:37,351::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000284312 s, 14.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:37,602::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:37,604::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:37,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:16:37,630::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:16:37,630::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287822::DEBUG::2014-01-16 17:16:38,213::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287822::DEBUG::2014-01-16 17:16:38,213::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287822::DEBUG::2014-01-16 17:16:38,214::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287822::DEBUG::2014-01-16 17:16:38,214::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287822::DEBUG::2014-01-16 17:16:38,214::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287822::DEBUG::2014-01-16 17:16:38,214::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287822::DEBUG::2014-01-16 17:16:38,214::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287822::DEBUG::2014-01-16 17:16:38,216::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.57', 'elapsedTime': '49', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:16:38,631::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:16:38,631::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:39,605::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:39,632::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:16:39,633::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:16:39,633::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:16:39,633::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:16:39,822::task::579::TaskManager.Task::(_updateState) Task=`bbf71a51-79e6-4bf1-82e3-e86675a796c9`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:16:39,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:16:39,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:16:39,823::task::1168::TaskManager.Task::(prepare) Task=`bbf71a51-79e6-4bf1-82e3-e86675a796c9`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:16:39,823::task::579::TaskManager.Task::(_updateState) Task=`bbf71a51-79e6-4bf1-82e3-e86675a796c9`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:16:39,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:16:39,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:16:39,823::task::974::TaskManager.Task::(_decref) Task=`bbf71a51-79e6-4bf1-82e3-e86675a796c9`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:16:39,824::task::579::TaskManager.Task::(_updateState) Task=`a35cbe64-a6c4-4849-9b8c-e13182024c72`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:16:39,824::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:16:39,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:16:39,824::task::1168::TaskManager.Task::(prepare) Task=`a35cbe64-a6c4-4849-9b8c-e13182024c72`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:16:39,824::task::579::TaskManager.Task::(_updateState) Task=`a35cbe64-a6c4-4849-9b8c-e13182024c72`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:16:39,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:16:39,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:16:39,825::task::974::TaskManager.Task::(_decref) Task=`a35cbe64-a6c4-4849-9b8c-e13182024c72`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:40,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287823::DEBUG::2014-01-16 17:16:41,286::task::579::TaskManager.Task::(_updateState) Task=`f8f8266f-cca1-4d89-9b53-3f70fd8ba32d`::moving from state init -> state preparing >Thread-287823::INFO::2014-01-16 17:16:41,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287823::INFO::2014-01-16 17:16:41,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308307', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284312', 'lastCheck': '3.9', 'valid': True}} >Thread-287823::DEBUG::2014-01-16 17:16:41,287::task::1168::TaskManager.Task::(prepare) Task=`f8f8266f-cca1-4d89-9b53-3f70fd8ba32d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000308307', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284312', 'lastCheck': '3.9', 'valid': True}} >Thread-287823::DEBUG::2014-01-16 17:16:41,287::task::579::TaskManager.Task::(_updateState) Task=`f8f8266f-cca1-4d89-9b53-3f70fd8ba32d`::moving from state preparing -> state finished >Thread-287823::DEBUG::2014-01-16 17:16:41,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287823::DEBUG::2014-01-16 17:16:41,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287823::DEBUG::2014-01-16 17:16:41,288::task::974::TaskManager.Task::(_decref) Task=`f8f8266f-cca1-4d89-9b53-3f70fd8ba32d`::ref 0 aborting False >Thread-287824::DEBUG::2014-01-16 17:16:41,350::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287824::DEBUG::2014-01-16 17:16:41,350::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287824::DEBUG::2014-01-16 17:16:41,350::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287824::DEBUG::2014-01-16 17:16:41,350::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287824::DEBUG::2014-01-16 17:16:41,350::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287824::DEBUG::2014-01-16 17:16:41,350::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-189817::DEBUG::2014-01-16 17:16:41,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:41,635::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:16:41,635::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:16:41,635::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:16:41,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:41,636::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:16:41,637::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:16:42,105::task::579::TaskManager.Task::(_updateState) Task=`a6ab8f41-c505-43e6-b220-77461a3e25d0`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:16:42,105::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:16:42,105::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:16:42,105::task::1168::TaskManager.Task::(prepare) Task=`a6ab8f41-c505-43e6-b220-77461a3e25d0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:16:42,106::task::579::TaskManager.Task::(_updateState) Task=`a6ab8f41-c505-43e6-b220-77461a3e25d0`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:16:42,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:16:42,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:16:42,106::task::974::TaskManager.Task::(_decref) Task=`a6ab8f41-c505-43e6-b220-77461a3e25d0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:16:42,608::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:42,638::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287825::DEBUG::2014-01-16 17:16:43,380::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmSetTicket with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', 'qWaj4KcktC0I', '120', 'disconnect', {'userName': 'rhevadmin', 'userId': '88011004-16db-11e2-9b90-001a4a0cff04'}) {} flowID [30f55ac1] >Thread-287825::DEBUG::2014-01-16 17:16:43,398::BindingXMLRPC::991::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-189817::DEBUG::2014-01-16 17:16:43,610::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:43,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:16:43,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:16:43,640::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:16:43,962::task::579::TaskManager.Task::(_updateState) Task=`861dcd56-a5df-42c9-a3d4-b676622c4504`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:16:43,963::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:16:43,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:16:43,963::task::1168::TaskManager.Task::(prepare) Task=`861dcd56-a5df-42c9-a3d4-b676622c4504`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:16:43,963::task::579::TaskManager.Task::(_updateState) Task=`861dcd56-a5df-42c9-a3d4-b676622c4504`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:16:43,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:16:43,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:16:43,964::task::974::TaskManager.Task::(_decref) Task=`861dcd56-a5df-42c9-a3d4-b676622c4504`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:44,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:16:44,642::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:16:44,642::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287827::DEBUG::2014-01-16 17:16:44,814::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287827::DEBUG::2014-01-16 17:16:44,814::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287827::DEBUG::2014-01-16 17:16:44,814::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287827::DEBUG::2014-01-16 17:16:44,815::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287827::DEBUG::2014-01-16 17:16:44,815::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287827::DEBUG::2014-01-16 17:16:44,815::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287827::DEBUG::2014-01-16 17:16:44,815::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287827::DEBUG::2014-01-16 17:16:44,816::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.17', 'elapsedTime': '55', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-16393::DEBUG::2014-01-16 17:16:45,189::task::579::TaskManager.Task::(_updateState) Task=`ee941b9b-6659-48f5-8627-10455e8bc8a1`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:16:45,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:16:45,189::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:16:45,189::task::1168::TaskManager.Task::(prepare) Task=`ee941b9b-6659-48f5-8627-10455e8bc8a1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:16:45,190::task::579::TaskManager.Task::(_updateState) Task=`ee941b9b-6659-48f5-8627-10455e8bc8a1`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:16:45,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:16:45,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:16:45,190::task::974::TaskManager.Task::(_decref) Task=`ee941b9b-6659-48f5-8627-10455e8bc8a1`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:16:45,194::task::579::TaskManager.Task::(_updateState) Task=`6da0c08c-ba4d-4cbe-a01d-6c0e4601df13`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:16:45,195::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:16:45,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:16:45,195::task::1168::TaskManager.Task::(prepare) Task=`6da0c08c-ba4d-4cbe-a01d-6c0e4601df13`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:16:45,195::task::579::TaskManager.Task::(_updateState) Task=`6da0c08c-ba4d-4cbe-a01d-6c0e4601df13`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:16:45,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:16:45,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:16:45,196::task::974::TaskManager.Task::(_decref) Task=`6da0c08c-ba4d-4cbe-a01d-6c0e4601df13`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:16:45,204::task::579::TaskManager.Task::(_updateState) Task=`090713e5-e9f3-4e32-b130-4da485696b58`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:16:45,205::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:16:45,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:16:45,205::task::1168::TaskManager.Task::(prepare) Task=`090713e5-e9f3-4e32-b130-4da485696b58`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:16:45,205::task::579::TaskManager.Task::(_updateState) Task=`090713e5-e9f3-4e32-b130-4da485696b58`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:16:45,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:16:45,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:16:45,206::task::974::TaskManager.Task::(_decref) Task=`090713e5-e9f3-4e32-b130-4da485696b58`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:16:45,451::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:16:45,478::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279559 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:45,611::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:45,643::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:16:45,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:16:45,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:16:45,644::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:16:46,049::task::579::TaskManager.Task::(_updateState) Task=`ee329636-0fbe-4542-a4c0-25b1da2c792a`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:16:46,049::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:16:46,049::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:16:46,050::task::1168::TaskManager.Task::(prepare) Task=`ee329636-0fbe-4542-a4c0-25b1da2c792a`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:16:46,050::task::579::TaskManager.Task::(_updateState) Task=`ee329636-0fbe-4542-a4c0-25b1da2c792a`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:16:46,050::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:16:46,050::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:16:46,051::task::579::TaskManager.Task::(_updateState) Task=`c21fd1f8-4eb5-463b-aed0-699ef930bd34`::moving from state init -> state preparing >Thread-20952::DEBUG::2014-01-16 17:16:46,051::task::974::TaskManager.Task::(_decref) Task=`ee329636-0fbe-4542-a4c0-25b1da2c792a`::ref 0 aborting False >Thread-12152::INFO::2014-01-16 17:16:46,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:16:46,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:16:46,053::task::1168::TaskManager.Task::(prepare) Task=`c21fd1f8-4eb5-463b-aed0-699ef930bd34`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:16:46,053::task::579::TaskManager.Task::(_updateState) Task=`c21fd1f8-4eb5-463b-aed0-699ef930bd34`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:16:46,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:16:46,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:16:46,054::task::974::TaskManager.Task::(_decref) Task=`c21fd1f8-4eb5-463b-aed0-699ef930bd34`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:46,645::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:16:46,999::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,042::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,051::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,064::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,089::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,090::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,124::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:16:47,125::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >Thread-22::DEBUG::2014-01-16 17:16:47,357::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:16:47,374::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000304328 s, 13.5 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:47,613::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:47,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:16:47,616::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:16:47,617::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:47,646::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:16:47,647::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287829::DEBUG::2014-01-16 17:16:47,920::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287829::DEBUG::2014-01-16 17:16:47,921::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287829::DEBUG::2014-01-16 17:16:47,921::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287829::DEBUG::2014-01-16 17:16:47,921::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287829::DEBUG::2014-01-16 17:16:47,921::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287829::DEBUG::2014-01-16 17:16:47,921::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287829::DEBUG::2014-01-16 17:16:47,921::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287829::DEBUG::2014-01-16 17:16:47,923::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.28', 'elapsedTime': '59', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:16:48,648::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:49,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:49,649::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:50,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287831::DEBUG::2014-01-16 17:16:51,058::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287831::DEBUG::2014-01-16 17:16:51,058::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287831::DEBUG::2014-01-16 17:16:51,058::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd stats not available >Thread-287831::DEBUG::2014-01-16 17:16:51,058::vm::649::vm.Vm::(_getDiskStats) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda stats not available >Thread-287831::DEBUG::2014-01-16 17:16:51,059::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287831::DEBUG::2014-01-16 17:16:51,059::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk hdd latency not available >Thread-287831::DEBUG::2014-01-16 17:16:51,059::vm::688::vm.Vm::(_getDiskLatency) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::Disk vda latency not available >Thread-287831::DEBUG::2014-01-16 17:16:51,060::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'truesize': '42949672960', 'apparentsize': '42949672960', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa'}, u'hdd': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.42', 'elapsedTime': '62', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:16:51,619::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287783::DEBUG::2014-01-16 17:16:51,644::task::579::TaskManager.Task::(_updateState) Task=`561d9327-ce7b-4420-8623-183561aa4045`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:16:51,644::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:16:51,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:16:51,645::task::1168::TaskManager.Task::(prepare) Task=`561d9327-ce7b-4420-8623-183561aa4045`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:16:51,646::task::579::TaskManager.Task::(_updateState) Task=`561d9327-ce7b-4420-8623-183561aa4045`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:16:51,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:16:51,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:16:51,646::task::974::TaskManager.Task::(_decref) Task=`561d9327-ce7b-4420-8623-183561aa4045`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:51,652::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:52,621::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:52,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:16:52,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:16:53,103::task::579::TaskManager.Task::(_updateState) Task=`54ecdecd-88bd-4507-a8c2-1349ffac1186`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:16:53,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:16:53,104::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:16:53,104::task::1168::TaskManager.Task::(prepare) Task=`54ecdecd-88bd-4507-a8c2-1349ffac1186`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:16:53,104::task::579::TaskManager.Task::(_updateState) Task=`54ecdecd-88bd-4507-a8c2-1349ffac1186`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:16:53,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:16:53,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:16:53,105::task::974::TaskManager.Task::(_decref) Task=`54ecdecd-88bd-4507-a8c2-1349ffac1186`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:16:53,105::task::579::TaskManager.Task::(_updateState) Task=`a2cf04ea-36ec-464c-aa1e-fcdc8ec6f255`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:16:53,105::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:16:53,106::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:16:53,106::task::1168::TaskManager.Task::(prepare) Task=`a2cf04ea-36ec-464c-aa1e-fcdc8ec6f255`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:16:53,106::task::579::TaskManager.Task::(_updateState) Task=`a2cf04ea-36ec-464c-aa1e-fcdc8ec6f255`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:16:53,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:16:53,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:16:53,106::task::974::TaskManager.Task::(_decref) Task=`a2cf04ea-36ec-464c-aa1e-fcdc8ec6f255`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:16:53,107::task::579::TaskManager.Task::(_updateState) Task=`8b73ec0a-c05d-44bb-a9fa-8d4c3eaf422f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:16:53,107::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:16:53,107::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:16:53,107::task::1168::TaskManager.Task::(prepare) Task=`8b73ec0a-c05d-44bb-a9fa-8d4c3eaf422f`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:16:53,107::task::579::TaskManager.Task::(_updateState) Task=`8b73ec0a-c05d-44bb-a9fa-8d4c3eaf422f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:16:53,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:16:53,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:16:53,108::task::974::TaskManager.Task::(_decref) Task=`8b73ec0a-c05d-44bb-a9fa-8d4c3eaf422f`::ref 0 aborting False >Thread-16244::DEBUG::2014-01-16 17:16:53,264::task::579::TaskManager.Task::(_updateState) Task=`280ebe29-8eee-41a4-8e8e-ce209e205241`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:16:53,264::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:16:53,265::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:16:53,265::task::1168::TaskManager.Task::(prepare) Task=`280ebe29-8eee-41a4-8e8e-ce209e205241`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:16:53,265::task::579::TaskManager.Task::(_updateState) Task=`280ebe29-8eee-41a4-8e8e-ce209e205241`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:16:53,265::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:16:53,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:16:53,265::task::974::TaskManager.Task::(_decref) Task=`280ebe29-8eee-41a4-8e8e-ce209e205241`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:16:53,622::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:53,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:16:53,655::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:54,656::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:16:55,488::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:16:55,512::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000286194 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:55,623::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:55,657::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:16:56,659::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287833::DEBUG::2014-01-16 17:16:57,204::task::579::TaskManager.Task::(_updateState) Task=`e67e4fcd-2839-4fd9-854c-da4a5e9d393a`::moving from state init -> state preparing >Thread-287833::INFO::2014-01-16 17:16:57,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287833::INFO::2014-01-16 17:16:57,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286194', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304328', 'lastCheck': '9.8', 'valid': True}} >Thread-287833::DEBUG::2014-01-16 17:16:57,205::task::1168::TaskManager.Task::(prepare) Task=`e67e4fcd-2839-4fd9-854c-da4a5e9d393a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000286194', 'lastCheck': '1.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304328', 'lastCheck': '9.8', 'valid': True}} >Thread-287833::DEBUG::2014-01-16 17:16:57,205::task::579::TaskManager.Task::(_updateState) Task=`e67e4fcd-2839-4fd9-854c-da4a5e9d393a`::moving from state preparing -> state finished >Thread-287833::DEBUG::2014-01-16 17:16:57,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287833::DEBUG::2014-01-16 17:16:57,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287833::DEBUG::2014-01-16 17:16:57,206::task::974::TaskManager.Task::(_decref) Task=`e67e4fcd-2839-4fd9-854c-da4a5e9d393a`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:16:57,380::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:16:57,398::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000363039 s, 11.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:16:57,625::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:16:57,626::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:57,661::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:16:58,420::task::579::TaskManager.Task::(_updateState) Task=`e34e9980-9713-4a26-aeb6-771eb207a5e1`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:16:58,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:16:58,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:16:58,422::task::1168::TaskManager.Task::(prepare) Task=`e34e9980-9713-4a26-aeb6-771eb207a5e1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:16:58,422::task::579::TaskManager.Task::(_updateState) Task=`e34e9980-9713-4a26-aeb6-771eb207a5e1`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:16:58,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:16:58,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:16:58,422::task::974::TaskManager.Task::(_decref) Task=`e34e9980-9713-4a26-aeb6-771eb207a5e1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:16:58,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:16:58,662::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:16:58,662::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:16:59,627::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:16:59,664::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:16:59,664::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:00,665::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:17:00,666::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:17:00,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:01,628::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:01,667::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:17:01,667::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:02,630::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:17:02,631::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:17:02,633::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:02,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:17:02,669::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:03,634::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:03,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:04,671::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:17:04,671::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:17:05,272::task::579::TaskManager.Task::(_updateState) Task=`f3dd4bcd-4353-4363-9097-7272569b5837`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:17:05,272::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:17:05,272::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:17:05,273::task::1168::TaskManager.Task::(prepare) Task=`f3dd4bcd-4353-4363-9097-7272569b5837`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:17:05,273::task::579::TaskManager.Task::(_updateState) Task=`f3dd4bcd-4353-4363-9097-7272569b5837`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:17:05,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:17:05,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:17:05,273::task::974::TaskManager.Task::(_decref) Task=`f3dd4bcd-4353-4363-9097-7272569b5837`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:17:05,523::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:17:05,547::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264986 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:05,636::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:05,673::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:17:05,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:06,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:17:06,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:17:06,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:17:06,674::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:17:07,403::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:17:07,421::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000274708 s, 14.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:07,637::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:07,639::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:07,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:17:07,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:17:07,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:17:08,643::task::579::TaskManager.Task::(_updateState) Task=`e4c3b803-2adb-48a8-a9b7-a372f403c158`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:17:08,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:17:08,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:17:08,645::task::1168::TaskManager.Task::(prepare) Task=`e4c3b803-2adb-48a8-a9b7-a372f403c158`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:17:08,645::task::579::TaskManager.Task::(_updateState) Task=`e4c3b803-2adb-48a8-a9b7-a372f403c158`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:17:08,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:17:08,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:17:08,645::task::974::TaskManager.Task::(_decref) Task=`e4c3b803-2adb-48a8-a9b7-a372f403c158`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:17:08,653::task::579::TaskManager.Task::(_updateState) Task=`e7805a49-b553-4060-b9b6-d9a0baa8e0cc`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:17:08,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:17:08,654::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:17:08,655::task::1168::TaskManager.Task::(prepare) Task=`e7805a49-b553-4060-b9b6-d9a0baa8e0cc`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:17:08,655::task::579::TaskManager.Task::(_updateState) Task=`e7805a49-b553-4060-b9b6-d9a0baa8e0cc`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:17:08,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:17:08,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:17:08,656::task::974::TaskManager.Task::(_decref) Task=`e7805a49-b553-4060-b9b6-d9a0baa8e0cc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:08,677::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:17:08,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:09,640::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:09,678::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:17:09,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:17:09,679::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:17:09,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:17:10,653::task::579::TaskManager.Task::(_updateState) Task=`b851760a-fea7-46b7-89ff-3d7b5792862b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:17:10,654::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:17:10,655::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:17:10,655::task::1168::TaskManager.Task::(prepare) Task=`b851760a-fea7-46b7-89ff-3d7b5792862b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:17:10,655::task::579::TaskManager.Task::(_updateState) Task=`b851760a-fea7-46b7-89ff-3d7b5792862b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:17:10,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:17:10,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:17:10,656::task::974::TaskManager.Task::(_decref) Task=`b851760a-fea7-46b7-89ff-3d7b5792862b`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:17:10,656::task::579::TaskManager.Task::(_updateState) Task=`98066e93-35bc-4fc0-870d-46b9267e778e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:17:10,656::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:17:10,656::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:17:10,656::task::1168::TaskManager.Task::(prepare) Task=`98066e93-35bc-4fc0-870d-46b9267e778e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:17:10,657::task::579::TaskManager.Task::(_updateState) Task=`98066e93-35bc-4fc0-870d-46b9267e778e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:17:10,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:17:10,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:17:10,657::task::974::TaskManager.Task::(_decref) Task=`98066e93-35bc-4fc0-870d-46b9267e778e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:10,680::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:11,641::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:11,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:17:11,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:17:11,682::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:17:11,683::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:11,683::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:17:11,684::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:17:12,225::task::579::TaskManager.Task::(_updateState) Task=`c796966c-1434-4305-ab1b-d16868601c81`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:17:12,226::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:17:12,226::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:17:12,226::task::1168::TaskManager.Task::(prepare) Task=`c796966c-1434-4305-ab1b-d16868601c81`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:17:12,226::task::579::TaskManager.Task::(_updateState) Task=`c796966c-1434-4305-ab1b-d16868601c81`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:17:12,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:17:12,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:17:12,227::task::974::TaskManager.Task::(_decref) Task=`c796966c-1434-4305-ab1b-d16868601c81`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:17:12,435::task::579::TaskManager.Task::(_updateState) Task=`e86b0a52-aa37-4a8a-b023-814917561efc`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:17:12,435::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:17:12,435::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:17:12,435::task::1168::TaskManager.Task::(prepare) Task=`e86b0a52-aa37-4a8a-b023-814917561efc`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:17:12,436::task::579::TaskManager.Task::(_updateState) Task=`e86b0a52-aa37-4a8a-b023-814917561efc`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:17:12,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:17:12,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:17:12,436::task::974::TaskManager.Task::(_decref) Task=`e86b0a52-aa37-4a8a-b023-814917561efc`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:17:12,436::task::579::TaskManager.Task::(_updateState) Task=`f0e29ba6-2893-492a-93fa-557314c30d58`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:17:12,436::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:17:12,437::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:17:12,437::task::1168::TaskManager.Task::(prepare) Task=`f0e29ba6-2893-492a-93fa-557314c30d58`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:17:12,437::task::579::TaskManager.Task::(_updateState) Task=`f0e29ba6-2893-492a-93fa-557314c30d58`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:17:12,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:17:12,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:17:12,437::task::974::TaskManager.Task::(_decref) Task=`f0e29ba6-2893-492a-93fa-557314c30d58`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:12,642::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:12,685::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287839::DEBUG::2014-01-16 17:17:13,064::task::579::TaskManager.Task::(_updateState) Task=`0eda3217-5a01-49d7-a7f3-0143f626fc8d`::moving from state init -> state preparing >Thread-287839::INFO::2014-01-16 17:17:13,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287839::INFO::2014-01-16 17:17:13,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264986', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274708', 'lastCheck': '5.6', 'valid': True}} >Thread-287839::DEBUG::2014-01-16 17:17:13,064::task::1168::TaskManager.Task::(prepare) Task=`0eda3217-5a01-49d7-a7f3-0143f626fc8d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264986', 'lastCheck': '7.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274708', 'lastCheck': '5.6', 'valid': True}} >Thread-287839::DEBUG::2014-01-16 17:17:13,064::task::579::TaskManager.Task::(_updateState) Task=`0eda3217-5a01-49d7-a7f3-0143f626fc8d`::moving from state preparing -> state finished >Thread-287839::DEBUG::2014-01-16 17:17:13,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287839::DEBUG::2014-01-16 17:17:13,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287839::DEBUG::2014-01-16 17:17:13,065::task::974::TaskManager.Task::(_decref) Task=`0eda3217-5a01-49d7-a7f3-0143f626fc8d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:13,644::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:13,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:17:13,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:17:13,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:14,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:17:14,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:17:14,689::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:17:15,558::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:17:15,580::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029998 s, 1.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:15,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:15,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:17:15,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:17:15,690::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:17:15,691::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:17:15,989::task::579::TaskManager.Task::(_updateState) Task=`98e93d62-938e-4954-be17-bd3ff7c9f84e`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:17:15,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:17:15,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:17:15,990::task::1168::TaskManager.Task::(prepare) Task=`98e93d62-938e-4954-be17-bd3ff7c9f84e`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:17:15,990::task::579::TaskManager.Task::(_updateState) Task=`98e93d62-938e-4954-be17-bd3ff7c9f84e`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:17:15,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:17:15,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:17:15,990::task::974::TaskManager.Task::(_decref) Task=`98e93d62-938e-4954-be17-bd3ff7c9f84e`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:17:16,179::task::579::TaskManager.Task::(_updateState) Task=`337246ee-ee48-47a6-a26c-0b40b2587407`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:17:16,179::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:17:16,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:17:16,180::task::1168::TaskManager.Task::(prepare) Task=`337246ee-ee48-47a6-a26c-0b40b2587407`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:17:16,180::task::579::TaskManager.Task::(_updateState) Task=`337246ee-ee48-47a6-a26c-0b40b2587407`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:17:16,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:17:16,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:17:16,181::task::974::TaskManager.Task::(_decref) Task=`337246ee-ee48-47a6-a26c-0b40b2587407`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:16,692::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:17:17,365::task::579::TaskManager.Task::(_updateState) Task=`02fc2931-15ce-4484-bde6-f59c2d442c03`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:17:17,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:17:17,366::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:17:17,366::task::1168::TaskManager.Task::(prepare) Task=`02fc2931-15ce-4484-bde6-f59c2d442c03`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:17:17,366::task::579::TaskManager.Task::(_updateState) Task=`02fc2931-15ce-4484-bde6-f59c2d442c03`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:17:17,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:17:17,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:17:17,367::task::974::TaskManager.Task::(_decref) Task=`02fc2931-15ce-4484-bde6-f59c2d442c03`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:17:17,428::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:17:17,446::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000296185 s, 13.8 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:17,647::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:17,648::task::579::TaskManager.Task::(_updateState) Task=`4efb7eee-8356-445c-b254-416d61347df6`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:17:17,648::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:17:17,648::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:17:17,648::task::1168::TaskManager.Task::(prepare) Task=`4efb7eee-8356-445c-b254-416d61347df6`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:17:17,649::task::579::TaskManager.Task::(_updateState) Task=`4efb7eee-8356-445c-b254-416d61347df6`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:17:17,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:17:17,649::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:17:17,649::task::974::TaskManager.Task::(_decref) Task=`4efb7eee-8356-445c-b254-416d61347df6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:17,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:17:17,651::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:17:17,652::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:17,654::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:17,655::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:17,692::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:17:17,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:17:18,224::task::579::TaskManager.Task::(_updateState) Task=`1a63d12a-16b4-45ab-998e-4f37014381da`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:17:18,224::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:17:18,225::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:17:18,225::task::1168::TaskManager.Task::(prepare) Task=`1a63d12a-16b4-45ab-998e-4f37014381da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:17:18,225::task::579::TaskManager.Task::(_updateState) Task=`1a63d12a-16b4-45ab-998e-4f37014381da`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:17:18,225::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:17:18,225::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:17:18,225::task::974::TaskManager.Task::(_decref) Task=`1a63d12a-16b4-45ab-998e-4f37014381da`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:17:18,424::task::579::TaskManager.Task::(_updateState) Task=`ddd587df-a512-4463-939e-7c60ba6480e9`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:17:18,424::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:17:18,425::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:17:18,425::task::1168::TaskManager.Task::(prepare) Task=`ddd587df-a512-4463-939e-7c60ba6480e9`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:17:18,425::task::579::TaskManager.Task::(_updateState) Task=`ddd587df-a512-4463-939e-7c60ba6480e9`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:17:18,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:17:18,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:17:18,425::task::974::TaskManager.Task::(_decref) Task=`ddd587df-a512-4463-939e-7c60ba6480e9`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:17:18,426::task::579::TaskManager.Task::(_updateState) Task=`f97a9e85-5164-4d38-b3bd-a3592502be2a`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:17:18,426::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:17:18,426::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:17:18,426::task::1168::TaskManager.Task::(prepare) Task=`f97a9e85-5164-4d38-b3bd-a3592502be2a`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:17:18,426::task::579::TaskManager.Task::(_updateState) Task=`f97a9e85-5164-4d38-b3bd-a3592502be2a`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:17:18,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:17:18,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:17:18,427::task::974::TaskManager.Task::(_decref) Task=`f97a9e85-5164-4d38-b3bd-a3592502be2a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:18,694::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:19,656::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:19,695::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:17:20,230::task::579::TaskManager.Task::(_updateState) Task=`ea935ac3-98f3-4709-ba76-4ad6e669131b`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:17:20,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:17:20,231::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:17:20,232::task::1168::TaskManager.Task::(prepare) Task=`ea935ac3-98f3-4709-ba76-4ad6e669131b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:17:20,232::task::579::TaskManager.Task::(_updateState) Task=`ea935ac3-98f3-4709-ba76-4ad6e669131b`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:17:20,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:17:20,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:17:20,232::task::974::TaskManager.Task::(_decref) Task=`ea935ac3-98f3-4709-ba76-4ad6e669131b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:20,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:21,657::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:21,697::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:17:22,255::task::579::TaskManager.Task::(_updateState) Task=`42092be0-894e-4b00-8745-b8be0e78613c`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:17:22,255::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:17:22,255::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:17:22,256::task::1168::TaskManager.Task::(prepare) Task=`42092be0-894e-4b00-8745-b8be0e78613c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:17:22,256::task::579::TaskManager.Task::(_updateState) Task=`42092be0-894e-4b00-8745-b8be0e78613c`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:17:22,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:17:22,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:17:22,256::task::974::TaskManager.Task::(_decref) Task=`42092be0-894e-4b00-8745-b8be0e78613c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:22,659::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:22,698::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:17:22,698::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:23,660::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:23,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:17:23,700::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:24,700::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:17:25,161::task::579::TaskManager.Task::(_updateState) Task=`28e72dc4-3339-4119-b78c-6b684ed28a3c`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:17:25,162::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:17:25,162::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:17:25,162::task::1168::TaskManager.Task::(prepare) Task=`28e72dc4-3339-4119-b78c-6b684ed28a3c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:17:25,162::task::579::TaskManager.Task::(_updateState) Task=`28e72dc4-3339-4119-b78c-6b684ed28a3c`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:17:25,163::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:17:25,163::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:17:25,163::task::974::TaskManager.Task::(_decref) Task=`28e72dc4-3339-4119-b78c-6b684ed28a3c`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:17:25,163::task::579::TaskManager.Task::(_updateState) Task=`97daab87-3378-4dfb-9669-e53d746a6b00`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:17:25,163::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:17:25,164::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:17:25,164::task::1168::TaskManager.Task::(prepare) Task=`97daab87-3378-4dfb-9669-e53d746a6b00`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:17:25,164::task::579::TaskManager.Task::(_updateState) Task=`97daab87-3378-4dfb-9669-e53d746a6b00`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:17:25,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:17:25,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:17:25,164::task::974::TaskManager.Task::(_decref) Task=`97daab87-3378-4dfb-9669-e53d746a6b00`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:17:25,165::task::579::TaskManager.Task::(_updateState) Task=`a976ad39-81e9-4d55-badc-5ab54a8a7daa`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:17:25,165::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:17:25,165::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:17:25,165::task::1168::TaskManager.Task::(prepare) Task=`a976ad39-81e9-4d55-badc-5ab54a8a7daa`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:17:25,165::task::579::TaskManager.Task::(_updateState) Task=`a976ad39-81e9-4d55-badc-5ab54a8a7daa`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:17:25,165::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:17:25,165::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:17:25,166::task::974::TaskManager.Task::(_decref) Task=`a976ad39-81e9-4d55-badc-5ab54a8a7daa`::ref 0 aborting False >Thread-49313::DEBUG::2014-01-16 17:17:25,179::task::579::TaskManager.Task::(_updateState) Task=`87630e6c-1c3a-4f55-aa7e-20b23ff5fc16`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:17:25,179::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:17:25,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:17:25,179::task::1168::TaskManager.Task::(prepare) Task=`87630e6c-1c3a-4f55-aa7e-20b23ff5fc16`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:17:25,180::task::579::TaskManager.Task::(_updateState) Task=`87630e6c-1c3a-4f55-aa7e-20b23ff5fc16`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:17:25,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:17:25,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:17:25,180::task::974::TaskManager.Task::(_decref) Task=`87630e6c-1c3a-4f55-aa7e-20b23ff5fc16`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:17:25,591::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:17:25,613::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000270869 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:25,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:25,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:26,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:17:27,451::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:17:27,469::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000182361 s, 22.5 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 17:17:27,633::task::579::TaskManager.Task::(_updateState) Task=`c44c91cc-a528-47dd-972e-785db373eae9`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:17:27,633::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:17:27,635::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:17:27,635::task::1168::TaskManager.Task::(prepare) Task=`c44c91cc-a528-47dd-972e-785db373eae9`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:17:27,635::task::579::TaskManager.Task::(_updateState) Task=`c44c91cc-a528-47dd-972e-785db373eae9`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:17:27,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:17:27,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:17:27,636::task::974::TaskManager.Task::(_decref) Task=`c44c91cc-a528-47dd-972e-785db373eae9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:27,663::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:27,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:27,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:28,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:17:28,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:17:28,705::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287845::DEBUG::2014-01-16 17:17:28,828::task::579::TaskManager.Task::(_updateState) Task=`eb961cd8-f660-4d92-bd9e-929f47ff8b4b`::moving from state init -> state preparing >Thread-287845::INFO::2014-01-16 17:17:28,829::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287845::INFO::2014-01-16 17:17:28,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270869', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000182361', 'lastCheck': '1.4', 'valid': True}} >Thread-287845::DEBUG::2014-01-16 17:17:28,829::task::1168::TaskManager.Task::(prepare) Task=`eb961cd8-f660-4d92-bd9e-929f47ff8b4b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270869', 'lastCheck': '3.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000182361', 'lastCheck': '1.4', 'valid': True}} >Thread-287845::DEBUG::2014-01-16 17:17:28,829::task::579::TaskManager.Task::(_updateState) Task=`eb961cd8-f660-4d92-bd9e-929f47ff8b4b`::moving from state preparing -> state finished >Thread-287845::DEBUG::2014-01-16 17:17:28,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287845::DEBUG::2014-01-16 17:17:28,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287845::DEBUG::2014-01-16 17:17:28,830::task::974::TaskManager.Task::(_decref) Task=`eb961cd8-f660-4d92-bd9e-929f47ff8b4b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:29,666::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:29,706::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:17:29,707::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:30,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:17:30,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:17:30,709::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:31,667::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:31,710::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:17:31,710::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:32,669::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:17:32,670::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:17:32,671::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:32,712::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:17:32,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:17:32,762::task::579::TaskManager.Task::(_updateState) Task=`e09eb217-2f40-4b03-acab-d0d0bff9e29c`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:17:32,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:17:32,762::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:17:32,763::task::1168::TaskManager.Task::(prepare) Task=`e09eb217-2f40-4b03-acab-d0d0bff9e29c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:17:32,763::task::579::TaskManager.Task::(_updateState) Task=`e09eb217-2f40-4b03-acab-d0d0bff9e29c`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:17:32,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:17:32,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:17:32,763::task::974::TaskManager.Task::(_decref) Task=`e09eb217-2f40-4b03-acab-d0d0bff9e29c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:33,672::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:33,713::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:17:34,458::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:17:34,459::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:17:34,459::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:17:34,460::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:17:34,461::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >VM Channels Listener::DEBUG::2014-01-16 17:17:34,715::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:17:34,715::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:17:35,623::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:17:35,645::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000288941 s, 1.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:35,674::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:35,716::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:17:35,716::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287848::DEBUG::2014-01-16 17:17:36,459::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287849::DEBUG::2014-01-16 17:17:36,459::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287850::DEBUG::2014-01-16 17:17:36,460::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287851::DEBUG::2014-01-16 17:17:36,461::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287852::DEBUG::2014-01-16 17:17:36,461::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >VM Channels Listener::DEBUG::2014-01-16 17:17:36,717::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:17:36,717::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:17:36,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:17:36,718::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:17:36,762::task::579::TaskManager.Task::(_updateState) Task=`02601ff5-6c00-4b85-9589-e88f8b453e10`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:17:36,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:17:36,763::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:17:36,763::task::1168::TaskManager.Task::(prepare) Task=`02601ff5-6c00-4b85-9589-e88f8b453e10`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:17:36,763::task::579::TaskManager.Task::(_updateState) Task=`02601ff5-6c00-4b85-9589-e88f8b453e10`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:17:36,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:17:36,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:17:36,763::task::974::TaskManager.Task::(_decref) Task=`02601ff5-6c00-4b85-9589-e88f8b453e10`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:17:36,766::task::579::TaskManager.Task::(_updateState) Task=`58b65c62-3857-4cc6-9a9d-2d16b3fe322f`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:17:36,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:17:36,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:17:36,767::task::1168::TaskManager.Task::(prepare) Task=`58b65c62-3857-4cc6-9a9d-2d16b3fe322f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:17:36,767::task::579::TaskManager.Task::(_updateState) Task=`58b65c62-3857-4cc6-9a9d-2d16b3fe322f`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:17:36,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:17:36,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:17:36,767::task::974::TaskManager.Task::(_decref) Task=`58b65c62-3857-4cc6-9a9d-2d16b3fe322f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:17:37,474::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:17:37,491::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000307132 s, 13.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:37,676::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:37,677::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:37,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:17:37,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:17:37,720::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:38,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:17:38,721::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:39,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:39,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:17:39,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:17:39,723::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:17:39,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:17:40,193::task::579::TaskManager.Task::(_updateState) Task=`78942440-2497-442b-bfb6-e36b91bd9b46`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:17:40,193::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:17:40,193::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:17:40,193::task::1168::TaskManager.Task::(prepare) Task=`78942440-2497-442b-bfb6-e36b91bd9b46`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:17:40,194::task::579::TaskManager.Task::(_updateState) Task=`78942440-2497-442b-bfb6-e36b91bd9b46`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:17:40,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:17:40,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:17:40,194::task::974::TaskManager.Task::(_decref) Task=`78942440-2497-442b-bfb6-e36b91bd9b46`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:17:40,194::task::579::TaskManager.Task::(_updateState) Task=`5f194a7a-b996-426d-bf19-2c9774b43e95`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:17:40,194::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:17:40,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:17:40,195::task::1168::TaskManager.Task::(prepare) Task=`5f194a7a-b996-426d-bf19-2c9774b43e95`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:17:40,195::task::579::TaskManager.Task::(_updateState) Task=`5f194a7a-b996-426d-bf19-2c9774b43e95`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:17:40,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:17:40,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:17:40,195::task::974::TaskManager.Task::(_decref) Task=`5f194a7a-b996-426d-bf19-2c9774b43e95`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:40,724::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:41,679::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:41,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:17:41,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:17:41,726::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:17:41,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:41,727::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:17:41,727::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:17:42,310::task::579::TaskManager.Task::(_updateState) Task=`7284530a-854a-4663-915b-c152af598d4d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:17:42,310::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:17:42,311::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:17:42,311::task::1168::TaskManager.Task::(prepare) Task=`7284530a-854a-4663-915b-c152af598d4d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:17:42,311::task::579::TaskManager.Task::(_updateState) Task=`7284530a-854a-4663-915b-c152af598d4d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:17:42,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:17:42,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:17:42,312::task::974::TaskManager.Task::(_decref) Task=`7284530a-854a-4663-915b-c152af598d4d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:42,681::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:42,727::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:43,682::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:43,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:17:43,728::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:17:43,728::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:17:44,127::task::579::TaskManager.Task::(_updateState) Task=`16c46c7b-458d-4e09-853d-f0a18b928dba`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:17:44,127::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:17:44,128::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:17:44,128::task::1168::TaskManager.Task::(prepare) Task=`16c46c7b-458d-4e09-853d-f0a18b928dba`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:17:44,128::task::579::TaskManager.Task::(_updateState) Task=`16c46c7b-458d-4e09-853d-f0a18b928dba`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:17:44,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:17:44,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:17:44,129::task::974::TaskManager.Task::(_decref) Task=`16c46c7b-458d-4e09-853d-f0a18b928dba`::ref 0 aborting False >Thread-287856::DEBUG::2014-01-16 17:17:44,588::task::579::TaskManager.Task::(_updateState) Task=`d82c8b19-aa6b-40b9-9908-44e3d5c5fece`::moving from state init -> state preparing >Thread-287856::INFO::2014-01-16 17:17:44,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287856::INFO::2014-01-16 17:17:44,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288941', 'lastCheck': '8.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307132', 'lastCheck': '7.1', 'valid': True}} >Thread-287856::DEBUG::2014-01-16 17:17:44,589::task::1168::TaskManager.Task::(prepare) Task=`d82c8b19-aa6b-40b9-9908-44e3d5c5fece`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288941', 'lastCheck': '8.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307132', 'lastCheck': '7.1', 'valid': True}} >Thread-287856::DEBUG::2014-01-16 17:17:44,589::task::579::TaskManager.Task::(_updateState) Task=`d82c8b19-aa6b-40b9-9908-44e3d5c5fece`::moving from state preparing -> state finished >Thread-287856::DEBUG::2014-01-16 17:17:44,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287856::DEBUG::2014-01-16 17:17:44,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287856::DEBUG::2014-01-16 17:17:44,590::task::974::TaskManager.Task::(_decref) Task=`d82c8b19-aa6b-40b9-9908-44e3d5c5fece`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:44,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:17:44,730::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:17:44,730::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287858::DEBUG::2014-01-16 17:17:45,183::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [408a74ec] >Thread-287858::INFO::2014-01-16 17:17:45,184::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-287858::DEBUG::2014-01-16 17:17:45,184::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-287858::ERROR::2014-01-16 17:17:45,191::BindingXMLRPC::1003::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in vmDestroy > return vm.destroy() > File "/usr/share/vdsm/API.py", line 329, in destroy > res = v.destroy() > File "/usr/share/vdsm/vm.py", line 4485, in destroy > response = self.releaseVm() > File "/usr/share/vdsm/vm.py", line 4417, in releaseVm > supervdsm.getProxy().removeFs(drive.path) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in removeFs > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >Exception: Cannot remove Fs that does not exists in: /var/run/vdsm/payload >Thread-16393::DEBUG::2014-01-16 17:17:45,379::task::579::TaskManager.Task::(_updateState) Task=`c1f8a0f3-489f-47be-a31c-e3122d50d4f2`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:17:45,379::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:17:45,379::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:17:45,379::task::1168::TaskManager.Task::(prepare) Task=`c1f8a0f3-489f-47be-a31c-e3122d50d4f2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:17:45,380::task::579::TaskManager.Task::(_updateState) Task=`c1f8a0f3-489f-47be-a31c-e3122d50d4f2`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:17:45,380::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:17:45,380::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:17:45,380::task::974::TaskManager.Task::(_decref) Task=`c1f8a0f3-489f-47be-a31c-e3122d50d4f2`::ref 0 aborting False >Thread-16398::DEBUG::2014-01-16 17:17:45,389::task::579::TaskManager.Task::(_updateState) Task=`15f05644-6beb-4037-a7a7-64b6db633557`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:17:45,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:17:45,390::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:17:45,390::task::1168::TaskManager.Task::(prepare) Task=`15f05644-6beb-4037-a7a7-64b6db633557`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:17:45,390::task::579::TaskManager.Task::(_updateState) Task=`15f05644-6beb-4037-a7a7-64b6db633557`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:17:45,390::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:17:45,390::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:17:45,391::task::974::TaskManager.Task::(_decref) Task=`15f05644-6beb-4037-a7a7-64b6db633557`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:17:45,392::task::579::TaskManager.Task::(_updateState) Task=`c3977c60-2a6f-4841-ab5d-48c8b2be77f8`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:17:45,393::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:17:45,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:17:45,393::task::1168::TaskManager.Task::(prepare) Task=`c3977c60-2a6f-4841-ab5d-48c8b2be77f8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:17:45,393::task::579::TaskManager.Task::(_updateState) Task=`c3977c60-2a6f-4841-ab5d-48c8b2be77f8`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:17:45,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:17:45,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:17:45,394::task::974::TaskManager.Task::(_decref) Task=`c3977c60-2a6f-4841-ab5d-48c8b2be77f8`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:17:45,655::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:17:45,677::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257852 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:45,684::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:45,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:17:45,732::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:17:45,732::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:17:45,732::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20952::DEBUG::2014-01-16 17:17:46,250::task::579::TaskManager.Task::(_updateState) Task=`f3eecad2-b0e0-4c06-97db-b5cbc3de7156`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:17:46,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:17:46,251::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:17:46,251::task::1168::TaskManager.Task::(prepare) Task=`f3eecad2-b0e0-4c06-97db-b5cbc3de7156`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:17:46,251::task::579::TaskManager.Task::(_updateState) Task=`f3eecad2-b0e0-4c06-97db-b5cbc3de7156`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:17:46,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:17:46,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:17:46,252::task::974::TaskManager.Task::(_decref) Task=`f3eecad2-b0e0-4c06-97db-b5cbc3de7156`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:17:46,253::task::579::TaskManager.Task::(_updateState) Task=`99bc8806-c352-41d3-926a-7c016a0c7375`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:17:46,253::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:17:46,254::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:17:46,254::task::1168::TaskManager.Task::(prepare) Task=`99bc8806-c352-41d3-926a-7c016a0c7375`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:17:46,254::task::579::TaskManager.Task::(_updateState) Task=`99bc8806-c352-41d3-926a-7c016a0c7375`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:17:46,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:17:46,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:17:46,255::task::974::TaskManager.Task::(_decref) Task=`99bc8806-c352-41d3-926a-7c016a0c7375`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:46,733::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:17:47,496::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:17:47,513::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00027984 s, 14.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:47,686::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:47,688::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:17:47,688::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:17:47,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:47,734::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:17:47,735::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:48,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:49,690::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:49,737::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:50,738::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:51,692::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287783::DEBUG::2014-01-16 17:17:51,714::task::579::TaskManager.Task::(_updateState) Task=`f8609424-993b-42b2-9083-1e12ff88a85b`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:17:51,715::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:17:51,715::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:17:51,715::task::1168::TaskManager.Task::(prepare) Task=`f8609424-993b-42b2-9083-1e12ff88a85b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:17:51,715::task::579::TaskManager.Task::(_updateState) Task=`f8609424-993b-42b2-9083-1e12ff88a85b`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:17:51,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:17:51,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:17:51,716::task::974::TaskManager.Task::(_decref) Task=`f8609424-993b-42b2-9083-1e12ff88a85b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:51,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:52,693::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:52,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:17:52,741::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:17:53,379::task::579::TaskManager.Task::(_updateState) Task=`a70cf6ba-4413-4c9f-a3d9-892cd3a02764`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:17:53,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:17:53,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:17:53,380::task::1168::TaskManager.Task::(prepare) Task=`a70cf6ba-4413-4c9f-a3d9-892cd3a02764`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:17:53,380::task::579::TaskManager.Task::(_updateState) Task=`a70cf6ba-4413-4c9f-a3d9-892cd3a02764`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:17:53,380::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:17:53,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:17:53,381::task::974::TaskManager.Task::(_decref) Task=`a70cf6ba-4413-4c9f-a3d9-892cd3a02764`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:17:53,381::task::579::TaskManager.Task::(_updateState) Task=`3e2dd4eb-8e38-4370-b11f-f31c19167742`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:17:53,381::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:17:53,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:17:53,382::task::1168::TaskManager.Task::(prepare) Task=`3e2dd4eb-8e38-4370-b11f-f31c19167742`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:17:53,382::task::579::TaskManager.Task::(_updateState) Task=`3e2dd4eb-8e38-4370-b11f-f31c19167742`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:17:53,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:17:53,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:17:53,382::task::974::TaskManager.Task::(_decref) Task=`3e2dd4eb-8e38-4370-b11f-f31c19167742`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:17:53,382::task::579::TaskManager.Task::(_updateState) Task=`95628c70-935b-4162-ad35-77aea3ff9cb9`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:17:53,383::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:17:53,383::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:17:53,383::task::1168::TaskManager.Task::(prepare) Task=`95628c70-935b-4162-ad35-77aea3ff9cb9`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:17:53,383::task::579::TaskManager.Task::(_updateState) Task=`95628c70-935b-4162-ad35-77aea3ff9cb9`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:17:53,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:17:53,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:17:53,384::task::974::TaskManager.Task::(_decref) Task=`95628c70-935b-4162-ad35-77aea3ff9cb9`::ref 0 aborting False >Thread-16244::DEBUG::2014-01-16 17:17:53,433::task::579::TaskManager.Task::(_updateState) Task=`38b9d2f2-0b52-4c68-81bb-5456f7bfea96`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:17:53,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:17:53,433::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:17:53,434::task::1168::TaskManager.Task::(prepare) Task=`38b9d2f2-0b52-4c68-81bb-5456f7bfea96`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:17:53,434::task::579::TaskManager.Task::(_updateState) Task=`38b9d2f2-0b52-4c68-81bb-5456f7bfea96`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:17:53,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:17:53,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:17:53,434::task::974::TaskManager.Task::(_decref) Task=`38b9d2f2-0b52-4c68-81bb-5456f7bfea96`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:17:53,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:53,742::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:17:53,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:54,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:17:55,687::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:17:55,706::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:17:55,714::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000252992 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:17:55,744::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:17:56,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:17:57,518::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:17:57,535::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00022372 s, 18.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:17:57,711::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:17:57,713::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:57,747::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:17:58,607::task::579::TaskManager.Task::(_updateState) Task=`1aa5f876-83d8-41c2-a4e2-3f458c099189`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:17:58,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:17:58,608::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:17:58,608::task::1168::TaskManager.Task::(prepare) Task=`1aa5f876-83d8-41c2-a4e2-3f458c099189`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:17:58,608::task::579::TaskManager.Task::(_updateState) Task=`1aa5f876-83d8-41c2-a4e2-3f458c099189`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:17:58,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:17:58,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:17:58,609::task::974::TaskManager.Task::(_decref) Task=`1aa5f876-83d8-41c2-a4e2-3f458c099189`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:17:58,748::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:17:58,748::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:17:58,749::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:17:59,714::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:17:59,750::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:17:59,750::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287863::DEBUG::2014-01-16 17:18:00,373::task::579::TaskManager.Task::(_updateState) Task=`d3d92c39-fb6f-479d-92c1-5b0385b55aff`::moving from state init -> state preparing >Thread-287863::INFO::2014-01-16 17:18:00,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287863::INFO::2014-01-16 17:18:00,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252992', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022372', 'lastCheck': '2.8', 'valid': True}} >Thread-287863::DEBUG::2014-01-16 17:18:00,374::task::1168::TaskManager.Task::(prepare) Task=`d3d92c39-fb6f-479d-92c1-5b0385b55aff`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000252992', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022372', 'lastCheck': '2.8', 'valid': True}} >Thread-287863::DEBUG::2014-01-16 17:18:00,374::task::579::TaskManager.Task::(_updateState) Task=`d3d92c39-fb6f-479d-92c1-5b0385b55aff`::moving from state preparing -> state finished >Thread-287863::DEBUG::2014-01-16 17:18:00,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287863::DEBUG::2014-01-16 17:18:00,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287863::DEBUG::2014-01-16 17:18:00,375::task::974::TaskManager.Task::(_decref) Task=`d3d92c39-fb6f-479d-92c1-5b0385b55aff`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:00,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:18:00,752::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:18:00,752::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:01,715::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:01,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:18:01,754::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:02,717::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:18:02,718::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:18:02,719::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:02,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:18:02,755::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:03,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:03,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:04,757::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:18:04,757::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:18:05,448::task::579::TaskManager.Task::(_updateState) Task=`d715c82a-b691-4aec-9c48-f35fb9666c64`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:18:05,449::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:18:05,449::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:18:05,449::task::1168::TaskManager.Task::(prepare) Task=`d715c82a-b691-4aec-9c48-f35fb9666c64`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:18:05,450::task::579::TaskManager.Task::(_updateState) Task=`d715c82a-b691-4aec-9c48-f35fb9666c64`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:18:05,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:18:05,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:18:05,450::task::974::TaskManager.Task::(_decref) Task=`d715c82a-b691-4aec-9c48-f35fb9666c64`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:18:05,723::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:18:05,723::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:18:05,745::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000257201 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:18:05,759::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:18:05,759::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287866::DEBUG::2014-01-16 17:18:05,767::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmShutdown with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', '30', 'System Administrator has initiated shutdown of this Virtual Machine. Virtual Machine is shutting down.') {} flowID [58568b23] >Thread-287866::DEBUG::2014-01-16 17:18:05,770::BindingXMLRPC::991::vds::(wrapper) return vmShutdown with {'status': {'message': 'Machine shut down', 'code': 0}} >VM Channels Listener::DEBUG::2014-01-16 17:18:06,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:18:06,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:18:06,761::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:18:06,761::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287868::DEBUG::2014-01-16 17:18:06,968::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287868::DEBUG::2014-01-16 17:18:06,970::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.86', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.20', 'elapsedTime': '138', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:18:07,540::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:18:07,557::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000272357 s, 15.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:18:07,739::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:07,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:07,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:18:07,762::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:18:07,762::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:18:08,722::task::579::TaskManager.Task::(_updateState) Task=`6fb158bd-69ee-4171-a5a7-34c6cfef898c`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:18:08,723::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:18:08,723::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:18:08,723::task::1168::TaskManager.Task::(prepare) Task=`6fb158bd-69ee-4171-a5a7-34c6cfef898c`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:18:08,724::task::579::TaskManager.Task::(_updateState) Task=`6fb158bd-69ee-4171-a5a7-34c6cfef898c`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:18:08,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:18:08,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:18:08,724::task::974::TaskManager.Task::(_decref) Task=`6fb158bd-69ee-4171-a5a7-34c6cfef898c`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:18:08,729::task::579::TaskManager.Task::(_updateState) Task=`dc0c8101-0db1-4e82-95d2-f1d19142b827`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:18:08,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:18:08,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:18:08,731::task::1168::TaskManager.Task::(prepare) Task=`dc0c8101-0db1-4e82-95d2-f1d19142b827`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:18:08,731::task::579::TaskManager.Task::(_updateState) Task=`dc0c8101-0db1-4e82-95d2-f1d19142b827`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:18:08,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:18:08,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:18:08,732::task::974::TaskManager.Task::(_decref) Task=`dc0c8101-0db1-4e82-95d2-f1d19142b827`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:08,763::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:18:08,763::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:09,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:09,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:18:09,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:18:09,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:18:09,764::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287870::DEBUG::2014-01-16 17:18:10,072::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287870::DEBUG::2014-01-16 17:18:10,073::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.86', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.30', 'elapsedTime': '141', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-16399::DEBUG::2014-01-16 17:18:10,755::task::579::TaskManager.Task::(_updateState) Task=`ffc4d04f-f0a7-45c8-aa18-f87a6e9ef695`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:18:10,755::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:18:10,756::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:18:10,756::task::1168::TaskManager.Task::(prepare) Task=`ffc4d04f-f0a7-45c8-aa18-f87a6e9ef695`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:18:10,756::task::579::TaskManager.Task::(_updateState) Task=`ffc4d04f-f0a7-45c8-aa18-f87a6e9ef695`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:18:10,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:18:10,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:18:10,756::task::974::TaskManager.Task::(_decref) Task=`ffc4d04f-f0a7-45c8-aa18-f87a6e9ef695`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:18:10,757::task::579::TaskManager.Task::(_updateState) Task=`c2ac1d17-dcb1-43ec-9532-5bba5a82b20a`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:18:10,757::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:18:10,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:18:10,757::task::1168::TaskManager.Task::(prepare) Task=`c2ac1d17-dcb1-43ec-9532-5bba5a82b20a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:18:10,757::task::579::TaskManager.Task::(_updateState) Task=`c2ac1d17-dcb1-43ec-9532-5bba5a82b20a`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:18:10,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:18:10,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:18:10,758::task::974::TaskManager.Task::(_decref) Task=`c2ac1d17-dcb1-43ec-9532-5bba5a82b20a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:10,765::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:11,742::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:11,766::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:18:11,767::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:18:11,767::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:18:11,767::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:11,767::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:18:11,767::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:18:12,412::task::579::TaskManager.Task::(_updateState) Task=`1cd7338a-d432-4c7c-84b1-eab6ec0f8778`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:18:12,413::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:18:12,413::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:18:12,413::task::1168::TaskManager.Task::(prepare) Task=`1cd7338a-d432-4c7c-84b1-eab6ec0f8778`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:18:12,414::task::579::TaskManager.Task::(_updateState) Task=`1cd7338a-d432-4c7c-84b1-eab6ec0f8778`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:18:12,414::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:18:12,414::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:18:12,414::task::974::TaskManager.Task::(_decref) Task=`1cd7338a-d432-4c7c-84b1-eab6ec0f8778`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:18:12,669::task::579::TaskManager.Task::(_updateState) Task=`b49f3f85-4fb6-495f-b381-6b3cb39ab55d`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:18:12,669::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:18:12,670::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:18:12,670::task::1168::TaskManager.Task::(prepare) Task=`b49f3f85-4fb6-495f-b381-6b3cb39ab55d`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:18:12,670::task::579::TaskManager.Task::(_updateState) Task=`b49f3f85-4fb6-495f-b381-6b3cb39ab55d`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:18:12,670::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:18:12,670::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:18:12,671::task::974::TaskManager.Task::(_decref) Task=`b49f3f85-4fb6-495f-b381-6b3cb39ab55d`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:18:12,671::task::579::TaskManager.Task::(_updateState) Task=`7a764876-fc89-4084-ba13-124a033619b3`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:18:12,671::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:18:12,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:18:12,672::task::1168::TaskManager.Task::(prepare) Task=`7a764876-fc89-4084-ba13-124a033619b3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:18:12,672::task::579::TaskManager.Task::(_updateState) Task=`7a764876-fc89-4084-ba13-124a033619b3`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:18:12,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:18:12,672::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:18:12,672::task::974::TaskManager.Task::(_decref) Task=`7a764876-fc89-4084-ba13-124a033619b3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:12,744::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:12,767::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287872::DEBUG::2014-01-16 17:18:13,173::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287872::DEBUG::2014-01-16 17:18:13,174::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.86', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.40', 'elapsedTime': '144', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:18:13,746::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:13,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:18:13,768::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:18:13,768::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:14,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:18:14,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:18:14,770::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:15,747::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:18:15,755::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:18:15,773::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:18:15,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:18:15,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:18:15,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:18:15,787::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271523 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:18:16,133::task::579::TaskManager.Task::(_updateState) Task=`1db71369-dbdb-4df2-be79-1637e07d4183`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:18:16,134::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:18:16,134::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:18:16,134::task::1168::TaskManager.Task::(prepare) Task=`1db71369-dbdb-4df2-be79-1637e07d4183`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:18:16,135::task::579::TaskManager.Task::(_updateState) Task=`1db71369-dbdb-4df2-be79-1637e07d4183`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:18:16,135::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:18:16,135::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:18:16,135::task::974::TaskManager.Task::(_decref) Task=`1db71369-dbdb-4df2-be79-1637e07d4183`::ref 0 aborting False >Thread-287873::DEBUG::2014-01-16 17:18:16,232::task::579::TaskManager.Task::(_updateState) Task=`6980d38b-5cc8-4534-bf7c-6f2f34e54ff4`::moving from state init -> state preparing >Thread-287873::INFO::2014-01-16 17:18:16,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287873::INFO::2014-01-16 17:18:16,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271523', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272357', 'lastCheck': '8.7', 'valid': True}} >Thread-287873::DEBUG::2014-01-16 17:18:16,233::task::1168::TaskManager.Task::(prepare) Task=`6980d38b-5cc8-4534-bf7c-6f2f34e54ff4`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000271523', 'lastCheck': '0.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272357', 'lastCheck': '8.7', 'valid': True}} >Thread-287873::DEBUG::2014-01-16 17:18:16,233::task::579::TaskManager.Task::(_updateState) Task=`6980d38b-5cc8-4534-bf7c-6f2f34e54ff4`::moving from state preparing -> state finished >Thread-287873::DEBUG::2014-01-16 17:18:16,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287873::DEBUG::2014-01-16 17:18:16,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287873::DEBUG::2014-01-16 17:18:16,233::task::974::TaskManager.Task::(_decref) Task=`6980d38b-5cc8-4534-bf7c-6f2f34e54ff4`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:18:16,352::task::579::TaskManager.Task::(_updateState) Task=`39131d62-0fa2-409e-bb54-85b2937bda98`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:18:16,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:18:16,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:18:16,353::task::1168::TaskManager.Task::(prepare) Task=`39131d62-0fa2-409e-bb54-85b2937bda98`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:18:16,353::task::579::TaskManager.Task::(_updateState) Task=`39131d62-0fa2-409e-bb54-85b2937bda98`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:18:16,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:18:16,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:18:16,354::task::974::TaskManager.Task::(_decref) Task=`39131d62-0fa2-409e-bb54-85b2937bda98`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:16,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:18:17,538::task::579::TaskManager.Task::(_updateState) Task=`0ed3ae52-11a5-404c-92db-163f83152c6f`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:18:17,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:18:17,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:18:17,539::task::1168::TaskManager.Task::(prepare) Task=`0ed3ae52-11a5-404c-92db-163f83152c6f`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:18:17,539::task::579::TaskManager.Task::(_updateState) Task=`0ed3ae52-11a5-404c-92db-163f83152c6f`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:18:17,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:18:17,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:18:17,540::task::974::TaskManager.Task::(_decref) Task=`0ed3ae52-11a5-404c-92db-163f83152c6f`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:18:17,563::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:18:17,582::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000236188 s, 17.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:18:17,748::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:17,749::task::579::TaskManager.Task::(_updateState) Task=`0f14dc23-19ea-481a-ab1f-b59459c31ccb`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:18:17,750::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:18:17,750::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:18:17,750::task::1168::TaskManager.Task::(prepare) Task=`0f14dc23-19ea-481a-ab1f-b59459c31ccb`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:18:17,750::task::579::TaskManager.Task::(_updateState) Task=`0f14dc23-19ea-481a-ab1f-b59459c31ccb`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:18:17,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:18:17,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:18:17,751::task::974::TaskManager.Task::(_decref) Task=`0f14dc23-19ea-481a-ab1f-b59459c31ccb`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:17,753::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:18:17,753::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:18:17,754::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:17,756::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:17,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:17,789::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:18:17,791::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:18:18,393::task::579::TaskManager.Task::(_updateState) Task=`74a9dfee-652d-4c82-be2b-2e71e9efdb41`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:18:18,393::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:18:18,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:18:18,393::task::1168::TaskManager.Task::(prepare) Task=`74a9dfee-652d-4c82-be2b-2e71e9efdb41`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:18:18,394::task::579::TaskManager.Task::(_updateState) Task=`74a9dfee-652d-4c82-be2b-2e71e9efdb41`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:18:18,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:18:18,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:18:18,394::task::974::TaskManager.Task::(_decref) Task=`74a9dfee-652d-4c82-be2b-2e71e9efdb41`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:18:18,651::task::579::TaskManager.Task::(_updateState) Task=`32826eb1-1246-401b-9c09-610c45196064`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:18:18,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:18:18,652::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:18:18,652::task::1168::TaskManager.Task::(prepare) Task=`32826eb1-1246-401b-9c09-610c45196064`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:18:18,652::task::579::TaskManager.Task::(_updateState) Task=`32826eb1-1246-401b-9c09-610c45196064`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:18:18,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:18:18,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:18:18,652::task::974::TaskManager.Task::(_decref) Task=`32826eb1-1246-401b-9c09-610c45196064`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:18:18,652::task::579::TaskManager.Task::(_updateState) Task=`9a867020-1f2d-4609-ae1d-7384ed6e3925`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:18:18,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:18:18,653::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:18:18,653::task::1168::TaskManager.Task::(prepare) Task=`9a867020-1f2d-4609-ae1d-7384ed6e3925`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:18:18,653::task::579::TaskManager.Task::(_updateState) Task=`9a867020-1f2d-4609-ae1d-7384ed6e3925`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:18:18,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:18:18,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:18:18,654::task::974::TaskManager.Task::(_decref) Task=`9a867020-1f2d-4609-ae1d-7384ed6e3925`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:18,792::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:19,758::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287876::DEBUG::2014-01-16 17:18:19,777::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287876::DEBUG::2014-01-16 17:18:19,779::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.86', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.00', 'elapsedTime': '150', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:18:19,794::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:18:20,322::task::579::TaskManager.Task::(_updateState) Task=`fe09fb2e-6623-4e99-9632-878bee8e87bc`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:18:20,322::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:18:20,322::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:18:20,323::task::1168::TaskManager.Task::(prepare) Task=`fe09fb2e-6623-4e99-9632-878bee8e87bc`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:18:20,323::task::579::TaskManager.Task::(_updateState) Task=`fe09fb2e-6623-4e99-9632-878bee8e87bc`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:18:20,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:18:20,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:18:20,323::task::974::TaskManager.Task::(_decref) Task=`fe09fb2e-6623-4e99-9632-878bee8e87bc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:20,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:21,759::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:21,796::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:18:22,437::task::579::TaskManager.Task::(_updateState) Task=`7986a5a5-91dc-4f1b-98e2-3b940f37a211`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:18:22,437::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:18:22,437::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:18:22,438::task::1168::TaskManager.Task::(prepare) Task=`7986a5a5-91dc-4f1b-98e2-3b940f37a211`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:18:22,438::task::579::TaskManager.Task::(_updateState) Task=`7986a5a5-91dc-4f1b-98e2-3b940f37a211`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:18:22,438::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:18:22,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:18:22,438::task::974::TaskManager.Task::(_decref) Task=`7986a5a5-91dc-4f1b-98e2-3b940f37a211`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:22,761::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:22,797::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:18:22,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287878::DEBUG::2014-01-16 17:18:22,994::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287878::DEBUG::2014-01-16 17:18:22,995::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.06', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.22', 'elapsedTime': '154', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:18:23,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:23,798::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:18:23,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:24,800::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:18:25,361::task::579::TaskManager.Task::(_updateState) Task=`2908a31e-30a0-43de-b797-34894f9f2a5b`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:18:25,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:18:25,362::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:18:25,362::task::1168::TaskManager.Task::(prepare) Task=`2908a31e-30a0-43de-b797-34894f9f2a5b`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:18:25,362::task::579::TaskManager.Task::(_updateState) Task=`2908a31e-30a0-43de-b797-34894f9f2a5b`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:18:25,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:18:25,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:18:25,362::task::974::TaskManager.Task::(_decref) Task=`2908a31e-30a0-43de-b797-34894f9f2a5b`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:18:25,760::task::579::TaskManager.Task::(_updateState) Task=`3daf99f7-9572-458e-8be4-dd3f3f292ea2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:18:25,761::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:18:25,761::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:18:25,761::task::1168::TaskManager.Task::(prepare) Task=`3daf99f7-9572-458e-8be4-dd3f3f292ea2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:18:25,761::task::579::TaskManager.Task::(_updateState) Task=`3daf99f7-9572-458e-8be4-dd3f3f292ea2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:18:25,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:18:25,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:18:25,762::task::974::TaskManager.Task::(_decref) Task=`3daf99f7-9572-458e-8be4-dd3f3f292ea2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:18:25,762::task::579::TaskManager.Task::(_updateState) Task=`bab8f9b8-6c87-4c8a-9b1b-dae4461a35e5`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:18:25,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:18:25,762::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:18:25,763::task::1168::TaskManager.Task::(prepare) Task=`bab8f9b8-6c87-4c8a-9b1b-dae4461a35e5`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:18:25,763::task::579::TaskManager.Task::(_updateState) Task=`bab8f9b8-6c87-4c8a-9b1b-dae4461a35e5`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:18:25,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:18:25,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:18:25,763::task::974::TaskManager.Task::(_decref) Task=`bab8f9b8-6c87-4c8a-9b1b-dae4461a35e5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:25,763::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:18:25,764::task::579::TaskManager.Task::(_updateState) Task=`f14ebb98-9e84-4876-b8c1-2f6fc202b9c2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:18:25,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:18:25,764::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:18:25,764::task::1168::TaskManager.Task::(prepare) Task=`f14ebb98-9e84-4876-b8c1-2f6fc202b9c2`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:18:25,765::task::579::TaskManager.Task::(_updateState) Task=`f14ebb98-9e84-4876-b8c1-2f6fc202b9c2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:18:25,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:18:25,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:18:25,765::task::974::TaskManager.Task::(_decref) Task=`f14ebb98-9e84-4876-b8c1-2f6fc202b9c2`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:18:25,794::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:18:25,808::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:18:25,818::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000288737 s, 1.3 MB/s\n'; <rc> = 0 >Thread-287880::DEBUG::2014-01-16 17:18:26,146::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287880::DEBUG::2014-01-16 17:18:26,148::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.06', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.37', 'elapsedTime': '157', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:18:26,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:18:27,588::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:18:27,608::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000253982 s, 16.1 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 17:18:27,703::task::579::TaskManager.Task::(_updateState) Task=`027266f2-4300-41fd-9a5d-b29aea5d8279`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:18:27,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:18:27,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:18:27,705::task::1168::TaskManager.Task::(prepare) Task=`027266f2-4300-41fd-9a5d-b29aea5d8279`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:18:27,705::task::579::TaskManager.Task::(_updateState) Task=`027266f2-4300-41fd-9a5d-b29aea5d8279`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:18:27,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:18:27,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:18:27,705::task::974::TaskManager.Task::(_decref) Task=`027266f2-4300-41fd-9a5d-b29aea5d8279`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:27,765::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:27,767::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:27,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:28,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:18:28,815::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:18:28,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287882::DEBUG::2014-01-16 17:18:29,421::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287882::DEBUG::2014-01-16 17:18:29,423::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.06', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '160', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:18:29,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:29,816::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:18:29,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:30,818::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:18:30,818::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:18:30,818::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:31,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:31,819::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:18:31,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287883::DEBUG::2014-01-16 17:18:32,523::task::579::TaskManager.Task::(_updateState) Task=`4c076f03-5b4a-4b84-8ad3-04f0fb2e0b47`::moving from state init -> state preparing >Thread-287883::INFO::2014-01-16 17:18:32,523::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287883::INFO::2014-01-16 17:18:32,523::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288737', 'lastCheck': '6.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253982', 'lastCheck': '4.9', 'valid': True}} >Thread-287883::DEBUG::2014-01-16 17:18:32,523::task::1168::TaskManager.Task::(prepare) Task=`4c076f03-5b4a-4b84-8ad3-04f0fb2e0b47`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000288737', 'lastCheck': '6.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253982', 'lastCheck': '4.9', 'valid': True}} >Thread-287883::DEBUG::2014-01-16 17:18:32,523::task::579::TaskManager.Task::(_updateState) Task=`4c076f03-5b4a-4b84-8ad3-04f0fb2e0b47`::moving from state preparing -> state finished >Thread-287883::DEBUG::2014-01-16 17:18:32,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287883::DEBUG::2014-01-16 17:18:32,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287883::DEBUG::2014-01-16 17:18:32,524::task::974::TaskManager.Task::(_decref) Task=`4c076f03-5b4a-4b84-8ad3-04f0fb2e0b47`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:32,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:18:32,772::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:18:32,773::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:32,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:18:32,821::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:18:32,957::task::579::TaskManager.Task::(_updateState) Task=`3cca5259-2232-45e8-9b4d-8575604d3c07`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:18:32,957::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:18:32,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:18:32,958::task::1168::TaskManager.Task::(prepare) Task=`3cca5259-2232-45e8-9b4d-8575604d3c07`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:18:32,958::task::579::TaskManager.Task::(_updateState) Task=`3cca5259-2232-45e8-9b4d-8575604d3c07`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:18:32,958::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:18:32,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:18:32,959::task::974::TaskManager.Task::(_decref) Task=`3cca5259-2232-45e8-9b4d-8575604d3c07`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:33,774::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:33,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:34,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:18:34,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:35,776::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:35,824::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:18:35,825::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:18:35,826::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:18:35,852::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000455451 s, 801 kB/s\n'; <rc> = 0 >Thread-287886::DEBUG::2014-01-16 17:18:36,248::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287886::DEBUG::2014-01-16 17:18:36,250::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.06', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.47', 'elapsedTime': '167', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:18:36,826::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:18:36,827::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:18:36,827::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:18:36,827::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:18:36,971::task::579::TaskManager.Task::(_updateState) Task=`844b3267-9279-41e7-9ab0-c5251ec52ccb`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:18:36,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:18:36,972::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:18:36,972::task::1168::TaskManager.Task::(prepare) Task=`844b3267-9279-41e7-9ab0-c5251ec52ccb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-59295::DEBUG::2014-01-16 17:18:36,972::task::579::TaskManager.Task::(_updateState) Task=`1057a86d-ed99-4059-8406-08c7406def61`::moving from state init -> state preparing >Thread-3175::DEBUG::2014-01-16 17:18:36,973::task::579::TaskManager.Task::(_updateState) Task=`844b3267-9279-41e7-9ab0-c5251ec52ccb`::moving from state preparing -> state finished >Thread-59295::INFO::2014-01-16 17:18:36,973::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-3175::DEBUG::2014-01-16 17:18:36,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:18:36,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::INFO::2014-01-16 17:18:36,973::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-3175::DEBUG::2014-01-16 17:18:36,974::task::974::TaskManager.Task::(_decref) Task=`844b3267-9279-41e7-9ab0-c5251ec52ccb`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:18:36,974::task::1168::TaskManager.Task::(prepare) Task=`1057a86d-ed99-4059-8406-08c7406def61`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:18:36,974::task::579::TaskManager.Task::(_updateState) Task=`1057a86d-ed99-4059-8406-08c7406def61`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:18:36,974::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:18:36,974::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:18:36,974::task::974::TaskManager.Task::(_decref) Task=`1057a86d-ed99-4059-8406-08c7406def61`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:18:37,614::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:18:37,631::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000229236 s, 17.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:18:37,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:37,779::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:37,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:18:37,828::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:18:37,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:38,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:18:38,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287888::DEBUG::2014-01-16 17:18:39,382::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287888::DEBUG::2014-01-16 17:18:39,383::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.47', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.60', 'elapsedTime': '170', 'vmType': 'kvm', 'cpuSys': '1.20', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:18:39,780::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:39,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:18:39,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:18:39,831::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:18:39,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:18:40,579::task::579::TaskManager.Task::(_updateState) Task=`dd23f39e-8747-4a30-bee3-2ff2ca43c203`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:18:40,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:18:40,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:18:40,580::task::1168::TaskManager.Task::(prepare) Task=`dd23f39e-8747-4a30-bee3-2ff2ca43c203`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:18:40,581::task::579::TaskManager.Task::(_updateState) Task=`dd23f39e-8747-4a30-bee3-2ff2ca43c203`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:18:40,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:18:40,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:18:40,581::task::974::TaskManager.Task::(_decref) Task=`dd23f39e-8747-4a30-bee3-2ff2ca43c203`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:18:40,581::task::579::TaskManager.Task::(_updateState) Task=`8caaa75a-d829-4113-aeee-e180cab60f36`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:18:40,581::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:18:40,582::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:18:40,582::task::1168::TaskManager.Task::(prepare) Task=`8caaa75a-d829-4113-aeee-e180cab60f36`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:18:40,582::task::579::TaskManager.Task::(_updateState) Task=`8caaa75a-d829-4113-aeee-e180cab60f36`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:18:40,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:18:40,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:18:40,582::task::974::TaskManager.Task::(_decref) Task=`8caaa75a-d829-4113-aeee-e180cab60f36`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:40,832::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:41,781::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:41,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:18:41,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:18:41,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:18:41,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:41,835::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:18:41,835::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-287890::DEBUG::2014-01-16 17:18:42,483::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287890::DEBUG::2014-01-16 17:18:42,485::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.47', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.70', 'elapsedTime': '173', 'vmType': 'kvm', 'cpuSys': '1.20', 'appsList': [], 'guestIPs': ''}]} >Thread-251420::DEBUG::2014-01-16 17:18:42,489::task::579::TaskManager.Task::(_updateState) Task=`457f158a-706a-4afb-bbd8-049de796b1ad`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:18:42,489::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:18:42,489::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:18:42,489::task::1168::TaskManager.Task::(prepare) Task=`457f158a-706a-4afb-bbd8-049de796b1ad`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:18:42,490::task::579::TaskManager.Task::(_updateState) Task=`457f158a-706a-4afb-bbd8-049de796b1ad`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:18:42,490::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:18:42,490::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:18:42,490::task::974::TaskManager.Task::(_decref) Task=`457f158a-706a-4afb-bbd8-049de796b1ad`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:42,783::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:42,835::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:43,784::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:43,836::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:18:43,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:18:43,837::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:18:44,313::task::579::TaskManager.Task::(_updateState) Task=`478a3430-b1fb-45cf-a045-0f28ecfedbe2`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:18:44,313::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:18:44,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:18:44,314::task::1168::TaskManager.Task::(prepare) Task=`478a3430-b1fb-45cf-a045-0f28ecfedbe2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:18:44,314::task::579::TaskManager.Task::(_updateState) Task=`478a3430-b1fb-45cf-a045-0f28ecfedbe2`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:18:44,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:18:44,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:18:44,314::task::974::TaskManager.Task::(_decref) Task=`478a3430-b1fb-45cf-a045-0f28ecfedbe2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:44,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:18:44,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:18:44,837::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287892::DEBUG::2014-01-16 17:18:45,583::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-16398::DEBUG::2014-01-16 17:18:45,585::task::579::TaskManager.Task::(_updateState) Task=`643e09c4-1295-43fd-9395-fc6d28e856f4`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:18:45,585::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-287892::DEBUG::2014-01-16 17:18:45,585::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.47', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.80', 'elapsedTime': '176', 'vmType': 'kvm', 'cpuSys': '1.20', 'appsList': [], 'guestIPs': ''}]} >Thread-16398::INFO::2014-01-16 17:18:45,586::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:18:45,586::task::1168::TaskManager.Task::(prepare) Task=`643e09c4-1295-43fd-9395-fc6d28e856f4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:18:45,587::task::579::TaskManager.Task::(_updateState) Task=`643e09c4-1295-43fd-9395-fc6d28e856f4`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:18:45,587::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:18:45,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:18:45,587::task::974::TaskManager.Task::(_decref) Task=`643e09c4-1295-43fd-9395-fc6d28e856f4`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:18:45,592::task::579::TaskManager.Task::(_updateState) Task=`be4dde21-2f93-4f28-9365-8a86a27770a5`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:18:45,593::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:18:45,593::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:18:45,593::task::1168::TaskManager.Task::(prepare) Task=`be4dde21-2f93-4f28-9365-8a86a27770a5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:18:45,593::task::579::TaskManager.Task::(_updateState) Task=`be4dde21-2f93-4f28-9365-8a86a27770a5`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:18:45,593::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:18:45,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:18:45,594::task::974::TaskManager.Task::(_decref) Task=`be4dde21-2f93-4f28-9365-8a86a27770a5`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:18:45,599::task::579::TaskManager.Task::(_updateState) Task=`d7af239e-2f7f-4aca-8b3a-81d33366562e`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:18:45,599::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:18:45,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:18:45,599::task::1168::TaskManager.Task::(prepare) Task=`d7af239e-2f7f-4aca-8b3a-81d33366562e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:18:45,600::task::579::TaskManager.Task::(_updateState) Task=`d7af239e-2f7f-4aca-8b3a-81d33366562e`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:18:45,600::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:18:45,600::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:18:45,600::task::974::TaskManager.Task::(_decref) Task=`d7af239e-2f7f-4aca-8b3a-81d33366562e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:45,785::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:45,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:18:45,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:18:45,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:18:45,839::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:18:45,859::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:18:45,882::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258161 s, 1.4 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:18:46,438::task::579::TaskManager.Task::(_updateState) Task=`3bf60f0c-570c-41b8-aa7f-1e47fce46585`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:18:46,439::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:18:46,439::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:18:46,439::task::1168::TaskManager.Task::(prepare) Task=`3bf60f0c-570c-41b8-aa7f-1e47fce46585`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:18:46,440::task::579::TaskManager.Task::(_updateState) Task=`3bf60f0c-570c-41b8-aa7f-1e47fce46585`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:18:46,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:18:46,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:18:46,440::task::974::TaskManager.Task::(_decref) Task=`3bf60f0c-570c-41b8-aa7f-1e47fce46585`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:18:46,442::task::579::TaskManager.Task::(_updateState) Task=`ff567759-ad10-4247-b6db-f0ac45fa0212`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:18:46,442::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:18:46,442::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:18:46,443::task::1168::TaskManager.Task::(prepare) Task=`ff567759-ad10-4247-b6db-f0ac45fa0212`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:18:46,443::task::579::TaskManager.Task::(_updateState) Task=`ff567759-ad10-4247-b6db-f0ac45fa0212`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:18:46,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:18:46,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:18:46,443::task::974::TaskManager.Task::(_decref) Task=`ff567759-ad10-4247-b6db-f0ac45fa0212`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:46,840::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:18:47,638::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:18:47,659::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000273358 s, 15.0 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:18:47,787::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:47,789::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:18:47,789::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:18:47,790::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:47,841::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:18:47,842::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287893::DEBUG::2014-01-16 17:18:48,643::task::579::TaskManager.Task::(_updateState) Task=`bde401b9-de51-4103-814d-94ceff1303ee`::moving from state init -> state preparing >Thread-287893::INFO::2014-01-16 17:18:48,643::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287893::INFO::2014-01-16 17:18:48,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258161', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273358', 'lastCheck': '1.0', 'valid': True}} >Thread-287893::DEBUG::2014-01-16 17:18:48,644::task::1168::TaskManager.Task::(prepare) Task=`bde401b9-de51-4103-814d-94ceff1303ee`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258161', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273358', 'lastCheck': '1.0', 'valid': True}} >Thread-287893::DEBUG::2014-01-16 17:18:48,644::task::579::TaskManager.Task::(_updateState) Task=`bde401b9-de51-4103-814d-94ceff1303ee`::moving from state preparing -> state finished >Thread-287893::DEBUG::2014-01-16 17:18:48,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287893::DEBUG::2014-01-16 17:18:48,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287893::DEBUG::2014-01-16 17:18:48,645::task::974::TaskManager.Task::(_decref) Task=`bde401b9-de51-4103-814d-94ceff1303ee`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:48,843::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:49,792::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:49,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:50,846::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:18:51,788::task::579::TaskManager.Task::(_updateState) Task=`1baaa26f-8c1c-43b8-8116-3c3f6474337d`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:18:51,789::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:18:51,789::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:18:51,789::task::1168::TaskManager.Task::(prepare) Task=`1baaa26f-8c1c-43b8-8116-3c3f6474337d`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:18:51,789::task::579::TaskManager.Task::(_updateState) Task=`1baaa26f-8c1c-43b8-8116-3c3f6474337d`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:18:51,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:18:51,789::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:18:51,790::task::974::TaskManager.Task::(_decref) Task=`1baaa26f-8c1c-43b8-8116-3c3f6474337d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:51,793::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:51,847::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287896::DEBUG::2014-01-16 17:18:52,187::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287896::DEBUG::2014-01-16 17:18:52,188::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'elapsedTime': '183', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:18:52,794::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:52,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:18:52,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:18:53,618::task::579::TaskManager.Task::(_updateState) Task=`a7240d28-d20c-4ec9-ab50-21727212e130`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:18:53,619::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:18:53,619::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:18:53,619::task::1168::TaskManager.Task::(prepare) Task=`a7240d28-d20c-4ec9-ab50-21727212e130`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:18:53,619::task::579::TaskManager.Task::(_updateState) Task=`a7240d28-d20c-4ec9-ab50-21727212e130`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:18:53,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:18:53,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:18:53,620::task::974::TaskManager.Task::(_decref) Task=`a7240d28-d20c-4ec9-ab50-21727212e130`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:18:53,689::task::579::TaskManager.Task::(_updateState) Task=`a42687c0-8faa-433d-91b5-53f438ad4b22`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:18:53,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:18:53,690::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:18:53,690::task::1168::TaskManager.Task::(prepare) Task=`a42687c0-8faa-433d-91b5-53f438ad4b22`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:18:53,690::task::579::TaskManager.Task::(_updateState) Task=`a42687c0-8faa-433d-91b5-53f438ad4b22`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:18:53,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:18:53,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:18:53,691::task::974::TaskManager.Task::(_decref) Task=`a42687c0-8faa-433d-91b5-53f438ad4b22`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:18:53,691::task::579::TaskManager.Task::(_updateState) Task=`5684c4fd-de83-409e-8676-24dd9e42263a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:18:53,691::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:18:53,691::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:18:53,691::task::1168::TaskManager.Task::(prepare) Task=`5684c4fd-de83-409e-8676-24dd9e42263a`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:18:53,691::task::579::TaskManager.Task::(_updateState) Task=`5684c4fd-de83-409e-8676-24dd9e42263a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:18:53,692::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:18:53,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:18:53,692::task::974::TaskManager.Task::(_decref) Task=`5684c4fd-de83-409e-8676-24dd9e42263a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:18:53,692::task::579::TaskManager.Task::(_updateState) Task=`1b72c92b-3be6-47ba-946c-5c5ee98efc41`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:18:53,693::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:18:53,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:18:53,693::task::1168::TaskManager.Task::(prepare) Task=`1b72c92b-3be6-47ba-946c-5c5ee98efc41`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:18:53,693::task::579::TaskManager.Task::(_updateState) Task=`1b72c92b-3be6-47ba-946c-5c5ee98efc41`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:18:53,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:18:53,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:18:53,693::task::974::TaskManager.Task::(_decref) Task=`1b72c92b-3be6-47ba-946c-5c5ee98efc41`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:18:53,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:53,849::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:18:53,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:18:54,850::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287898::DEBUG::2014-01-16 17:18:55,288::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287898::DEBUG::2014-01-16 17:18:55,289::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.44', 'elapsedTime': '186', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:18:55,798::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:55,852::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:18:55,890::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:18:55,913::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000367536 s, 993 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:18:56,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:18:57,665::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:18:57,684::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000236495 s, 17.3 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:18:57,799::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:18:57,801::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:57,854::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287900::DEBUG::2014-01-16 17:18:58,388::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287900::DEBUG::2014-01-16 17:18:58,390::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.54', 'elapsedTime': '189', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-221160::DEBUG::2014-01-16 17:18:58,806::task::579::TaskManager.Task::(_updateState) Task=`6882c566-1766-4d7a-95c0-6207940bac06`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:18:58,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:18:58,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:18:58,806::task::1168::TaskManager.Task::(prepare) Task=`6882c566-1766-4d7a-95c0-6207940bac06`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:18:58,807::task::579::TaskManager.Task::(_updateState) Task=`6882c566-1766-4d7a-95c0-6207940bac06`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:18:58,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:18:58,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:18:58,807::task::974::TaskManager.Task::(_decref) Task=`6882c566-1766-4d7a-95c0-6207940bac06`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:18:58,855::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:18:58,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:18:58,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:18:59,802::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:18:59,857::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:18:59,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:00,859::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:19:00,859::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:19:00,859::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287902::DEBUG::2014-01-16 17:19:01,490::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287902::DEBUG::2014-01-16 17:19:01,492::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '192', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:19:01,804::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:01,861::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:19:01,861::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:02,807::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:19:02,807::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:19:02,808::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:02,862::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:19:02,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:03,809::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:03,863::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287903::DEBUG::2014-01-16 17:19:04,551::task::579::TaskManager.Task::(_updateState) Task=`f517b043-e7ff-447c-b5b6-52bfbc553914`::moving from state init -> state preparing >Thread-287903::INFO::2014-01-16 17:19:04,552::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287903::INFO::2014-01-16 17:19:04,552::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000367536', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000236495', 'lastCheck': '6.9', 'valid': True}} >Thread-287903::DEBUG::2014-01-16 17:19:04,552::task::1168::TaskManager.Task::(prepare) Task=`f517b043-e7ff-447c-b5b6-52bfbc553914`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000367536', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000236495', 'lastCheck': '6.9', 'valid': True}} >Thread-287903::DEBUG::2014-01-16 17:19:04,552::task::579::TaskManager.Task::(_updateState) Task=`f517b043-e7ff-447c-b5b6-52bfbc553914`::moving from state preparing -> state finished >Thread-287903::DEBUG::2014-01-16 17:19:04,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287903::DEBUG::2014-01-16 17:19:04,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287903::DEBUG::2014-01-16 17:19:04,553::task::974::TaskManager.Task::(_decref) Task=`f517b043-e7ff-447c-b5b6-52bfbc553914`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:04,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:19:04,865::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:19:05,644::task::579::TaskManager.Task::(_updateState) Task=`5aad9e76-4419-4d67-8752-b76861f969e6`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:19:05,645::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:19:05,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:19:05,645::task::1168::TaskManager.Task::(prepare) Task=`5aad9e76-4419-4d67-8752-b76861f969e6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:19:05,645::task::579::TaskManager.Task::(_updateState) Task=`5aad9e76-4419-4d67-8752-b76861f969e6`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:19:05,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:19:05,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:19:05,646::task::974::TaskManager.Task::(_decref) Task=`5aad9e76-4419-4d67-8752-b76861f969e6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:05,810::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:05,866::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:19:05,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:19:05,922::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:19:05,946::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000305153 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:19:06,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:19:06,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:19:06,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:19:06,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:19:07,692::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:19:07,714::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000216459 s, 18.9 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:19:07,812::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:07,813::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:07,869::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:19:07,869::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:19:07,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287906::DEBUG::2014-01-16 17:19:08,175::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287906::DEBUG::2014-01-16 17:19:08,177::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.32', 'elapsedTime': '199', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-53040::DEBUG::2014-01-16 17:19:08,796::task::579::TaskManager.Task::(_updateState) Task=`38566528-d6eb-4f98-bef1-96acd822658c`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:19:08,796::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:19:08,797::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:19:08,798::task::1168::TaskManager.Task::(prepare) Task=`38566528-d6eb-4f98-bef1-96acd822658c`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:19:08,798::task::579::TaskManager.Task::(_updateState) Task=`38566528-d6eb-4f98-bef1-96acd822658c`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:19:08,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:19:08,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:19:08,798::task::974::TaskManager.Task::(_decref) Task=`38566528-d6eb-4f98-bef1-96acd822658c`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:19:08,805::task::579::TaskManager.Task::(_updateState) Task=`355cbeec-068c-4f27-9a0c-17ccb8fc3f0f`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:19:08,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:19:08,806::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:19:08,806::task::1168::TaskManager.Task::(prepare) Task=`355cbeec-068c-4f27-9a0c-17ccb8fc3f0f`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:19:08,807::task::579::TaskManager.Task::(_updateState) Task=`355cbeec-068c-4f27-9a0c-17ccb8fc3f0f`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:19:08,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:19:08,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:19:08,807::task::974::TaskManager.Task::(_decref) Task=`355cbeec-068c-4f27-9a0c-17ccb8fc3f0f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:08,871::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:19:08,871::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:09,814::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:09,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:19:09,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:19:09,873::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:19:09,873::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:19:10,862::task::579::TaskManager.Task::(_updateState) Task=`c934a0ac-04cc-481e-827a-2fb4a2a7f38b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:19:10,862::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:19:10,862::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:19:10,863::task::1168::TaskManager.Task::(prepare) Task=`c934a0ac-04cc-481e-827a-2fb4a2a7f38b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:19:10,863::task::579::TaskManager.Task::(_updateState) Task=`c934a0ac-04cc-481e-827a-2fb4a2a7f38b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:19:10,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:19:10,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:19:10,863::task::974::TaskManager.Task::(_decref) Task=`c934a0ac-04cc-481e-827a-2fb4a2a7f38b`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:19:10,863::task::579::TaskManager.Task::(_updateState) Task=`a45345bb-c731-4cf3-befc-eb1d477851e9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:19:10,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:19:10,864::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:19:10,864::task::1168::TaskManager.Task::(prepare) Task=`a45345bb-c731-4cf3-befc-eb1d477851e9`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:19:10,864::task::579::TaskManager.Task::(_updateState) Task=`a45345bb-c731-4cf3-befc-eb1d477851e9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:19:10,864::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:19:10,864::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:19:10,864::task::974::TaskManager.Task::(_decref) Task=`a45345bb-c731-4cf3-befc-eb1d477851e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:10,874::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287908::DEBUG::2014-01-16 17:19:11,274::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287908::DEBUG::2014-01-16 17:19:11,275::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.42', 'elapsedTime': '202', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:19:11,816::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:11,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:19:11,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:19:11,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:19:11,875::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:11,875::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:19:11,876::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-131629::DEBUG::2014-01-16 17:19:12,585::task::579::TaskManager.Task::(_updateState) Task=`69fb06c1-f0dd-4a81-bc0f-e0b7b1c524d6`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:19:12,585::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:19:12,586::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:19:12,586::task::1168::TaskManager.Task::(prepare) Task=`69fb06c1-f0dd-4a81-bc0f-e0b7b1c524d6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:19:12,586::task::579::TaskManager.Task::(_updateState) Task=`69fb06c1-f0dd-4a81-bc0f-e0b7b1c524d6`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:19:12,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:19:12,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:19:12,586::task::974::TaskManager.Task::(_decref) Task=`69fb06c1-f0dd-4a81-bc0f-e0b7b1c524d6`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:12,817::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:12,877::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:19:12,896::task::579::TaskManager.Task::(_updateState) Task=`b1e5df08-e9a8-46ab-aaa6-d6e617d28caf`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:19:12,896::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:19:12,897::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:19:12,897::task::1168::TaskManager.Task::(prepare) Task=`b1e5df08-e9a8-46ab-aaa6-d6e617d28caf`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:19:12,897::task::579::TaskManager.Task::(_updateState) Task=`b1e5df08-e9a8-46ab-aaa6-d6e617d28caf`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:19:12,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:19:12,897::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:19:12,898::task::974::TaskManager.Task::(_decref) Task=`b1e5df08-e9a8-46ab-aaa6-d6e617d28caf`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:19:12,898::task::579::TaskManager.Task::(_updateState) Task=`caca97d0-14fd-4d3a-b6ec-6bbcb8e46f68`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:19:12,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:19:12,898::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:19:12,898::task::1168::TaskManager.Task::(prepare) Task=`caca97d0-14fd-4d3a-b6ec-6bbcb8e46f68`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:19:12,898::task::579::TaskManager.Task::(_updateState) Task=`caca97d0-14fd-4d3a-b6ec-6bbcb8e46f68`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:19:12,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:19:12,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:19:12,899::task::974::TaskManager.Task::(_decref) Task=`caca97d0-14fd-4d3a-b6ec-6bbcb8e46f68`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:13,819::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:13,877::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:19:13,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:19:13,878::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287910::DEBUG::2014-01-16 17:19:14,378::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287910::DEBUG::2014-01-16 17:19:14,379::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.53', 'elapsedTime': '205', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:19:14,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:19:14,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:19:14,879::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:15,820::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:15,881::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:19:15,881::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:19:15,881::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:19:15,881::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:19:15,956::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:19:15,980::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00031164 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:19:16,275::task::579::TaskManager.Task::(_updateState) Task=`035e00ee-a066-46a8-806b-7819d6fc1900`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:19:16,276::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:19:16,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:19:16,277::task::1168::TaskManager.Task::(prepare) Task=`035e00ee-a066-46a8-806b-7819d6fc1900`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:19:16,277::task::579::TaskManager.Task::(_updateState) Task=`035e00ee-a066-46a8-806b-7819d6fc1900`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:19:16,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:19:16,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:19:16,277::task::974::TaskManager.Task::(_decref) Task=`035e00ee-a066-46a8-806b-7819d6fc1900`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:19:16,524::task::579::TaskManager.Task::(_updateState) Task=`c685a72c-34a1-4b5e-a638-7e0aa797a95e`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:19:16,525::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:19:16,525::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:19:16,525::task::1168::TaskManager.Task::(prepare) Task=`c685a72c-34a1-4b5e-a638-7e0aa797a95e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:19:16,525::task::579::TaskManager.Task::(_updateState) Task=`c685a72c-34a1-4b5e-a638-7e0aa797a95e`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:19:16,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:19:16,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:19:16,526::task::974::TaskManager.Task::(_decref) Task=`c685a72c-34a1-4b5e-a638-7e0aa797a95e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:16,883::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287912::DEBUG::2014-01-16 17:19:17,483::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287912::DEBUG::2014-01-16 17:19:17,485::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.63', 'elapsedTime': '208', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:19:17,721::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:19:17,738::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000261737 s, 15.6 MB/s\n'; <rc> = 0 >Thread-184546::DEBUG::2014-01-16 17:19:17,745::task::579::TaskManager.Task::(_updateState) Task=`a3c8bfa3-4312-4885-a4a8-bc52dc01126b`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:19:17,746::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:19:17,746::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:19:17,747::task::1168::TaskManager.Task::(prepare) Task=`a3c8bfa3-4312-4885-a4a8-bc52dc01126b`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:19:17,747::task::579::TaskManager.Task::(_updateState) Task=`a3c8bfa3-4312-4885-a4a8-bc52dc01126b`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:19:17,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:19:17,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:19:17,748::task::974::TaskManager.Task::(_decref) Task=`a3c8bfa3-4312-4885-a4a8-bc52dc01126b`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:17,822::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:17,822::task::579::TaskManager.Task::(_updateState) Task=`12d8fab7-5039-4229-8e92-0128086c5a9d`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:19:17,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:19:17,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:19:17,823::task::1168::TaskManager.Task::(prepare) Task=`12d8fab7-5039-4229-8e92-0128086c5a9d`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:19:17,823::task::579::TaskManager.Task::(_updateState) Task=`12d8fab7-5039-4229-8e92-0128086c5a9d`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:19:17,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:19:17,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:19:17,824::task::974::TaskManager.Task::(_decref) Task=`12d8fab7-5039-4229-8e92-0128086c5a9d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:17,825::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:19:17,826::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:19:17,827::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:17,829::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:17,829::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:17,884::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:19:17,885::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:19:18,575::task::579::TaskManager.Task::(_updateState) Task=`1df3dca9-4312-499c-8cc2-d9eafcabe8f2`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:19:18,575::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:19:18,575::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:19:18,576::task::1168::TaskManager.Task::(prepare) Task=`1df3dca9-4312-499c-8cc2-d9eafcabe8f2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:19:18,576::task::579::TaskManager.Task::(_updateState) Task=`1df3dca9-4312-499c-8cc2-d9eafcabe8f2`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:19:18,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:19:18,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:19:18,576::task::974::TaskManager.Task::(_decref) Task=`1df3dca9-4312-499c-8cc2-d9eafcabe8f2`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:19:18,877::task::579::TaskManager.Task::(_updateState) Task=`b905b80e-b2f8-47b3-8cb3-843d516a79d0`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:19:18,877::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:19:18,877::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:19:18,877::task::1168::TaskManager.Task::(prepare) Task=`b905b80e-b2f8-47b3-8cb3-843d516a79d0`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:19:18,878::task::579::TaskManager.Task::(_updateState) Task=`b905b80e-b2f8-47b3-8cb3-843d516a79d0`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:19:18,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:19:18,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:19:18,878::task::974::TaskManager.Task::(_decref) Task=`b905b80e-b2f8-47b3-8cb3-843d516a79d0`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:19:18,878::task::579::TaskManager.Task::(_updateState) Task=`02b1ef49-1dad-4670-99e4-dc28b60c968e`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:19:18,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:19:18,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:19:18,879::task::1168::TaskManager.Task::(prepare) Task=`02b1ef49-1dad-4670-99e4-dc28b60c968e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:19:18,879::task::579::TaskManager.Task::(_updateState) Task=`02b1ef49-1dad-4670-99e4-dc28b60c968e`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:19:18,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:19:18,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:19:18,879::task::974::TaskManager.Task::(_decref) Task=`02b1ef49-1dad-4670-99e4-dc28b60c968e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:18,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:19,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:19,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131569::DEBUG::2014-01-16 17:19:20,411::task::579::TaskManager.Task::(_updateState) Task=`87db3457-d155-497a-8ceb-b63462038b46`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:19:20,412::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:19:20,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:19:20,412::task::1168::TaskManager.Task::(prepare) Task=`87db3457-d155-497a-8ceb-b63462038b46`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:19:20,412::task::579::TaskManager.Task::(_updateState) Task=`87db3457-d155-497a-8ceb-b63462038b46`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:19:20,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:19:20,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:19:20,413::task::974::TaskManager.Task::(_decref) Task=`87db3457-d155-497a-8ceb-b63462038b46`::ref 0 aborting False >Thread-287913::DEBUG::2014-01-16 17:19:20,547::task::579::TaskManager.Task::(_updateState) Task=`d06ced46-7377-4c9c-814a-f40980ff729f`::moving from state init -> state preparing >Thread-287913::INFO::2014-01-16 17:19:20,554::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287913::INFO::2014-01-16 17:19:20,554::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031164', 'lastCheck': '4.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261737', 'lastCheck': '2.8', 'valid': True}} >Thread-287913::DEBUG::2014-01-16 17:19:20,555::task::1168::TaskManager.Task::(prepare) Task=`d06ced46-7377-4c9c-814a-f40980ff729f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00031164', 'lastCheck': '4.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261737', 'lastCheck': '2.8', 'valid': True}} >Thread-287913::DEBUG::2014-01-16 17:19:20,555::task::579::TaskManager.Task::(_updateState) Task=`d06ced46-7377-4c9c-814a-f40980ff729f`::moving from state preparing -> state finished >Thread-287913::DEBUG::2014-01-16 17:19:20,555::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287913::DEBUG::2014-01-16 17:19:20,555::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287913::DEBUG::2014-01-16 17:19:20,556::task::974::TaskManager.Task::(_decref) Task=`d06ced46-7377-4c9c-814a-f40980ff729f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:20,888::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:21,832::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:21,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:19:22,634::task::579::TaskManager.Task::(_updateState) Task=`7c025dad-eba4-4a5b-a6c6-f828db179aa0`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:19:22,635::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:19:22,636::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:19:22,636::task::1168::TaskManager.Task::(prepare) Task=`7c025dad-eba4-4a5b-a6c6-f828db179aa0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:19:22,637::task::579::TaskManager.Task::(_updateState) Task=`7c025dad-eba4-4a5b-a6c6-f828db179aa0`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:19:22,637::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:19:22,637::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:19:22,637::task::974::TaskManager.Task::(_decref) Task=`7c025dad-eba4-4a5b-a6c6-f828db179aa0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:22,833::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:22,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:19:22,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:23,835::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:23,892::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:19:23,892::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287916::DEBUG::2014-01-16 17:19:24,130::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287916::DEBUG::2014-01-16 17:19:24,132::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.27', 'elapsedTime': '215', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:19:24,893::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:19:25,536::task::579::TaskManager.Task::(_updateState) Task=`3515b9aa-5b86-4bed-a952-45ec5cb1f321`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:19:25,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:19:25,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:19:25,536::task::1168::TaskManager.Task::(prepare) Task=`3515b9aa-5b86-4bed-a952-45ec5cb1f321`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:19:25,537::task::579::TaskManager.Task::(_updateState) Task=`3515b9aa-5b86-4bed-a952-45ec5cb1f321`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:19:25,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:19:25,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:19:25,537::task::974::TaskManager.Task::(_decref) Task=`3515b9aa-5b86-4bed-a952-45ec5cb1f321`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:25,836::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:25,894::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:19:25,989::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:19:26,013::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000259728 s, 1.4 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 17:19:26,374::task::579::TaskManager.Task::(_updateState) Task=`7b8de5fa-304f-4c93-83f6-bf987d1653f2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:19:26,374::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:19:26,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:19:26,375::task::1168::TaskManager.Task::(prepare) Task=`7b8de5fa-304f-4c93-83f6-bf987d1653f2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:19:26,375::task::579::TaskManager.Task::(_updateState) Task=`7b8de5fa-304f-4c93-83f6-bf987d1653f2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:19:26,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:19:26,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:19:26,376::task::974::TaskManager.Task::(_decref) Task=`7b8de5fa-304f-4c93-83f6-bf987d1653f2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:19:26,376::task::579::TaskManager.Task::(_updateState) Task=`172d080d-03b4-47f1-97ec-c70cf28d3595`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:19:26,376::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:19:26,376::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:19:26,377::task::1168::TaskManager.Task::(prepare) Task=`172d080d-03b4-47f1-97ec-c70cf28d3595`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:19:26,377::task::579::TaskManager.Task::(_updateState) Task=`172d080d-03b4-47f1-97ec-c70cf28d3595`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:19:26,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:19:26,377::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:19:26,377::task::974::TaskManager.Task::(_decref) Task=`172d080d-03b4-47f1-97ec-c70cf28d3595`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:19:26,378::task::579::TaskManager.Task::(_updateState) Task=`cca3c2ef-6583-4caf-b0f1-4c2570732a34`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:19:26,378::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:19:26,378::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:19:26,378::task::1168::TaskManager.Task::(prepare) Task=`cca3c2ef-6583-4caf-b0f1-4c2570732a34`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:19:26,378::task::579::TaskManager.Task::(_updateState) Task=`cca3c2ef-6583-4caf-b0f1-4c2570732a34`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:19:26,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:19:26,379::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:19:26,379::task::974::TaskManager.Task::(_decref) Task=`cca3c2ef-6583-4caf-b0f1-4c2570732a34`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:26,896::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287918::DEBUG::2014-01-16 17:19:27,251::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287918::DEBUG::2014-01-16 17:19:27,253::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'elapsedTime': '218', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:19:27,748::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:19:27,765::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000293385 s, 14.0 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 17:19:27,770::task::579::TaskManager.Task::(_updateState) Task=`2707b885-cf41-4c1b-a5f0-ce86fd851fbf`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:19:27,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:19:27,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:19:27,773::task::1168::TaskManager.Task::(prepare) Task=`2707b885-cf41-4c1b-a5f0-ce86fd851fbf`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:19:27,774::task::579::TaskManager.Task::(_updateState) Task=`2707b885-cf41-4c1b-a5f0-ce86fd851fbf`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:19:27,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:19:27,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:19:27,774::task::974::TaskManager.Task::(_decref) Task=`2707b885-cf41-4c1b-a5f0-ce86fd851fbf`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:27,837::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:27,838::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:27,897::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:28,899::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:19:28,900::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:19:28,900::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:29,839::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:29,902::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:19:29,902::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287920::DEBUG::2014-01-16 17:19:30,352::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287920::DEBUG::2014-01-16 17:19:30,353::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.49', 'elapsedTime': '221', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:19:30,904::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:19:30,904::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:19:30,904::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:31,840::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:31,905::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:19:31,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287921::DEBUG::2014-01-16 17:19:32,215::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmSetTicket with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', 'S0NHkkh7TOVA', '120', 'disconnect', {'userName': 'rhevadmin', 'userId': '88011004-16db-11e2-9b90-001a4a0cff04'}) {} flowID [3c92ca6d] >Thread-287921::DEBUG::2014-01-16 17:19:32,229::BindingXMLRPC::991::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-189817::DEBUG::2014-01-16 17:19:32,842::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:19:32,843::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:19:32,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:32,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:19:32,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:19:33,140::task::579::TaskManager.Task::(_updateState) Task=`2d60023f-1ee8-44dd-bc63-aab5b647fe8c`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:19:33,140::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:19:33,140::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:19:33,140::task::1168::TaskManager.Task::(prepare) Task=`2d60023f-1ee8-44dd-bc63-aab5b647fe8c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:19:33,141::task::579::TaskManager.Task::(_updateState) Task=`2d60023f-1ee8-44dd-bc63-aab5b647fe8c`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:19:33,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:19:33,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:19:33,141::task::974::TaskManager.Task::(_decref) Task=`2d60023f-1ee8-44dd-bc63-aab5b647fe8c`::ref 0 aborting False >Thread-287923::DEBUG::2014-01-16 17:19:33,450::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287923::DEBUG::2014-01-16 17:19:33,452::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.59', 'elapsedTime': '224', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:19:33,845::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:33,909::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:34,909::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:19:34,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,368::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,406::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,412::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,427::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,452::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,452::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,500::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:35,501::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >Thread-189817::DEBUG::2014-01-16 17:19:35,847::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:35,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:19:35,911::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:19:36,023::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:19:36,047::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264241 s, 1.4 MB/s\n'; <rc> = 0 >Thread-287924::DEBUG::2014-01-16 17:19:36,511::task::579::TaskManager.Task::(_updateState) Task=`e56004b7-4350-4098-a1ce-dbc5748f22b5`::moving from state init -> state preparing >Thread-287924::INFO::2014-01-16 17:19:36,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287924::INFO::2014-01-16 17:19:36,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264241', 'lastCheck': '0.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293385', 'lastCheck': '8.7', 'valid': True}} >Thread-287924::DEBUG::2014-01-16 17:19:36,512::task::1168::TaskManager.Task::(prepare) Task=`e56004b7-4350-4098-a1ce-dbc5748f22b5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264241', 'lastCheck': '0.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293385', 'lastCheck': '8.7', 'valid': True}} >Thread-287924::DEBUG::2014-01-16 17:19:36,512::task::579::TaskManager.Task::(_updateState) Task=`e56004b7-4350-4098-a1ce-dbc5748f22b5`::moving from state preparing -> state finished >Thread-287924::DEBUG::2014-01-16 17:19:36,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287924::DEBUG::2014-01-16 17:19:36,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287924::DEBUG::2014-01-16 17:19:36,513::task::974::TaskManager.Task::(_decref) Task=`e56004b7-4350-4098-a1ce-dbc5748f22b5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:36,912::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:19:36,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:19:36,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:19:36,913::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:19:37,160::task::579::TaskManager.Task::(_updateState) Task=`19fc2aab-736b-4a41-b646-ef032077e01d`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:19:37,160::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:19:37,160::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:19:37,160::task::1168::TaskManager.Task::(prepare) Task=`19fc2aab-736b-4a41-b646-ef032077e01d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:19:37,161::task::579::TaskManager.Task::(_updateState) Task=`19fc2aab-736b-4a41-b646-ef032077e01d`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:19:37,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:19:37,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:19:37,161::task::974::TaskManager.Task::(_decref) Task=`19fc2aab-736b-4a41-b646-ef032077e01d`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:19:37,169::task::579::TaskManager.Task::(_updateState) Task=`a793f89e-4a5d-4103-967d-90d8afa4e0ed`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:19:37,170::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:19:37,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:19:37,170::task::1168::TaskManager.Task::(prepare) Task=`a793f89e-4a5d-4103-967d-90d8afa4e0ed`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:19:37,170::task::579::TaskManager.Task::(_updateState) Task=`a793f89e-4a5d-4103-967d-90d8afa4e0ed`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:19:37,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:19:37,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:19:37,171::task::974::TaskManager.Task::(_decref) Task=`a793f89e-4a5d-4103-967d-90d8afa4e0ed`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:19:37,774::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:19:37,792::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000238763 s, 17.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:19:37,848::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:37,849::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:37,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:19:37,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:19:37,915::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:38,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:19:38,916::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:39,851::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:39,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:19:39,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:19:39,917::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:19:39,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287927::DEBUG::2014-01-16 17:19:40,094::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287927::DEBUG::2014-01-16 17:19:40,095::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.23', 'elapsedTime': '231', 'vmType': 'kvm', 'cpuSys': '2.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:19:40,919::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:19:40,960::task::579::TaskManager.Task::(_updateState) Task=`d206440e-ab4b-4dbf-a9a3-b680c5a10719`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:19:40,960::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:19:40,961::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:19:40,961::task::1168::TaskManager.Task::(prepare) Task=`d206440e-ab4b-4dbf-a9a3-b680c5a10719`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:19:40,961::task::579::TaskManager.Task::(_updateState) Task=`d206440e-ab4b-4dbf-a9a3-b680c5a10719`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:19:40,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:19:40,961::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:19:40,961::task::974::TaskManager.Task::(_decref) Task=`d206440e-ab4b-4dbf-a9a3-b680c5a10719`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:19:40,962::task::579::TaskManager.Task::(_updateState) Task=`ff41ff0e-af61-4bd2-9e3b-e3b275d4ef49`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:19:40,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:19:40,962::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:19:40,962::task::1168::TaskManager.Task::(prepare) Task=`ff41ff0e-af61-4bd2-9e3b-e3b275d4ef49`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:19:40,962::task::579::TaskManager.Task::(_updateState) Task=`ff41ff0e-af61-4bd2-9e3b-e3b275d4ef49`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:19:40,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:19:40,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:19:40,963::task::974::TaskManager.Task::(_decref) Task=`ff41ff0e-af61-4bd2-9e3b-e3b275d4ef49`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:41,853::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:41,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:19:41,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:19:41,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:19:41,921::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:41,921::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:19:41,922::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-251420::DEBUG::2014-01-16 17:19:42,697::task::579::TaskManager.Task::(_updateState) Task=`6372e5e7-2575-408a-af89-9954fee5abe1`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:19:42,697::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:19:42,697::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:19:42,698::task::1168::TaskManager.Task::(prepare) Task=`6372e5e7-2575-408a-af89-9954fee5abe1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:19:42,698::task::579::TaskManager.Task::(_updateState) Task=`6372e5e7-2575-408a-af89-9954fee5abe1`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:19:42,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:19:42,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:19:42,698::task::974::TaskManager.Task::(_decref) Task=`6372e5e7-2575-408a-af89-9954fee5abe1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:42,854::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:42,923::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287929::DEBUG::2014-01-16 17:19:43,192::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287929::DEBUG::2014-01-16 17:19:43,194::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.34.1.189', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.33', 'elapsedTime': '234', 'vmType': 'kvm', 'cpuSys': '2.60', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:19:43,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:43,924::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:19:43,924::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:19:43,924::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:19:44,494::task::579::TaskManager.Task::(_updateState) Task=`034fde0a-43f8-407e-9725-993c729fe012`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:19:44,495::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:19:44,495::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:19:44,495::task::1168::TaskManager.Task::(prepare) Task=`034fde0a-43f8-407e-9725-993c729fe012`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:19:44,496::task::579::TaskManager.Task::(_updateState) Task=`034fde0a-43f8-407e-9725-993c729fe012`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:19:44,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:19:44,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:19:44,496::task::974::TaskManager.Task::(_decref) Task=`034fde0a-43f8-407e-9725-993c729fe012`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:44,924::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:19:44,925::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:19:44,925::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >libvirtEventLoop::DEBUG::2014-01-16 17:19:45,461::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:45,462::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:45,462::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:45,463::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:19:45,463::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >Thread-16398::DEBUG::2014-01-16 17:19:45,777::task::579::TaskManager.Task::(_updateState) Task=`66a9eff9-a607-4ca9-ac67-8fdd63c350c4`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:19:45,777::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:19:45,777::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:19:45,777::task::1168::TaskManager.Task::(prepare) Task=`66a9eff9-a607-4ca9-ac67-8fdd63c350c4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:19:45,777::task::579::TaskManager.Task::(_updateState) Task=`66a9eff9-a607-4ca9-ac67-8fdd63c350c4`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:19:45,778::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:19:45,778::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:19:45,778::task::974::TaskManager.Task::(_decref) Task=`66a9eff9-a607-4ca9-ac67-8fdd63c350c4`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:19:45,822::task::579::TaskManager.Task::(_updateState) Task=`8f4fac09-e2b7-4932-83f3-da6217df4029`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:19:45,823::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:19:45,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:19:45,823::task::1168::TaskManager.Task::(prepare) Task=`8f4fac09-e2b7-4932-83f3-da6217df4029`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:19:45,823::task::579::TaskManager.Task::(_updateState) Task=`8f4fac09-e2b7-4932-83f3-da6217df4029`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:19:45,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:19:45,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:19:45,824::task::974::TaskManager.Task::(_decref) Task=`8f4fac09-e2b7-4932-83f3-da6217df4029`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:19:45,824::task::579::TaskManager.Task::(_updateState) Task=`572ed780-edfe-4c63-b8f7-843047ae7a25`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:19:45,825::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:19:45,825::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:19:45,825::task::1168::TaskManager.Task::(prepare) Task=`572ed780-edfe-4c63-b8f7-843047ae7a25`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:19:45,825::task::579::TaskManager.Task::(_updateState) Task=`572ed780-edfe-4c63-b8f7-843047ae7a25`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:19:45,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:19:45,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:19:45,826::task::974::TaskManager.Task::(_decref) Task=`572ed780-edfe-4c63-b8f7-843047ae7a25`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:45,856::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:45,926::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:19:45,926::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:19:45,926::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:19:45,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:19:46,057::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:19:46,078::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000320981 s, 1.1 MB/s\n'; <rc> = 0 >Thread-287936::DEBUG::2014-01-16 17:19:46,295::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [4857e8d9] >Thread-287936::DEBUG::2014-01-16 17:19:46,297::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'elapsedTime': '237', 'vmType': 'kvm', 'cpuSys': '2.60', 'appsList': [], 'guestIPs': ''}]} >Thread-20952::DEBUG::2014-01-16 17:19:46,637::task::579::TaskManager.Task::(_updateState) Task=`a1eeb1a0-06ef-47cc-a06b-a84273ac2e97`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:19:46,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-12152::DEBUG::2014-01-16 17:19:46,639::task::579::TaskManager.Task::(_updateState) Task=`3076bff6-59b1-45e8-b1fb-e1d90fd9b9bb`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:19:46,639::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:19:46,640::task::1168::TaskManager.Task::(prepare) Task=`a1eeb1a0-06ef-47cc-a06b-a84273ac2e97`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::INFO::2014-01-16 17:19:46,640::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-20952::DEBUG::2014-01-16 17:19:46,641::task::579::TaskManager.Task::(_updateState) Task=`a1eeb1a0-06ef-47cc-a06b-a84273ac2e97`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:19:46,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::INFO::2014-01-16 17:19:46,642::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:19:46,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:19:46,644::task::1168::TaskManager.Task::(prepare) Task=`3076bff6-59b1-45e8-b1fb-e1d90fd9b9bb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:19:46,644::task::974::TaskManager.Task::(_decref) Task=`a1eeb1a0-06ef-47cc-a06b-a84273ac2e97`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:19:46,645::task::579::TaskManager.Task::(_updateState) Task=`3076bff6-59b1-45e8-b1fb-e1d90fd9b9bb`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:19:46,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:19:46,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:19:46,646::task::974::TaskManager.Task::(_decref) Task=`3076bff6-59b1-45e8-b1fb-e1d90fd9b9bb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:46,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287930::DEBUG::2014-01-16 17:19:47,462::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287931::DEBUG::2014-01-16 17:19:47,462::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287932::DEBUG::2014-01-16 17:19:47,463::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287933::DEBUG::2014-01-16 17:19:47,464::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-287934::DEBUG::2014-01-16 17:19:47,464::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-22::DEBUG::2014-01-16 17:19:47,800::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:19:47,818::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00021468 s, 19.1 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:19:47,858::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:47,860::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:19:47,861::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:19:47,862::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:47,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:19:47,928::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:48,929::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287938::DEBUG::2014-01-16 17:19:49,410::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287938::DEBUG::2014-01-16 17:19:49,412::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'elapsedTime': '240', 'vmType': 'kvm', 'cpuSys': '2.60', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:19:49,864::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:49,930::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:50,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:51,865::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287783::DEBUG::2014-01-16 17:19:51,866::task::579::TaskManager.Task::(_updateState) Task=`cae5b120-3617-4a6d-93e8-55be2ec6747d`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:19:51,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:19:51,868::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:19:51,868::task::1168::TaskManager.Task::(prepare) Task=`cae5b120-3617-4a6d-93e8-55be2ec6747d`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:19:51,868::task::579::TaskManager.Task::(_updateState) Task=`cae5b120-3617-4a6d-93e8-55be2ec6747d`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:19:51,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:19:51,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:19:51,869::task::974::TaskManager.Task::(_decref) Task=`cae5b120-3617-4a6d-93e8-55be2ec6747d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:51,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287939::DEBUG::2014-01-16 17:19:52,466::task::579::TaskManager.Task::(_updateState) Task=`8a58d93e-e4c8-4514-9564-badeebccea0c`::moving from state init -> state preparing >Thread-287939::INFO::2014-01-16 17:19:52,467::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287939::INFO::2014-01-16 17:19:52,467::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000320981', 'lastCheck': '6.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021468', 'lastCheck': '4.6', 'valid': True}} >Thread-287939::DEBUG::2014-01-16 17:19:52,467::task::1168::TaskManager.Task::(prepare) Task=`8a58d93e-e4c8-4514-9564-badeebccea0c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000320981', 'lastCheck': '6.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021468', 'lastCheck': '4.6', 'valid': True}} >Thread-287939::DEBUG::2014-01-16 17:19:52,467::task::579::TaskManager.Task::(_updateState) Task=`8a58d93e-e4c8-4514-9564-badeebccea0c`::moving from state preparing -> state finished >Thread-287939::DEBUG::2014-01-16 17:19:52,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287939::DEBUG::2014-01-16 17:19:52,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287939::DEBUG::2014-01-16 17:19:52,468::task::974::TaskManager.Task::(_decref) Task=`8a58d93e-e4c8-4514-9564-badeebccea0c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:52,867::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:52,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:19:52,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:19:53,806::task::579::TaskManager.Task::(_updateState) Task=`249f3e3f-c2ad-45b6-a407-46cc39859bb7`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:19:53,806::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:19:53,807::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:19:53,807::task::1168::TaskManager.Task::(prepare) Task=`249f3e3f-c2ad-45b6-a407-46cc39859bb7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:19:53,807::task::579::TaskManager.Task::(_updateState) Task=`249f3e3f-c2ad-45b6-a407-46cc39859bb7`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:19:53,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:19:53,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:19:53,807::task::974::TaskManager.Task::(_decref) Task=`249f3e3f-c2ad-45b6-a407-46cc39859bb7`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:19:53,868::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:53,934::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:19:53,934::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:19:53,977::task::579::TaskManager.Task::(_updateState) Task=`1fc07fb1-7a45-4df5-8f6f-9ed95cca3bc0`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:19:53,977::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:19:53,978::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:19:53,978::task::1168::TaskManager.Task::(prepare) Task=`1fc07fb1-7a45-4df5-8f6f-9ed95cca3bc0`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:19:53,978::task::579::TaskManager.Task::(_updateState) Task=`1fc07fb1-7a45-4df5-8f6f-9ed95cca3bc0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:19:53,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:19:53,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:19:53,979::task::974::TaskManager.Task::(_decref) Task=`1fc07fb1-7a45-4df5-8f6f-9ed95cca3bc0`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:19:53,979::task::579::TaskManager.Task::(_updateState) Task=`a1157b30-b98d-4eff-b45a-3da4bf5e5043`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:19:53,979::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:19:53,979::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:19:53,979::task::1168::TaskManager.Task::(prepare) Task=`a1157b30-b98d-4eff-b45a-3da4bf5e5043`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:19:53,980::task::579::TaskManager.Task::(_updateState) Task=`a1157b30-b98d-4eff-b45a-3da4bf5e5043`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:19:53,980::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:19:53,980::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:19:53,980::task::974::TaskManager.Task::(_decref) Task=`a1157b30-b98d-4eff-b45a-3da4bf5e5043`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:19:53,980::task::579::TaskManager.Task::(_updateState) Task=`a489fd38-20fd-4c4e-9e87-534d10fa49e1`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:19:53,980::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:19:53,981::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:19:53,981::task::1168::TaskManager.Task::(prepare) Task=`a489fd38-20fd-4c4e-9e87-534d10fa49e1`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:19:53,981::task::579::TaskManager.Task::(_updateState) Task=`a489fd38-20fd-4c4e-9e87-534d10fa49e1`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:19:53,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:19:53,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:19:53,981::task::974::TaskManager.Task::(_decref) Task=`a489fd38-20fd-4c4e-9e87-534d10fa49e1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:19:54,935::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:19:55,870::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:55,937::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287942::DEBUG::2014-01-16 17:19:56,012::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287942::DEBUG::2014-01-16 17:19:56,013::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.09', 'elapsedTime': '247', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:19:56,088::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:19:56,114::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.0002627 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:19:56,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287943::DEBUG::2014-01-16 17:19:57,240::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [3ec1671d] >Thread-287943::INFO::2014-01-16 17:19:57,240::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-287943::DEBUG::2014-01-16 17:19:57,240::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-287943::ERROR::2014-01-16 17:19:57,260::BindingXMLRPC::1003::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in vmDestroy > return vm.destroy() > File "/usr/share/vdsm/API.py", line 329, in destroy > res = v.destroy() > File "/usr/share/vdsm/vm.py", line 4485, in destroy > response = self.releaseVm() > File "/usr/share/vdsm/vm.py", line 4417, in releaseVm > supervdsm.getProxy().removeFs(drive.path) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in removeFs > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >Exception: Cannot remove Fs that does not exists in: /var/run/vdsm/payload >Thread-22::DEBUG::2014-01-16 17:19:57,824::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:19:57,840::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000324347 s, 12.6 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:19:57,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:19:57,873::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:57,940::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:19:58,941::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:19:58,941::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:19:58,941::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:19:58,993::task::579::TaskManager.Task::(_updateState) Task=`b517f487-4a01-4b25-985c-480856f4bfcb`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:19:58,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:19:58,994::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:19:58,994::task::1168::TaskManager.Task::(prepare) Task=`b517f487-4a01-4b25-985c-480856f4bfcb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:19:58,994::task::579::TaskManager.Task::(_updateState) Task=`b517f487-4a01-4b25-985c-480856f4bfcb`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:19:58,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:19:58,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:19:58,995::task::974::TaskManager.Task::(_decref) Task=`b517f487-4a01-4b25-985c-480856f4bfcb`::ref 0 aborting False >Thread-287945::DEBUG::2014-01-16 17:19:59,111::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287945::DEBUG::2014-01-16 17:19:59,112::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.19', 'elapsedTime': '250', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:19:59,877::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:19:59,942::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:19:59,943::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:00,944::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:20:00,944::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:20:00,944::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:01,879::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:01,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:20:01,946::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287947::DEBUG::2014-01-16 17:20:02,212::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287947::DEBUG::2014-01-16 17:20:02,220::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.29', 'elapsedTime': '253', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:20:02,882::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:20:02,882::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:20:02,884::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:02,947::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:20:02,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:03,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:03,948::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:04,948::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:20:04,949::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287949::DEBUG::2014-01-16 17:20:05,318::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287949::DEBUG::2014-01-16 17:20:05,320::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.39', 'elapsedTime': '256', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-84941::DEBUG::2014-01-16 17:20:05,833::task::579::TaskManager.Task::(_updateState) Task=`ad5d3c76-600a-43aa-b4e0-3887e999102c`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:20:05,833::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:20:05,834::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:20:05,834::task::1168::TaskManager.Task::(prepare) Task=`ad5d3c76-600a-43aa-b4e0-3887e999102c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:20:05,834::task::579::TaskManager.Task::(_updateState) Task=`ad5d3c76-600a-43aa-b4e0-3887e999102c`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:20:05,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:20:05,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:20:05,834::task::974::TaskManager.Task::(_decref) Task=`ad5d3c76-600a-43aa-b4e0-3887e999102c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:20:05,887::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:05,950::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:20:05,950::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:20:06,122::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:20:06,146::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275248 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:20:06,950::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:20:06,951::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:20:06,951::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:20:06,951::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:20:07,850::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:07,866::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213163 s, 19.2 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:20:07,888::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:07,889::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:07,952::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:20:07,953::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:20:07,953::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287950::DEBUG::2014-01-16 17:20:08,377::task::579::TaskManager.Task::(_updateState) Task=`0c7bfb0f-cca1-43ef-a2f2-9d236251e6da`::moving from state init -> state preparing >Thread-287950::INFO::2014-01-16 17:20:08,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287950::INFO::2014-01-16 17:20:08,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275248', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213163', 'lastCheck': '0.5', 'valid': True}} >Thread-287950::DEBUG::2014-01-16 17:20:08,377::task::1168::TaskManager.Task::(prepare) Task=`0c7bfb0f-cca1-43ef-a2f2-9d236251e6da`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275248', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213163', 'lastCheck': '0.5', 'valid': True}} >Thread-287950::DEBUG::2014-01-16 17:20:08,378::task::579::TaskManager.Task::(_updateState) Task=`0c7bfb0f-cca1-43ef-a2f2-9d236251e6da`::moving from state preparing -> state finished >Thread-287950::DEBUG::2014-01-16 17:20:08,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287950::DEBUG::2014-01-16 17:20:08,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287950::DEBUG::2014-01-16 17:20:08,378::task::974::TaskManager.Task::(_decref) Task=`0c7bfb0f-cca1-43ef-a2f2-9d236251e6da`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:20:08,865::task::579::TaskManager.Task::(_updateState) Task=`bf0b3909-9c3f-4aab-baf6-f183aa991af4`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:20:08,866::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:20:08,867::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:20:08,867::task::1168::TaskManager.Task::(prepare) Task=`bf0b3909-9c3f-4aab-baf6-f183aa991af4`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:20:08,867::task::579::TaskManager.Task::(_updateState) Task=`bf0b3909-9c3f-4aab-baf6-f183aa991af4`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:20:08,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:20:08,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:20:08,868::task::974::TaskManager.Task::(_decref) Task=`bf0b3909-9c3f-4aab-baf6-f183aa991af4`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:20:08,878::task::579::TaskManager.Task::(_updateState) Task=`d6a6c719-163d-4451-816d-9d5543d7e59d`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:20:08,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:20:08,879::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:20:08,879::task::1168::TaskManager.Task::(prepare) Task=`d6a6c719-163d-4451-816d-9d5543d7e59d`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:20:08,879::task::579::TaskManager.Task::(_updateState) Task=`d6a6c719-163d-4451-816d-9d5543d7e59d`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:20:08,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:20:08,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:20:08,880::task::974::TaskManager.Task::(_decref) Task=`d6a6c719-163d-4451-816d-9d5543d7e59d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:08,954::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:20:08,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:09,890::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:09,956::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:20:09,956::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:20:09,956::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:20:09,956::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:20:10,946::task::579::TaskManager.Task::(_updateState) Task=`13d99c44-4c34-4c0d-9c87-873d83dd5a23`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:20:10,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:20:10,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:20:10,948::task::1168::TaskManager.Task::(prepare) Task=`13d99c44-4c34-4c0d-9c87-873d83dd5a23`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:20:10,948::task::579::TaskManager.Task::(_updateState) Task=`13d99c44-4c34-4c0d-9c87-873d83dd5a23`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:20:10,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:20:10,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:20:10,949::task::974::TaskManager.Task::(_decref) Task=`13d99c44-4c34-4c0d-9c87-873d83dd5a23`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:20:10,949::task::579::TaskManager.Task::(_updateState) Task=`3a91e57f-193e-4de9-bd92-e846ae8a4e70`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:20:10,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:20:10,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:20:10,950::task::1168::TaskManager.Task::(prepare) Task=`3a91e57f-193e-4de9-bd92-e846ae8a4e70`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:20:10,950::task::579::TaskManager.Task::(_updateState) Task=`3a91e57f-193e-4de9-bd92-e846ae8a4e70`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:20:10,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:20:10,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:20:10,950::task::974::TaskManager.Task::(_decref) Task=`3a91e57f-193e-4de9-bd92-e846ae8a4e70`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:10,957::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:11,892::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:11,958::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:20:11,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:20:11,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:20:11,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:11,959::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:20:11,960::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-287953::DEBUG::2014-01-16 17:20:12,138::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287953::DEBUG::2014-01-16 17:20:12,139::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'elapsedTime': '263', 'vmType': 'kvm', 'cpuSys': '0.66', 'appsList': [], 'guestIPs': ''}]} >Thread-131629::DEBUG::2014-01-16 17:20:12,764::task::579::TaskManager.Task::(_updateState) Task=`1ac6a7fb-fe3c-499d-80ee-f58376b42449`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:20:12,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:20:12,764::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:20:12,764::task::1168::TaskManager.Task::(prepare) Task=`1ac6a7fb-fe3c-499d-80ee-f58376b42449`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:20:12,765::task::579::TaskManager.Task::(_updateState) Task=`1ac6a7fb-fe3c-499d-80ee-f58376b42449`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:20:12,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:20:12,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:20:12,765::task::974::TaskManager.Task::(_decref) Task=`1ac6a7fb-fe3c-499d-80ee-f58376b42449`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:20:12,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:12,962::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:20:13,126::task::579::TaskManager.Task::(_updateState) Task=`8722c6c8-2036-4bbb-b520-0933eaaee74a`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:20:13,127::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:20:13,127::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:20:13,127::task::1168::TaskManager.Task::(prepare) Task=`8722c6c8-2036-4bbb-b520-0933eaaee74a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:20:13,127::task::579::TaskManager.Task::(_updateState) Task=`8722c6c8-2036-4bbb-b520-0933eaaee74a`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:20:13,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:20:13,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:20:13,128::task::974::TaskManager.Task::(_decref) Task=`8722c6c8-2036-4bbb-b520-0933eaaee74a`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:20:13,128::task::579::TaskManager.Task::(_updateState) Task=`2e11a9ce-3d13-4374-a84a-8cefb6661924`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:20:13,128::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:20:13,128::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:20:13,128::task::1168::TaskManager.Task::(prepare) Task=`2e11a9ce-3d13-4374-a84a-8cefb6661924`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:20:13,128::task::579::TaskManager.Task::(_updateState) Task=`2e11a9ce-3d13-4374-a84a-8cefb6661924`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:20:13,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:20:13,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:20:13,129::task::974::TaskManager.Task::(_decref) Task=`2e11a9ce-3d13-4374-a84a-8cefb6661924`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:20:13,898::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:13,963::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:20:13,964::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:20:13,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:14,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:20:14,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:20:14,965::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287955::DEBUG::2014-01-16 17:20:15,237::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287955::DEBUG::2014-01-16 17:20:15,238::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.31', 'elapsedTime': '266', 'vmType': 'kvm', 'cpuSys': '0.66', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:20:15,900::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:15,966::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:20:15,966::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:20:15,966::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:20:15,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:20:16,155::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:20:16,176::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000260373 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:20:16,430::task::579::TaskManager.Task::(_updateState) Task=`f3034515-b60e-4ce3-a198-f2b8d6b227c7`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:20:16,431::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:20:16,431::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:20:16,431::task::1168::TaskManager.Task::(prepare) Task=`f3034515-b60e-4ce3-a198-f2b8d6b227c7`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:20:16,432::task::579::TaskManager.Task::(_updateState) Task=`f3034515-b60e-4ce3-a198-f2b8d6b227c7`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:20:16,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:20:16,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:20:16,432::task::974::TaskManager.Task::(_decref) Task=`f3034515-b60e-4ce3-a198-f2b8d6b227c7`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:20:16,714::task::579::TaskManager.Task::(_updateState) Task=`2adcb7be-e1eb-45ab-81fa-4d7a5541a788`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:20:16,714::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:20:16,715::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:20:16,715::task::1168::TaskManager.Task::(prepare) Task=`2adcb7be-e1eb-45ab-81fa-4d7a5541a788`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:20:16,715::task::579::TaskManager.Task::(_updateState) Task=`2adcb7be-e1eb-45ab-81fa-4d7a5541a788`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:20:16,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:20:16,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:20:16,715::task::974::TaskManager.Task::(_decref) Task=`2adcb7be-e1eb-45ab-81fa-4d7a5541a788`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:16,968::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:20:17,873::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:20:17,874::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:20:17,874::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:20:17,874::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:20:17,877::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:17,892::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000257848 s, 7.9 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:20:17,893::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000257848 s, 7.9 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:20:17,893::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:20:17,893::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:20:17,893::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:20:17,894::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:20:17,894::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:20:17,894::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:20:17,897::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:20:17,897::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:20:17,898::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:20:17,917::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:17,918::task::579::TaskManager.Task::(_updateState) Task=`3e01d16f-b6db-478c-8ff4-3db2c0511c08`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:20:17,918::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-184546::DEBUG::2014-01-16 17:20:17,920::task::579::TaskManager.Task::(_updateState) Task=`56b40174-716e-415e-aa5f-37e8f4ea2e03`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:20:17,921::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >VM Channels Listener::DEBUG::2014-01-16 17:20:17,969::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:20:17,970::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:20:18,127::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:20:18,130::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:20:18,130::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:20:18,131::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:20:18,131::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:20:18,131::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-189817::INFO::2014-01-16 17:20:18,133::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-184546::INFO::2014-01-16 17:20:18,133::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-189817::DEBUG::2014-01-16 17:20:18,135::task::1168::TaskManager.Task::(prepare) Task=`3e01d16f-b6db-478c-8ff4-3db2c0511c08`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-184546::DEBUG::2014-01-16 17:20:18,135::task::1168::TaskManager.Task::(prepare) Task=`56b40174-716e-415e-aa5f-37e8f4ea2e03`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-189817::DEBUG::2014-01-16 17:20:18,136::task::579::TaskManager.Task::(_updateState) Task=`3e01d16f-b6db-478c-8ff4-3db2c0511c08`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:20:18,137::task::579::TaskManager.Task::(_updateState) Task=`56b40174-716e-415e-aa5f-37e8f4ea2e03`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:20:18,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:20:18,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-01-16 17:20:18,139::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-189817::DEBUG::2014-01-16 17:20:18,140::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:20:18,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:20:18,160::task::974::TaskManager.Task::(_decref) Task=`3e01d16f-b6db-478c-8ff4-3db2c0511c08`::ref 0 aborting False >Thread-184546::DEBUG::2014-01-16 17:20:18,161::task::974::TaskManager.Task::(_decref) Task=`56b40174-716e-415e-aa5f-37e8f4ea2e03`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:20:18,167::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:20:18,167::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:20:18,170::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:18,172::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:18,173::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:20:18,311::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:20:18,315::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:18,345::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000234807 s, 17.4 MB/s\n'; <rc> = 0 >Thread-287957::DEBUG::2014-01-16 17:20:18,416::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287957::DEBUG::2014-01-16 17:20:18,417::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.49', 'elapsedTime': '269', 'vmType': 'kvm', 'cpuSys': '0.66', 'appsList': [], 'guestIPs': ''}]} >Thread-84402::DEBUG::2014-01-16 17:20:18,759::task::579::TaskManager.Task::(_updateState) Task=`1ec749e2-a146-400e-9385-67fe34ab2fda`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:20:18,759::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:20:18,760::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:20:18,760::task::1168::TaskManager.Task::(prepare) Task=`1ec749e2-a146-400e-9385-67fe34ab2fda`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:20:18,760::task::579::TaskManager.Task::(_updateState) Task=`1ec749e2-a146-400e-9385-67fe34ab2fda`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:20:18,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:20:18,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:20:18,761::task::974::TaskManager.Task::(_decref) Task=`1ec749e2-a146-400e-9385-67fe34ab2fda`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:18,972::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:20:19,103::task::579::TaskManager.Task::(_updateState) Task=`aeb19232-550b-464e-aac6-43c65aaaa0f4`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:20:19,103::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:20:19,104::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:20:19,104::task::1168::TaskManager.Task::(prepare) Task=`aeb19232-550b-464e-aac6-43c65aaaa0f4`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:20:19,104::task::579::TaskManager.Task::(_updateState) Task=`aeb19232-550b-464e-aac6-43c65aaaa0f4`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:20:19,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:20:19,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:20:19,104::task::974::TaskManager.Task::(_decref) Task=`aeb19232-550b-464e-aac6-43c65aaaa0f4`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:20:19,105::task::579::TaskManager.Task::(_updateState) Task=`f188f2fa-bdc0-4beb-b0ec-5c6485570e0f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:20:19,105::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:20:19,105::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:20:19,105::task::1168::TaskManager.Task::(prepare) Task=`f188f2fa-bdc0-4beb-b0ec-5c6485570e0f`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:20:19,106::task::579::TaskManager.Task::(_updateState) Task=`f188f2fa-bdc0-4beb-b0ec-5c6485570e0f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:20:19,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:20:19,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:20:19,106::task::974::TaskManager.Task::(_decref) Task=`f188f2fa-bdc0-4beb-b0ec-5c6485570e0f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:19,973::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:20,175::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:20:20,495::task::579::TaskManager.Task::(_updateState) Task=`c07eab09-12ca-461f-aa6e-f17ba11bae41`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:20:20,495::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:20:20,496::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:20:20,496::task::1168::TaskManager.Task::(prepare) Task=`c07eab09-12ca-461f-aa6e-f17ba11bae41`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:20:20,496::task::579::TaskManager.Task::(_updateState) Task=`c07eab09-12ca-461f-aa6e-f17ba11bae41`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:20:20,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:20:20,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:20:20,496::task::974::TaskManager.Task::(_decref) Task=`c07eab09-12ca-461f-aa6e-f17ba11bae41`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:20,974::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287959::DEBUG::2014-01-16 17:20:21,516::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287959::DEBUG::2014-01-16 17:20:21,517::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.59', 'elapsedTime': '272', 'vmType': 'kvm', 'cpuSys': '0.66', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:20:21,975::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:22,176::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:20:22,829::task::579::TaskManager.Task::(_updateState) Task=`90686438-274c-47da-9276-e923aaa913b9`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:20:22,830::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:20:22,830::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:20:22,830::task::1168::TaskManager.Task::(prepare) Task=`90686438-274c-47da-9276-e923aaa913b9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:20:22,830::task::579::TaskManager.Task::(_updateState) Task=`90686438-274c-47da-9276-e923aaa913b9`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:20:22,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:20:22,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:20:22,831::task::974::TaskManager.Task::(_decref) Task=`90686438-274c-47da-9276-e923aaa913b9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:22,976::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:20:22,976::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:23,177::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:23,978::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:20:23,978::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:24,178::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287960::DEBUG::2014-01-16 17:20:24,573::task::579::TaskManager.Task::(_updateState) Task=`078c3a1b-4874-4bcc-8af9-805bae8635dc`::moving from state init -> state preparing >Thread-287960::INFO::2014-01-16 17:20:24,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287960::INFO::2014-01-16 17:20:24,574::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260373', 'lastCheck': '8.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234807', 'lastCheck': '6.2', 'valid': True}} >Thread-287960::DEBUG::2014-01-16 17:20:24,574::task::1168::TaskManager.Task::(prepare) Task=`078c3a1b-4874-4bcc-8af9-805bae8635dc`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000260373', 'lastCheck': '8.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234807', 'lastCheck': '6.2', 'valid': True}} >Thread-287960::DEBUG::2014-01-16 17:20:24,574::task::579::TaskManager.Task::(_updateState) Task=`078c3a1b-4874-4bcc-8af9-805bae8635dc`::moving from state preparing -> state finished >Thread-287960::DEBUG::2014-01-16 17:20:24,574::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287960::DEBUG::2014-01-16 17:20:24,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287960::DEBUG::2014-01-16 17:20:24,574::task::974::TaskManager.Task::(_decref) Task=`078c3a1b-4874-4bcc-8af9-805bae8635dc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:24,979::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:20:25,708::task::579::TaskManager.Task::(_updateState) Task=`436de279-1244-4e4f-b622-b2e8cebe293f`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:20:25,708::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:20:25,709::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:20:25,709::task::1168::TaskManager.Task::(prepare) Task=`436de279-1244-4e4f-b622-b2e8cebe293f`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:20:25,709::task::579::TaskManager.Task::(_updateState) Task=`436de279-1244-4e4f-b622-b2e8cebe293f`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:20:25,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:20:25,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:20:25,709::task::974::TaskManager.Task::(_decref) Task=`436de279-1244-4e4f-b622-b2e8cebe293f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:25,980::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:26,179::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:20:26,187::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:20:26,211::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000261116 s, 1.4 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 17:20:26,962::task::579::TaskManager.Task::(_updateState) Task=`17e86f71-5dd1-4354-a9bd-92528129c85f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:20:26,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:20:26,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:20:26,963::task::1168::TaskManager.Task::(prepare) Task=`17e86f71-5dd1-4354-a9bd-92528129c85f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:20:26,963::task::579::TaskManager.Task::(_updateState) Task=`17e86f71-5dd1-4354-a9bd-92528129c85f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:20:26,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:20:26,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:20:26,963::task::974::TaskManager.Task::(_decref) Task=`17e86f71-5dd1-4354-a9bd-92528129c85f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:20:26,964::task::579::TaskManager.Task::(_updateState) Task=`669ec3e9-a5dc-4bf5-99f7-a2a64170d2a0`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:20:26,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:20:26,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:20:26,964::task::1168::TaskManager.Task::(prepare) Task=`669ec3e9-a5dc-4bf5-99f7-a2a64170d2a0`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:20:26,964::task::579::TaskManager.Task::(_updateState) Task=`669ec3e9-a5dc-4bf5-99f7-a2a64170d2a0`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:20:26,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:20:26,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:20:26,965::task::974::TaskManager.Task::(_decref) Task=`669ec3e9-a5dc-4bf5-99f7-a2a64170d2a0`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:20:26,965::task::579::TaskManager.Task::(_updateState) Task=`202eb494-10eb-4251-ba84-10aded7abdfc`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:20:26,965::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:20:26,966::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:20:26,966::task::1168::TaskManager.Task::(prepare) Task=`202eb494-10eb-4251-ba84-10aded7abdfc`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:20:26,966::task::579::TaskManager.Task::(_updateState) Task=`202eb494-10eb-4251-ba84-10aded7abdfc`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:20:26,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:20:26,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:20:26,966::task::974::TaskManager.Task::(_decref) Task=`202eb494-10eb-4251-ba84-10aded7abdfc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:26,981::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:20:27,859::task::579::TaskManager.Task::(_updateState) Task=`204f5d26-35c5-4e4e-be93-5ab3047ee72d`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:20:27,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:20:27,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:20:27,861::task::1168::TaskManager.Task::(prepare) Task=`204f5d26-35c5-4e4e-be93-5ab3047ee72d`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:20:27,861::task::579::TaskManager.Task::(_updateState) Task=`204f5d26-35c5-4e4e-be93-5ab3047ee72d`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:20:27,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:20:27,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:20:27,862::task::974::TaskManager.Task::(_decref) Task=`204f5d26-35c5-4e4e-be93-5ab3047ee72d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:27,982::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287963::DEBUG::2014-01-16 17:20:28,118::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287963::DEBUG::2014-01-16 17:20:28,119::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.12', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '279', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:20:28,181::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:28,182::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:20:28,359::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:28,376::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000224124 s, 18.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:20:28,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:20:28,984::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:20:28,985::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:29,987::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:20:29,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:30,183::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:30,989::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:20:30,989::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:20:30,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287965::DEBUG::2014-01-16 17:20:31,218::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287965::DEBUG::2014-01-16 17:20:31,220::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.12', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.28', 'elapsedTime': '282', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:20:31,990::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:20:31,990::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:32,185::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:32,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:20:32,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:33,187::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:20:33,187::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:20:33,195::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:20:33,318::task::579::TaskManager.Task::(_updateState) Task=`42c4608a-a692-41d5-98fc-ddbcdac0fea0`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:20:33,318::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:20:33,319::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:20:33,319::task::1168::TaskManager.Task::(prepare) Task=`42c4608a-a692-41d5-98fc-ddbcdac0fea0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:20:33,319::task::579::TaskManager.Task::(_updateState) Task=`42c4608a-a692-41d5-98fc-ddbcdac0fea0`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:20:33,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:20:33,319::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:20:33,319::task::974::TaskManager.Task::(_decref) Task=`42c4608a-a692-41d5-98fc-ddbcdac0fea0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:33,992::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:34,202::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287967::DEBUG::2014-01-16 17:20:34,321::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287967::DEBUG::2014-01-16 17:20:34,322::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.12', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'elapsedTime': '285', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:20:34,999::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:20:34,999::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:36,000::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:20:36,001::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:36,204::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:20:36,219::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:20:36,246::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000268455 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:20:37,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:20:37,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:20:37,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:20:37,003::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:20:37,336::task::579::TaskManager.Task::(_updateState) Task=`8c2d7ce2-be75-4885-8262-2929ec185f6a`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:20:37,337::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:20:37,337::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:20:37,337::task::1168::TaskManager.Task::(prepare) Task=`8c2d7ce2-be75-4885-8262-2929ec185f6a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:20:37,338::task::579::TaskManager.Task::(_updateState) Task=`8c2d7ce2-be75-4885-8262-2929ec185f6a`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:20:37,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:20:37,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:20:37,338::task::974::TaskManager.Task::(_decref) Task=`8c2d7ce2-be75-4885-8262-2929ec185f6a`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:20:37,340::task::579::TaskManager.Task::(_updateState) Task=`f61d656f-7a55-4259-a3a1-0dc6f440bb68`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:20:37,341::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:20:37,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:20:37,341::task::1168::TaskManager.Task::(prepare) Task=`f61d656f-7a55-4259-a3a1-0dc6f440bb68`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:20:37,341::task::579::TaskManager.Task::(_updateState) Task=`f61d656f-7a55-4259-a3a1-0dc6f440bb68`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:20:37,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:20:37,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:20:37,342::task::974::TaskManager.Task::(_decref) Task=`f61d656f-7a55-4259-a3a1-0dc6f440bb68`::ref 0 aborting False >Thread-287969::DEBUG::2014-01-16 17:20:37,424::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287969::DEBUG::2014-01-16 17:20:37,425::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.49', 'elapsedTime': '288', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:20:38,004::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:20:38,004::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:20:38,004::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:38,205::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:38,206::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:20:38,383::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:38,400::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258795 s, 15.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:20:39,006::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:20:39,006::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:40,007::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:20:40,007::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:20:40,007::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:20:40,007::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:40,208::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287970::DEBUG::2014-01-16 17:20:40,485::task::579::TaskManager.Task::(_updateState) Task=`a824c41b-609d-4aaf-9af1-a42bda796cbe`::moving from state init -> state preparing >Thread-287970::INFO::2014-01-16 17:20:40,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287970::INFO::2014-01-16 17:20:40,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268455', 'lastCheck': '4.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258795', 'lastCheck': '2.1', 'valid': True}} >Thread-287970::DEBUG::2014-01-16 17:20:40,485::task::1168::TaskManager.Task::(prepare) Task=`a824c41b-609d-4aaf-9af1-a42bda796cbe`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000268455', 'lastCheck': '4.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258795', 'lastCheck': '2.1', 'valid': True}} >Thread-287970::DEBUG::2014-01-16 17:20:40,485::task::579::TaskManager.Task::(_updateState) Task=`a824c41b-609d-4aaf-9af1-a42bda796cbe`::moving from state preparing -> state finished >Thread-287970::DEBUG::2014-01-16 17:20:40,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287970::DEBUG::2014-01-16 17:20:40,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287970::DEBUG::2014-01-16 17:20:40,486::task::974::TaskManager.Task::(_decref) Task=`a824c41b-609d-4aaf-9af1-a42bda796cbe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:41,009::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:20:41,356::task::579::TaskManager.Task::(_updateState) Task=`a3a11810-efa5-46bf-b26c-f96fcb4cc9c0`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:20:41,357::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:20:41,357::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:20:41,357::task::1168::TaskManager.Task::(prepare) Task=`a3a11810-efa5-46bf-b26c-f96fcb4cc9c0`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:20:41,357::task::579::TaskManager.Task::(_updateState) Task=`a3a11810-efa5-46bf-b26c-f96fcb4cc9c0`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:20:41,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:20:41,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:20:41,358::task::974::TaskManager.Task::(_decref) Task=`a3a11810-efa5-46bf-b26c-f96fcb4cc9c0`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:20:41,358::task::579::TaskManager.Task::(_updateState) Task=`b4494f81-2bec-4495-961d-5a6092714fd6`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:20:41,358::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:20:41,358::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:20:41,359::task::1168::TaskManager.Task::(prepare) Task=`b4494f81-2bec-4495-961d-5a6092714fd6`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:20:41,359::task::579::TaskManager.Task::(_updateState) Task=`b4494f81-2bec-4495-961d-5a6092714fd6`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:20:41,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:20:41,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:20:41,359::task::974::TaskManager.Task::(_decref) Task=`b4494f81-2bec-4495-961d-5a6092714fd6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:42,010::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:20:42,010::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:20:42,011::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:20:42,011::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:42,011::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:20:42,013::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:20:42,209::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:20:42,879::task::579::TaskManager.Task::(_updateState) Task=`4d4bfbb5-fb5f-4220-8cf5-2fd1610ea39d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:20:42,880::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:20:42,880::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:20:42,880::task::1168::TaskManager.Task::(prepare) Task=`4d4bfbb5-fb5f-4220-8cf5-2fd1610ea39d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:20:42,880::task::579::TaskManager.Task::(_updateState) Task=`4d4bfbb5-fb5f-4220-8cf5-2fd1610ea39d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:20:42,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:20:42,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:20:42,881::task::974::TaskManager.Task::(_decref) Task=`4d4bfbb5-fb5f-4220-8cf5-2fd1610ea39d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:43,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:43,210::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:44,015::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:20:44,015::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:20:44,015::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:44,211::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287973::DEBUG::2014-01-16 17:20:44,275::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287973::DEBUG::2014-01-16 17:20:44,276::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.33', 'elapsedTime': '295', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-3168::DEBUG::2014-01-16 17:20:44,670::task::579::TaskManager.Task::(_updateState) Task=`9455ce4b-7002-4c82-997c-d457fd311604`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:20:44,670::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:20:44,671::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:20:44,671::task::1168::TaskManager.Task::(prepare) Task=`9455ce4b-7002-4c82-997c-d457fd311604`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:20:44,671::task::579::TaskManager.Task::(_updateState) Task=`9455ce4b-7002-4c82-997c-d457fd311604`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:20:44,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:20:44,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:20:44,671::task::974::TaskManager.Task::(_decref) Task=`9455ce4b-7002-4c82-997c-d457fd311604`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:45,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:20:45,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:20:45,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 17:20:45,994::task::579::TaskManager.Task::(_updateState) Task=`b6a5c32f-2287-4fba-baf0-a71c212b896e`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:20:45,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:20:45,994::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:20:45,994::task::1168::TaskManager.Task::(prepare) Task=`b6a5c32f-2287-4fba-baf0-a71c212b896e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:20:45,995::task::579::TaskManager.Task::(_updateState) Task=`b6a5c32f-2287-4fba-baf0-a71c212b896e`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:20:45,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:20:45,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:20:45,995::task::974::TaskManager.Task::(_decref) Task=`b6a5c32f-2287-4fba-baf0-a71c212b896e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:46,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:20:46,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:20:46,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:20:46,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-69607::DEBUG::2014-01-16 17:20:46,031::task::579::TaskManager.Task::(_updateState) Task=`db1a1f92-7dcb-4565-92b6-3d0edf3851d0`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:20:46,031::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:20:46,031::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:20:46,031::task::1168::TaskManager.Task::(prepare) Task=`db1a1f92-7dcb-4565-92b6-3d0edf3851d0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:20:46,032::task::579::TaskManager.Task::(_updateState) Task=`db1a1f92-7dcb-4565-92b6-3d0edf3851d0`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:20:46,032::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:20:46,032::task::579::TaskManager.Task::(_updateState) Task=`a7e969d1-ed58-4bd0-89e6-767fbe4eb8d3`::moving from state init -> state preparing >Thread-69607::DEBUG::2014-01-16 17:20:46,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::INFO::2014-01-16 17:20:46,033::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-69607::DEBUG::2014-01-16 17:20:46,033::task::974::TaskManager.Task::(_decref) Task=`db1a1f92-7dcb-4565-92b6-3d0edf3851d0`::ref 0 aborting False >Thread-16393::INFO::2014-01-16 17:20:46,033::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:20:46,033::task::1168::TaskManager.Task::(prepare) Task=`a7e969d1-ed58-4bd0-89e6-767fbe4eb8d3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:20:46,033::task::579::TaskManager.Task::(_updateState) Task=`a7e969d1-ed58-4bd0-89e6-767fbe4eb8d3`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:20:46,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:20:46,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:20:46,034::task::974::TaskManager.Task::(_decref) Task=`a7e969d1-ed58-4bd0-89e6-767fbe4eb8d3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:20:46,213::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:20:46,255::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:20:46,282::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000279638 s, 1.3 MB/s\n'; <rc> = 0 >Thread-20952::DEBUG::2014-01-16 17:20:46,861::task::579::TaskManager.Task::(_updateState) Task=`9761bf6d-ef86-408b-a324-7ec896ce68cc`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:20:46,862::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-12152::DEBUG::2014-01-16 17:20:46,863::task::579::TaskManager.Task::(_updateState) Task=`de2cd024-550b-4364-af7f-0ffd70623587`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:20:46,863::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:20:46,864::task::1168::TaskManager.Task::(prepare) Task=`9761bf6d-ef86-408b-a324-7ec896ce68cc`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::INFO::2014-01-16 17:20:46,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-20952::DEBUG::2014-01-16 17:20:46,865::task::579::TaskManager.Task::(_updateState) Task=`9761bf6d-ef86-408b-a324-7ec896ce68cc`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:20:46,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::INFO::2014-01-16 17:20:46,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:20:46,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:20:46,867::task::1168::TaskManager.Task::(prepare) Task=`de2cd024-550b-4364-af7f-0ffd70623587`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:20:46,868::task::974::TaskManager.Task::(_decref) Task=`9761bf6d-ef86-408b-a324-7ec896ce68cc`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:20:46,868::task::579::TaskManager.Task::(_updateState) Task=`de2cd024-550b-4364-af7f-0ffd70623587`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:20:46,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:20:46,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:20:46,869::task::974::TaskManager.Task::(_decref) Task=`de2cd024-550b-4364-af7f-0ffd70623587`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:47,019::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287975::DEBUG::2014-01-16 17:20:47,377::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287975::DEBUG::2014-01-16 17:20:47,379::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.44', 'elapsedTime': '298', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:20:48,021::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:20:48,021::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:48,214::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:48,216::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:20:48,216::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:20:48,217::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:20:48,405::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:48,423::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000223334 s, 18.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:20:49,023::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:50,024::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:50,219::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287977::DEBUG::2014-01-16 17:20:50,476::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287977::DEBUG::2014-01-16 17:20:50,477::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.53', 'elapsedTime': '301', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:20:51,026::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:20:51,943::task::579::TaskManager.Task::(_updateState) Task=`e106bb73-47d5-4249-b0ba-353479f9b6a5`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:20:51,943::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:20:51,944::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:20:51,945::task::1168::TaskManager.Task::(prepare) Task=`e106bb73-47d5-4249-b0ba-353479f9b6a5`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:20:51,945::task::579::TaskManager.Task::(_updateState) Task=`e106bb73-47d5-4249-b0ba-353479f9b6a5`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:20:51,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:20:51,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:20:51,945::task::974::TaskManager.Task::(_decref) Task=`e106bb73-47d5-4249-b0ba-353479f9b6a5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:52,027::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:52,220::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:20:53,028::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:20:53,029::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:53,222::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287979::DEBUG::2014-01-16 17:20:53,585::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287979::DEBUG::2014-01-16 17:20:53,586::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '304', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-16244::DEBUG::2014-01-16 17:20:54,009::task::579::TaskManager.Task::(_updateState) Task=`241fdbdb-79e6-4daf-a42a-360cc5bb1996`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:20:54,009::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:20:54,010::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:20:54,010::task::1168::TaskManager.Task::(prepare) Task=`241fdbdb-79e6-4daf-a42a-360cc5bb1996`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:20:54,010::task::579::TaskManager.Task::(_updateState) Task=`241fdbdb-79e6-4daf-a42a-360cc5bb1996`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:20:54,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:20:54,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:20:54,011::task::974::TaskManager.Task::(_decref) Task=`241fdbdb-79e6-4daf-a42a-360cc5bb1996`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:54,030::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:20:54,030::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:54,223::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:20:54,303::task::579::TaskManager.Task::(_updateState) Task=`800e4218-8b3b-4e63-aaba-a77a9c61c6f5`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:20:54,303::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:20:54,304::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:20:54,304::task::1168::TaskManager.Task::(prepare) Task=`800e4218-8b3b-4e63-aaba-a77a9c61c6f5`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:20:54,304::task::579::TaskManager.Task::(_updateState) Task=`800e4218-8b3b-4e63-aaba-a77a9c61c6f5`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:20:54,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:20:54,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:20:54,304::task::974::TaskManager.Task::(_decref) Task=`800e4218-8b3b-4e63-aaba-a77a9c61c6f5`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:20:54,305::task::579::TaskManager.Task::(_updateState) Task=`12eed08e-4cee-4dde-b75c-0aa55a3532db`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:20:54,305::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:20:54,305::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:20:54,305::task::1168::TaskManager.Task::(prepare) Task=`12eed08e-4cee-4dde-b75c-0aa55a3532db`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:20:54,305::task::579::TaskManager.Task::(_updateState) Task=`12eed08e-4cee-4dde-b75c-0aa55a3532db`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:20:54,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:20:54,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:20:54,306::task::974::TaskManager.Task::(_decref) Task=`12eed08e-4cee-4dde-b75c-0aa55a3532db`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:20:54,306::task::579::TaskManager.Task::(_updateState) Task=`0e982f3d-d9f1-44b5-9635-ed7c3af174c6`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:20:54,306::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:20:54,306::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:20:54,306::task::1168::TaskManager.Task::(prepare) Task=`0e982f3d-d9f1-44b5-9635-ed7c3af174c6`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:20:54,307::task::579::TaskManager.Task::(_updateState) Task=`0e982f3d-d9f1-44b5-9635-ed7c3af174c6`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:20:54,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:20:54,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:20:54,307::task::974::TaskManager.Task::(_decref) Task=`0e982f3d-d9f1-44b5-9635-ed7c3af174c6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:55,031::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:56,033::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:56,225::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:20:56,290::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:20:56,314::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258926 s, 1.4 MB/s\n'; <rc> = 0 >Thread-287980::DEBUG::2014-01-16 17:20:56,647::task::579::TaskManager.Task::(_updateState) Task=`de8e2443-fa48-4482-bd4c-a8b4bc226b7e`::moving from state init -> state preparing >Thread-287980::INFO::2014-01-16 17:20:56,647::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287980::INFO::2014-01-16 17:20:56,647::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258926', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223334', 'lastCheck': '8.2', 'valid': True}} >Thread-287980::DEBUG::2014-01-16 17:20:56,647::task::1168::TaskManager.Task::(prepare) Task=`de8e2443-fa48-4482-bd4c-a8b4bc226b7e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000258926', 'lastCheck': '0.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223334', 'lastCheck': '8.2', 'valid': True}} >Thread-287980::DEBUG::2014-01-16 17:20:56,648::task::579::TaskManager.Task::(_updateState) Task=`de8e2443-fa48-4482-bd4c-a8b4bc226b7e`::moving from state preparing -> state finished >Thread-287980::DEBUG::2014-01-16 17:20:56,648::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287980::DEBUG::2014-01-16 17:20:56,648::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287980::DEBUG::2014-01-16 17:20:56,648::task::974::TaskManager.Task::(_decref) Task=`de8e2443-fa48-4482-bd4c-a8b4bc226b7e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:20:57,035::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:20:58,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:20:58,226::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:20:58,228::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:20:58,429::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:20:58,446::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00020456 s, 20.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:20:59,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:20:59,038::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:20:59,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:20:59,178::task::579::TaskManager.Task::(_updateState) Task=`985976c4-6c9c-4cb1-b952-17011e397d35`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:20:59,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:20:59,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:20:59,179::task::1168::TaskManager.Task::(prepare) Task=`985976c4-6c9c-4cb1-b952-17011e397d35`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:20:59,179::task::579::TaskManager.Task::(_updateState) Task=`985976c4-6c9c-4cb1-b952-17011e397d35`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:20:59,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:20:59,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:20:59,180::task::974::TaskManager.Task::(_decref) Task=`985976c4-6c9c-4cb1-b952-17011e397d35`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:00,040::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:21:00,040::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287983::DEBUG::2014-01-16 17:21:00,183::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287983::DEBUG::2014-01-16 17:21:00,185::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '311', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:21:00,229::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:01,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:21:01,042::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:21:01,042::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:02,043::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:21:02,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:02,231::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:03,044::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:21:03,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:03,233::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:21:03,233::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:21:03,235::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287985::DEBUG::2014-01-16 17:21:03,376::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287985::DEBUG::2014-01-16 17:21:03,377::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.37', 'elapsedTime': '314', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:04,046::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:04,236::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:05,047::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:21:05,048::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:21:06,037::task::579::TaskManager.Task::(_updateState) Task=`d79bee70-32b8-4b0d-b886-c5a25a2d25d1`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:21:06,037::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:21:06,037::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:21:06,038::task::1168::TaskManager.Task::(prepare) Task=`d79bee70-32b8-4b0d-b886-c5a25a2d25d1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:21:06,038::task::579::TaskManager.Task::(_updateState) Task=`d79bee70-32b8-4b0d-b886-c5a25a2d25d1`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:21:06,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:21:06,038::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:21:06,038::task::974::TaskManager.Task::(_decref) Task=`d79bee70-32b8-4b0d-b886-c5a25a2d25d1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:06,049::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:21:06,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:06,238::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:21:06,323::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:21:06,348::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000306701 s, 1.2 MB/s\n'; <rc> = 0 >Thread-287987::DEBUG::2014-01-16 17:21:06,474::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287987::DEBUG::2014-01-16 17:21:06,476::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.47', 'elapsedTime': '317', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:07,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:21:07,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:21:07,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:21:07,051::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:08,052::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:21:08,053::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:21:08,053::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:08,239::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:08,240::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:21:08,452::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:21:08,469::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00020798 s, 19.7 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 17:21:08,956::task::579::TaskManager.Task::(_updateState) Task=`6bd28669-21f2-4c9e-99c3-d29689db6422`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:21:08,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:21:08,957::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:21:08,957::task::1168::TaskManager.Task::(prepare) Task=`6bd28669-21f2-4c9e-99c3-d29689db6422`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:21:08,958::task::579::TaskManager.Task::(_updateState) Task=`6bd28669-21f2-4c9e-99c3-d29689db6422`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:21:08,958::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:21:08,958::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:21:08,958::task::974::TaskManager.Task::(_decref) Task=`6bd28669-21f2-4c9e-99c3-d29689db6422`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:21:08,964::task::579::TaskManager.Task::(_updateState) Task=`6bec44dd-c1e7-44ed-96e8-3721df829c3d`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:21:08,964::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:21:08,965::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:21:08,965::task::1168::TaskManager.Task::(prepare) Task=`6bec44dd-c1e7-44ed-96e8-3721df829c3d`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:21:08,966::task::579::TaskManager.Task::(_updateState) Task=`6bec44dd-c1e7-44ed-96e8-3721df829c3d`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:21:08,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:21:08,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:21:08,967::task::974::TaskManager.Task::(_decref) Task=`6bec44dd-c1e7-44ed-96e8-3721df829c3d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:09,054::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:21:09,054::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287989::DEBUG::2014-01-16 17:21:09,583::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287989::DEBUG::2014-01-16 17:21:09,585::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.57', 'elapsedTime': '320', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:10,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:21:10,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:21:10,056::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:21:10,057::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:10,241::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16399::DEBUG::2014-01-16 17:21:11,040::task::579::TaskManager.Task::(_updateState) Task=`9611f788-6aa3-467a-8e58-e4fb4d6bf9c6`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:21:11,040::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:21:11,041::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:21:11,042::task::1168::TaskManager.Task::(prepare) Task=`9611f788-6aa3-467a-8e58-e4fb4d6bf9c6`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:21:11,042::task::579::TaskManager.Task::(_updateState) Task=`9611f788-6aa3-467a-8e58-e4fb4d6bf9c6`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:21:11,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:21:11,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:21:11,042::task::974::TaskManager.Task::(_decref) Task=`9611f788-6aa3-467a-8e58-e4fb4d6bf9c6`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:21:11,042::task::579::TaskManager.Task::(_updateState) Task=`33625216-a73e-4df1-88b9-3fe8e46fce36`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:21:11,043::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:21:11,043::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:21:11,043::task::1168::TaskManager.Task::(prepare) Task=`33625216-a73e-4df1-88b9-3fe8e46fce36`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:21:11,043::task::579::TaskManager.Task::(_updateState) Task=`33625216-a73e-4df1-88b9-3fe8e46fce36`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:21:11,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:21:11,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:21:11,044::task::974::TaskManager.Task::(_decref) Task=`33625216-a73e-4df1-88b9-3fe8e46fce36`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:11,057::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:12,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:21:12,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:21:12,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:21:12,059::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:12,059::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:21:12,060::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:21:12,243::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287990::DEBUG::2014-01-16 17:21:12,669::task::579::TaskManager.Task::(_updateState) Task=`70e5907e-e086-4db1-831b-d207b7b3844d`::moving from state init -> state preparing >Thread-287990::INFO::2014-01-16 17:21:12,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-287990::INFO::2014-01-16 17:21:12,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306701', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020798', 'lastCheck': '4.2', 'valid': True}} >Thread-287990::DEBUG::2014-01-16 17:21:12,670::task::1168::TaskManager.Task::(prepare) Task=`70e5907e-e086-4db1-831b-d207b7b3844d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306701', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020798', 'lastCheck': '4.2', 'valid': True}} >Thread-287990::DEBUG::2014-01-16 17:21:12,670::task::579::TaskManager.Task::(_updateState) Task=`70e5907e-e086-4db1-831b-d207b7b3844d`::moving from state preparing -> state finished >Thread-287990::DEBUG::2014-01-16 17:21:12,670::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287990::DEBUG::2014-01-16 17:21:12,670::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287990::DEBUG::2014-01-16 17:21:12,671::task::974::TaskManager.Task::(_decref) Task=`70e5907e-e086-4db1-831b-d207b7b3844d`::ref 0 aborting False >Thread-131629::DEBUG::2014-01-16 17:21:12,939::task::579::TaskManager.Task::(_updateState) Task=`307b8521-aa4f-43bc-99ec-c9acb4a29fd8`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:21:12,939::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:21:12,940::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:21:12,940::task::1168::TaskManager.Task::(prepare) Task=`307b8521-aa4f-43bc-99ec-c9acb4a29fd8`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:21:12,940::task::579::TaskManager.Task::(_updateState) Task=`307b8521-aa4f-43bc-99ec-c9acb4a29fd8`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:21:12,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:21:12,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:21:12,940::task::974::TaskManager.Task::(_decref) Task=`307b8521-aa4f-43bc-99ec-c9acb4a29fd8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:13,062::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:13,244::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:21:13,352::task::579::TaskManager.Task::(_updateState) Task=`7533e843-8a06-4df0-863f-33f4241e7bc6`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:21:13,352::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:21:13,353::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:21:13,353::task::1168::TaskManager.Task::(prepare) Task=`7533e843-8a06-4df0-863f-33f4241e7bc6`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:21:13,353::task::579::TaskManager.Task::(_updateState) Task=`7533e843-8a06-4df0-863f-33f4241e7bc6`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:21:13,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:21:13,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:21:13,353::task::974::TaskManager.Task::(_decref) Task=`7533e843-8a06-4df0-863f-33f4241e7bc6`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:21:13,354::task::579::TaskManager.Task::(_updateState) Task=`09e49df3-420d-44aa-882c-742ae31bd3ef`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:21:13,354::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:21:13,354::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:21:13,354::task::1168::TaskManager.Task::(prepare) Task=`09e49df3-420d-44aa-882c-742ae31bd3ef`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:21:13,354::task::579::TaskManager.Task::(_updateState) Task=`09e49df3-420d-44aa-882c-742ae31bd3ef`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:21:13,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:21:13,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:21:13,355::task::974::TaskManager.Task::(_decref) Task=`09e49df3-420d-44aa-882c-742ae31bd3ef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:14,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:21:14,063::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:21:14,064::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:14,245::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:15,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:21:15,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:21:15,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:16,067::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:21:16,067::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:21:16,067::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:21:16,067::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287993::DEBUG::2014-01-16 17:21:16,237::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287993::DEBUG::2014-01-16 17:21:16,238::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.23', 'elapsedTime': '327', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:21:16,247::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:21:16,351::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:21:16,356::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:21:16,357::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:21:16,362::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:21:16,363::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:21:16,364::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:21:16,364::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 17:21:16,371::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:21:16,387::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000315761 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:21:16,573::task::579::TaskManager.Task::(_updateState) Task=`13a28533-5dc7-4759-a983-c189a19530b3`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:21:16,574::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:21:16,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:21:16,574::task::1168::TaskManager.Task::(prepare) Task=`13a28533-5dc7-4759-a983-c189a19530b3`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:21:16,574::task::579::TaskManager.Task::(_updateState) Task=`13a28533-5dc7-4759-a983-c189a19530b3`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:21:16,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:21:16,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:21:16,575::task::974::TaskManager.Task::(_decref) Task=`13a28533-5dc7-4759-a983-c189a19530b3`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:21:16,892::task::579::TaskManager.Task::(_updateState) Task=`97939887-751e-4484-a9db-7b4a9146d500`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:21:16,892::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:21:16,892::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:21:16,893::task::1168::TaskManager.Task::(prepare) Task=`97939887-751e-4484-a9db-7b4a9146d500`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:21:16,893::task::579::TaskManager.Task::(_updateState) Task=`97939887-751e-4484-a9db-7b4a9146d500`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:21:16,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:21:16,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:21:16,893::task::974::TaskManager.Task::(_decref) Task=`97939887-751e-4484-a9db-7b4a9146d500`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:17,068::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:18,069::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:21:18,070::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:18,248::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:18,249::task::579::TaskManager.Task::(_updateState) Task=`f70d3e31-4fa4-4c66-a4bb-44e9460f24dc`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:21:18,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:21:18,249::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:21:18,249::task::1168::TaskManager.Task::(prepare) Task=`f70d3e31-4fa4-4c66-a4bb-44e9460f24dc`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:21:18,250::task::579::TaskManager.Task::(_updateState) Task=`f70d3e31-4fa4-4c66-a4bb-44e9460f24dc`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:21:18,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:21:18,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:21:18,250::task::974::TaskManager.Task::(_decref) Task=`f70d3e31-4fa4-4c66-a4bb-44e9460f24dc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:21:18,252::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:21:18,252::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:21:18,254::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:18,256::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:18,257::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 17:21:18,367::task::579::TaskManager.Task::(_updateState) Task=`d21c2df6-ecd8-4f53-9de3-05dfef9ee31a`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:21:18,367::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:21:18,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:21:18,368::task::1168::TaskManager.Task::(prepare) Task=`d21c2df6-ecd8-4f53-9de3-05dfef9ee31a`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:21:18,368::task::579::TaskManager.Task::(_updateState) Task=`d21c2df6-ecd8-4f53-9de3-05dfef9ee31a`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:21:18,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:21:18,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:21:18,368::task::974::TaskManager.Task::(_decref) Task=`d21c2df6-ecd8-4f53-9de3-05dfef9ee31a`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:21:18,475::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:21:18,492::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000398133 s, 10.3 MB/s\n'; <rc> = 0 >Thread-84402::DEBUG::2014-01-16 17:21:18,923::task::579::TaskManager.Task::(_updateState) Task=`3503af10-bc07-4de4-9b14-44c7c34d2a22`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:21:18,924::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:21:18,924::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:21:18,924::task::1168::TaskManager.Task::(prepare) Task=`3503af10-bc07-4de4-9b14-44c7c34d2a22`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:21:18,924::task::579::TaskManager.Task::(_updateState) Task=`3503af10-bc07-4de4-9b14-44c7c34d2a22`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:21:18,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:21:18,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:21:18,925::task::974::TaskManager.Task::(_decref) Task=`3503af10-bc07-4de4-9b14-44c7c34d2a22`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:19,071::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:21:19,324::task::579::TaskManager.Task::(_updateState) Task=`0cba3ad2-418f-4dfc-a58b-18c0e764cf01`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:21:19,324::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:21:19,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:21:19,325::task::1168::TaskManager.Task::(prepare) Task=`0cba3ad2-418f-4dfc-a58b-18c0e764cf01`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:21:19,325::task::579::TaskManager.Task::(_updateState) Task=`0cba3ad2-418f-4dfc-a58b-18c0e764cf01`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:21:19,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:21:19,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:21:19,325::task::974::TaskManager.Task::(_decref) Task=`0cba3ad2-418f-4dfc-a58b-18c0e764cf01`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:21:19,326::task::579::TaskManager.Task::(_updateState) Task=`1067c34f-cef9-40e3-a897-f42ae87acbd1`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:21:19,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:21:19,326::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:21:19,326::task::1168::TaskManager.Task::(prepare) Task=`1067c34f-cef9-40e3-a897-f42ae87acbd1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:21:19,326::task::579::TaskManager.Task::(_updateState) Task=`1067c34f-cef9-40e3-a897-f42ae87acbd1`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:21:19,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:21:19,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:21:19,327::task::974::TaskManager.Task::(_decref) Task=`1067c34f-cef9-40e3-a897-f42ae87acbd1`::ref 0 aborting False >Thread-287996::DEBUG::2014-01-16 17:21:19,344::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287996::DEBUG::2014-01-16 17:21:19,345::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.09', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.33', 'elapsedTime': '330', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:20,073::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:20,258::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:21:20,580::task::579::TaskManager.Task::(_updateState) Task=`00f8c928-6aca-4857-b230-95f20c4a66a6`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:21:20,581::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:21:20,581::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:21:20,581::task::1168::TaskManager.Task::(prepare) Task=`00f8c928-6aca-4857-b230-95f20c4a66a6`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:21:20,581::task::579::TaskManager.Task::(_updateState) Task=`00f8c928-6aca-4857-b230-95f20c4a66a6`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:21:20,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:21:20,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:21:20,582::task::974::TaskManager.Task::(_decref) Task=`00f8c928-6aca-4857-b230-95f20c4a66a6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:21,074::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:22,075::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:22,259::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-287998::DEBUG::2014-01-16 17:21:22,442::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-287998::DEBUG::2014-01-16 17:21:22,444::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'elapsedTime': '333', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-227488::DEBUG::2014-01-16 17:21:23,003::task::579::TaskManager.Task::(_updateState) Task=`10e8a185-082f-44c8-b994-9b3cf49ce62b`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:21:23,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:21:23,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:21:23,004::task::1168::TaskManager.Task::(prepare) Task=`10e8a185-082f-44c8-b994-9b3cf49ce62b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:21:23,004::task::579::TaskManager.Task::(_updateState) Task=`10e8a185-082f-44c8-b994-9b3cf49ce62b`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:21:23,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:21:23,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:21:23,005::task::974::TaskManager.Task::(_decref) Task=`10e8a185-082f-44c8-b994-9b3cf49ce62b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:23,076::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:21:23,076::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:23,260::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:24,078::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:21:24,078::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:24,262::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:25,079::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288000::DEBUG::2014-01-16 17:21:25,572::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288000::DEBUG::2014-01-16 17:21:25,573::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.56', 'elapsedTime': '336', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-49313::DEBUG::2014-01-16 17:21:25,874::task::579::TaskManager.Task::(_updateState) Task=`93a51844-2dc4-40fd-93e7-35be79b9c2f8`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:21:25,874::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:21:25,874::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:21:25,875::task::1168::TaskManager.Task::(prepare) Task=`93a51844-2dc4-40fd-93e7-35be79b9c2f8`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:21:25,875::task::579::TaskManager.Task::(_updateState) Task=`93a51844-2dc4-40fd-93e7-35be79b9c2f8`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:21:25,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:21:25,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:21:25,875::task::974::TaskManager.Task::(_decref) Task=`93a51844-2dc4-40fd-93e7-35be79b9c2f8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:26,081::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:26,263::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:21:26,395::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:21:26,412::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00025787 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:21:27,082::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:21:27,530::task::579::TaskManager.Task::(_updateState) Task=`1be22f0f-d779-4bb8-9687-0cdd2e376f85`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:21:27,530::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:21:27,530::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:21:27,530::task::1168::TaskManager.Task::(prepare) Task=`1be22f0f-d779-4bb8-9687-0cdd2e376f85`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:21:27,531::task::579::TaskManager.Task::(_updateState) Task=`1be22f0f-d779-4bb8-9687-0cdd2e376f85`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:21:27,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:21:27,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:21:27,531::task::974::TaskManager.Task::(_decref) Task=`1be22f0f-d779-4bb8-9687-0cdd2e376f85`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:21:27,531::task::579::TaskManager.Task::(_updateState) Task=`aa9cefe0-2dd6-4e05-83dd-baa3bcf19c24`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:21:27,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:21:27,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:21:27,532::task::1168::TaskManager.Task::(prepare) Task=`aa9cefe0-2dd6-4e05-83dd-baa3bcf19c24`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:21:27,532::task::579::TaskManager.Task::(_updateState) Task=`aa9cefe0-2dd6-4e05-83dd-baa3bcf19c24`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:21:27,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:21:27,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:21:27,532::task::974::TaskManager.Task::(_decref) Task=`aa9cefe0-2dd6-4e05-83dd-baa3bcf19c24`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:21:27,533::task::579::TaskManager.Task::(_updateState) Task=`dce8fec5-efd1-4b2a-b282-22263496ce34`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:21:27,533::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:21:27,533::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:21:27,533::task::1168::TaskManager.Task::(prepare) Task=`dce8fec5-efd1-4b2a-b282-22263496ce34`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:21:27,533::task::579::TaskManager.Task::(_updateState) Task=`dce8fec5-efd1-4b2a-b282-22263496ce34`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:21:27,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:21:27,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:21:27,534::task::974::TaskManager.Task::(_decref) Task=`dce8fec5-efd1-4b2a-b282-22263496ce34`::ref 0 aborting False >Thread-15207::DEBUG::2014-01-16 17:21:27,929::task::579::TaskManager.Task::(_updateState) Task=`0f30d2f9-1e17-42df-ab28-d80d7be2c052`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:21:27,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:21:27,930::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:21:27,930::task::1168::TaskManager.Task::(prepare) Task=`0f30d2f9-1e17-42df-ab28-d80d7be2c052`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:21:27,930::task::579::TaskManager.Task::(_updateState) Task=`0f30d2f9-1e17-42df-ab28-d80d7be2c052`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:21:27,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:21:27,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:21:27,930::task::974::TaskManager.Task::(_decref) Task=`0f30d2f9-1e17-42df-ab28-d80d7be2c052`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:28,084::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:28,265::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:28,266::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:21:28,497::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:21:28,517::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000254819 s, 16.1 MB/s\n'; <rc> = 0 >Thread-288001::DEBUG::2014-01-16 17:21:28,632::task::579::TaskManager.Task::(_updateState) Task=`791ac175-0762-43ef-9859-8763fa1fbe98`::moving from state init -> state preparing >Thread-288001::INFO::2014-01-16 17:21:28,632::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288001::INFO::2014-01-16 17:21:28,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025787', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254819', 'lastCheck': '0.1', 'valid': True}} >Thread-288001::DEBUG::2014-01-16 17:21:28,633::task::1168::TaskManager.Task::(prepare) Task=`791ac175-0762-43ef-9859-8763fa1fbe98`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025787', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254819', 'lastCheck': '0.1', 'valid': True}} >Thread-288001::DEBUG::2014-01-16 17:21:28,633::task::579::TaskManager.Task::(_updateState) Task=`791ac175-0762-43ef-9859-8763fa1fbe98`::moving from state preparing -> state finished >Thread-288001::DEBUG::2014-01-16 17:21:28,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288001::DEBUG::2014-01-16 17:21:28,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288001::DEBUG::2014-01-16 17:21:28,633::task::974::TaskManager.Task::(_decref) Task=`791ac175-0762-43ef-9859-8763fa1fbe98`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:29,085::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:21:29,085::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:21:29,085::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:30,087::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:21:30,087::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:30,267::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:31,088::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:21:31,089::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:21:31,089::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:32,089::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:21:32,090::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288004::DEBUG::2014-01-16 17:21:32,172::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288004::DEBUG::2014-01-16 17:21:32,173::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.16', 'elapsedTime': '343', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:21:32,268::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:33,091::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:21:33,091::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:33,270::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:21:33,271::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:21:33,272::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:21:33,499::task::579::TaskManager.Task::(_updateState) Task=`0137fa71-c4ea-476f-b153-471729df24a5`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:21:33,499::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:21:33,499::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:21:33,499::task::1168::TaskManager.Task::(prepare) Task=`0137fa71-c4ea-476f-b153-471729df24a5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:21:33,500::task::579::TaskManager.Task::(_updateState) Task=`0137fa71-c4ea-476f-b153-471729df24a5`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:21:33,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:21:33,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:21:33,500::task::974::TaskManager.Task::(_decref) Task=`0137fa71-c4ea-476f-b153-471729df24a5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:34,092::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:34,273::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:35,093::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:21:35,094::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288006::DEBUG::2014-01-16 17:21:35,269::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288006::DEBUG::2014-01-16 17:21:35,270::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.45', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.25', 'elapsedTime': '346', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:36,095::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:21:36,095::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:36,274::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:21:36,419::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:21:36,436::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000295877 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:21:37,096::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:21:37,097::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:21:37,097::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:21:37,097::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:21:37,507::task::579::TaskManager.Task::(_updateState) Task=`fc8cdf8d-6fd1-4835-aceb-c74dec4751ba`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:21:37,507::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:21:37,507::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:21:37,508::task::1168::TaskManager.Task::(prepare) Task=`fc8cdf8d-6fd1-4835-aceb-c74dec4751ba`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:21:37,508::task::579::TaskManager.Task::(_updateState) Task=`fc8cdf8d-6fd1-4835-aceb-c74dec4751ba`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:21:37,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:21:37,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:21:37,508::task::974::TaskManager.Task::(_decref) Task=`fc8cdf8d-6fd1-4835-aceb-c74dec4751ba`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:21:37,513::task::579::TaskManager.Task::(_updateState) Task=`16fb6a5d-ab2a-48ba-8f28-283fa3856e37`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:21:37,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:21:37,514::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:21:37,514::task::1168::TaskManager.Task::(prepare) Task=`16fb6a5d-ab2a-48ba-8f28-283fa3856e37`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:21:37,514::task::579::TaskManager.Task::(_updateState) Task=`16fb6a5d-ab2a-48ba-8f28-283fa3856e37`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:21:37,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:21:37,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:21:37,515::task::974::TaskManager.Task::(_decref) Task=`16fb6a5d-ab2a-48ba-8f28-283fa3856e37`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:38,099::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:21:38,099::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:21:38,099::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:38,275::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:38,277::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288008::DEBUG::2014-01-16 17:21:38,375::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288008::DEBUG::2014-01-16 17:21:38,377::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.35', 'elapsedTime': '349', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:21:38,523::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:21:38,543::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000246789 s, 16.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:21:39,101::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:21:39,101::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:40,102::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:21:40,102::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:21:40,103::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:21:40,103::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:40,278::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:41,104::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288010::DEBUG::2014-01-16 17:21:41,548::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288010::DEBUG::2014-01-16 17:21:41,549::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.53', 'elapsedTime': '352', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-48925::DEBUG::2014-01-16 17:21:41,728::task::579::TaskManager.Task::(_updateState) Task=`53fe569d-78bd-42b0-a5ea-c7c27c67ec20`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:21:41,729::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:21:41,729::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:21:41,729::task::1168::TaskManager.Task::(prepare) Task=`53fe569d-78bd-42b0-a5ea-c7c27c67ec20`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:21:41,729::task::579::TaskManager.Task::(_updateState) Task=`53fe569d-78bd-42b0-a5ea-c7c27c67ec20`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:21:41,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:21:41,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:21:41,730::task::974::TaskManager.Task::(_decref) Task=`53fe569d-78bd-42b0-a5ea-c7c27c67ec20`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:21:41,730::task::579::TaskManager.Task::(_updateState) Task=`8e60f1ce-202e-482b-8fa7-cd3cc52a0b93`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:21:41,730::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:21:41,730::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:21:41,730::task::1168::TaskManager.Task::(prepare) Task=`8e60f1ce-202e-482b-8fa7-cd3cc52a0b93`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:21:41,730::task::579::TaskManager.Task::(_updateState) Task=`8e60f1ce-202e-482b-8fa7-cd3cc52a0b93`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:21:41,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:21:41,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:21:41,731::task::974::TaskManager.Task::(_decref) Task=`8e60f1ce-202e-482b-8fa7-cd3cc52a0b93`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:42,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:21:42,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:21:42,106::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:21:42,106::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:42,106::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:21:42,107::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:21:42,279::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:21:43,058::task::579::TaskManager.Task::(_updateState) Task=`e77507ed-7088-4f4b-87db-3706487c65c3`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:21:43,058::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:21:43,058::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:21:43,059::task::1168::TaskManager.Task::(prepare) Task=`e77507ed-7088-4f4b-87db-3706487c65c3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:21:43,059::task::579::TaskManager.Task::(_updateState) Task=`e77507ed-7088-4f4b-87db-3706487c65c3`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:21:43,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:21:43,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:21:43,059::task::974::TaskManager.Task::(_decref) Task=`e77507ed-7088-4f4b-87db-3706487c65c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:43,108::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:43,281::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:44,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:21:44,109::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:21:44,109::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:44,282::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288011::DEBUG::2014-01-16 17:21:44,647::task::579::TaskManager.Task::(_updateState) Task=`5816e604-7ba8-4555-b16f-c774734b453c`::moving from state init -> state preparing >Thread-288011::INFO::2014-01-16 17:21:44,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288011::INFO::2014-01-16 17:21:44,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295877', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246789', 'lastCheck': '6.1', 'valid': True}} >Thread-288011::DEBUG::2014-01-16 17:21:44,648::task::1168::TaskManager.Task::(prepare) Task=`5816e604-7ba8-4555-b16f-c774734b453c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000295877', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246789', 'lastCheck': '6.1', 'valid': True}} >Thread-288011::DEBUG::2014-01-16 17:21:44,648::task::579::TaskManager.Task::(_updateState) Task=`5816e604-7ba8-4555-b16f-c774734b453c`::moving from state preparing -> state finished >Thread-288011::DEBUG::2014-01-16 17:21:44,648::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288011::DEBUG::2014-01-16 17:21:44,649::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288011::DEBUG::2014-01-16 17:21:44,649::task::974::TaskManager.Task::(_decref) Task=`5816e604-7ba8-4555-b16f-c774734b453c`::ref 0 aborting False >Thread-3168::DEBUG::2014-01-16 17:21:44,839::task::579::TaskManager.Task::(_updateState) Task=`dadb9448-fe62-4093-8f56-8d91dd9ef09e`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:21:44,839::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:21:44,840::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:21:44,840::task::1168::TaskManager.Task::(prepare) Task=`dadb9448-fe62-4093-8f56-8d91dd9ef09e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:21:44,840::task::579::TaskManager.Task::(_updateState) Task=`dadb9448-fe62-4093-8f56-8d91dd9ef09e`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:21:44,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:21:44,840::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:21:44,840::task::974::TaskManager.Task::(_decref) Task=`dadb9448-fe62-4093-8f56-8d91dd9ef09e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:45,110::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:21:45,111::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:21:45,111::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:46,112::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:21:46,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:21:46,113::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:21:46,113::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16398::DEBUG::2014-01-16 17:21:46,173::task::579::TaskManager.Task::(_updateState) Task=`8727af21-1374-451c-ad78-c0104208e663`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:21:46,173::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:21:46,174::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:21:46,174::task::1168::TaskManager.Task::(prepare) Task=`8727af21-1374-451c-ad78-c0104208e663`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:21:46,174::task::579::TaskManager.Task::(_updateState) Task=`8727af21-1374-451c-ad78-c0104208e663`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:21:46,174::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:21:46,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:21:46,174::task::974::TaskManager.Task::(_decref) Task=`8727af21-1374-451c-ad78-c0104208e663`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:21:46,235::task::579::TaskManager.Task::(_updateState) Task=`a8263762-28d0-47f8-b308-30788362d23e`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:21:46,235::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:21:46,236::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:21:46,236::task::1168::TaskManager.Task::(prepare) Task=`a8263762-28d0-47f8-b308-30788362d23e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:21:46,236::task::579::TaskManager.Task::(_updateState) Task=`a8263762-28d0-47f8-b308-30788362d23e`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:21:46,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:21:46,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:21:46,237::task::974::TaskManager.Task::(_decref) Task=`a8263762-28d0-47f8-b308-30788362d23e`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:21:46,241::task::579::TaskManager.Task::(_updateState) Task=`ff5ba18c-402e-4603-803b-7018cacedab8`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:21:46,241::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:21:46,241::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:21:46,241::task::1168::TaskManager.Task::(prepare) Task=`ff5ba18c-402e-4603-803b-7018cacedab8`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:21:46,242::task::579::TaskManager.Task::(_updateState) Task=`ff5ba18c-402e-4603-803b-7018cacedab8`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:21:46,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:21:46,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:21:46,242::task::974::TaskManager.Task::(_decref) Task=`ff5ba18c-402e-4603-803b-7018cacedab8`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:21:46,283::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:21:46,443::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:21:46,460::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000307666 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12152::DEBUG::2014-01-16 17:21:47,047::task::579::TaskManager.Task::(_updateState) Task=`9d30cdbc-b949-4dd9-b061-d9bf292f304c`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:21:47,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:21:47,048::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:21:47,048::task::1168::TaskManager.Task::(prepare) Task=`9d30cdbc-b949-4dd9-b061-d9bf292f304c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:21:47,048::task::579::TaskManager.Task::(_updateState) Task=`9d30cdbc-b949-4dd9-b061-d9bf292f304c`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:21:47,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:21:47,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:21:47,049::task::974::TaskManager.Task::(_decref) Task=`9d30cdbc-b949-4dd9-b061-d9bf292f304c`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:21:47,054::task::579::TaskManager.Task::(_updateState) Task=`8754be6e-2957-4472-aca5-d2c0744cf2ae`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:21:47,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:21:47,055::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:21:47,055::task::1168::TaskManager.Task::(prepare) Task=`8754be6e-2957-4472-aca5-d2c0744cf2ae`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:21:47,055::task::579::TaskManager.Task::(_updateState) Task=`8754be6e-2957-4472-aca5-d2c0744cf2ae`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:21:47,055::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:21:47,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:21:47,055::task::974::TaskManager.Task::(_decref) Task=`8754be6e-2957-4472-aca5-d2c0744cf2ae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:47,115::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:48,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:21:48,117::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:48,284::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:48,287::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:21:48,287::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:21:48,289::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:21:48,548::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:21:48,566::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000242658 s, 16.9 MB/s\n'; <rc> = 0 >Thread-288014::DEBUG::2014-01-16 17:21:48,647::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288014::DEBUG::2014-01-16 17:21:48,648::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.62', 'elapsedTime': '359', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:49,118::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:50,120::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:50,290::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:51,121::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288016::DEBUG::2014-01-16 17:21:51,777::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288016::DEBUG::2014-01-16 17:21:51,779::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.75', 'elapsedTime': '362', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-287783::DEBUG::2014-01-16 17:21:52,024::task::579::TaskManager.Task::(_updateState) Task=`1d57c310-f59f-4ce3-ac03-2233be8cac0a`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:21:52,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:21:52,025::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:21:52,025::task::1168::TaskManager.Task::(prepare) Task=`1d57c310-f59f-4ce3-ac03-2233be8cac0a`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:21:52,025::task::579::TaskManager.Task::(_updateState) Task=`1d57c310-f59f-4ce3-ac03-2233be8cac0a`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:21:52,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:21:52,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:21:52,026::task::974::TaskManager.Task::(_decref) Task=`1d57c310-f59f-4ce3-ac03-2233be8cac0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:21:52,122::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:52,292::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:53,123::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:21:53,124::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:53,293::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:21:54,125::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:21:54,125::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:21:54,175::task::579::TaskManager.Task::(_updateState) Task=`22825145-3ced-4938-8a7b-8bc88ecec290`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:21:54,176::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:21:54,176::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:21:54,176::task::1168::TaskManager.Task::(prepare) Task=`22825145-3ced-4938-8a7b-8bc88ecec290`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:21:54,176::task::579::TaskManager.Task::(_updateState) Task=`22825145-3ced-4938-8a7b-8bc88ecec290`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:21:54,176::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:21:54,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:21:54,177::task::974::TaskManager.Task::(_decref) Task=`22825145-3ced-4938-8a7b-8bc88ecec290`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:21:54,294::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:21:54,595::task::579::TaskManager.Task::(_updateState) Task=`a05b47b7-60b9-4cef-b7cf-bb92a51748f3`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:21:54,595::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:21:54,596::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:21:54,596::task::1168::TaskManager.Task::(prepare) Task=`a05b47b7-60b9-4cef-b7cf-bb92a51748f3`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:21:54,596::task::579::TaskManager.Task::(_updateState) Task=`a05b47b7-60b9-4cef-b7cf-bb92a51748f3`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:21:54,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:21:54,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:21:54,597::task::974::TaskManager.Task::(_decref) Task=`a05b47b7-60b9-4cef-b7cf-bb92a51748f3`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:21:54,597::task::579::TaskManager.Task::(_updateState) Task=`dfccdd72-bb24-4134-8998-267492594359`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:21:54,597::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:21:54,598::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:21:54,598::task::1168::TaskManager.Task::(prepare) Task=`dfccdd72-bb24-4134-8998-267492594359`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:21:54,598::task::579::TaskManager.Task::(_updateState) Task=`dfccdd72-bb24-4134-8998-267492594359`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:21:54,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:21:54,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:21:54,598::task::974::TaskManager.Task::(_decref) Task=`dfccdd72-bb24-4134-8998-267492594359`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:21:54,599::task::579::TaskManager.Task::(_updateState) Task=`f80542da-19a6-48b3-b9d5-800be03eb6f0`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:21:54,599::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:21:54,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:21:54,599::task::1168::TaskManager.Task::(prepare) Task=`f80542da-19a6-48b3-b9d5-800be03eb6f0`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:21:54,599::task::579::TaskManager.Task::(_updateState) Task=`f80542da-19a6-48b3-b9d5-800be03eb6f0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:21:54,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:21:54,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:21:54,600::task::974::TaskManager.Task::(_decref) Task=`f80542da-19a6-48b3-b9d5-800be03eb6f0`::ref 0 aborting False >Thread-288018::DEBUG::2014-01-16 17:21:54,908::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288018::DEBUG::2014-01-16 17:21:54,909::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.84', 'elapsedTime': '365', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:55,126::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:21:56,127::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:56,295::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:21:56,467::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:21:56,484::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000284748 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:21:57,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288020::DEBUG::2014-01-16 17:21:58,033::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288020::DEBUG::2014-01-16 17:21:58,035::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.96', 'elapsedTime': '369', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:21:58,128::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:21:58,297::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:21:58,298::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:21:58,572::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:21:58,589::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000313092 s, 13.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:21:59,129::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:21:59,130::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:21:59,130::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:21:59,358::task::579::TaskManager.Task::(_updateState) Task=`22395751-20a7-461a-a8fa-4101c8df661f`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:21:59,359::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:21:59,359::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:21:59,359::task::1168::TaskManager.Task::(prepare) Task=`22395751-20a7-461a-a8fa-4101c8df661f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:21:59,359::task::579::TaskManager.Task::(_updateState) Task=`22395751-20a7-461a-a8fa-4101c8df661f`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:21:59,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:21:59,360::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:21:59,360::task::974::TaskManager.Task::(_decref) Task=`22395751-20a7-461a-a8fa-4101c8df661f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:00,131::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:22:00,131::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:00,299::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:01,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:22:01,133::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:22:01,133::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288021::DEBUG::2014-01-16 17:22:01,142::task::579::TaskManager.Task::(_updateState) Task=`ef6624cd-7ea2-46d1-ace1-50b81d89c64c`::moving from state init -> state preparing >Thread-288021::INFO::2014-01-16 17:22:01,142::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288021::INFO::2014-01-16 17:22:01,142::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284748', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313092', 'lastCheck': '2.5', 'valid': True}} >Thread-288021::DEBUG::2014-01-16 17:22:01,142::task::1168::TaskManager.Task::(prepare) Task=`ef6624cd-7ea2-46d1-ace1-50b81d89c64c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000284748', 'lastCheck': '4.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313092', 'lastCheck': '2.5', 'valid': True}} >Thread-288021::DEBUG::2014-01-16 17:22:01,143::task::579::TaskManager.Task::(_updateState) Task=`ef6624cd-7ea2-46d1-ace1-50b81d89c64c`::moving from state preparing -> state finished >Thread-288021::DEBUG::2014-01-16 17:22:01,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288021::DEBUG::2014-01-16 17:22:01,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288021::DEBUG::2014-01-16 17:22:01,143::task::974::TaskManager.Task::(_decref) Task=`ef6624cd-7ea2-46d1-ace1-50b81d89c64c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:02,134::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:22:02,134::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:02,301::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:03,135::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:22:03,136::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:03,303::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:22:03,303::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:22:03,305::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:04,137::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:04,306::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288024::DEBUG::2014-01-16 17:22:04,910::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288024::DEBUG::2014-01-16 17:22:04,912::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.84', 'elapsedTime': '375', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:05,138::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:22:05,138::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:06,140::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:22:06,140::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84941::DEBUG::2014-01-16 17:22:06,220::task::579::TaskManager.Task::(_updateState) Task=`68cd1dfd-3baa-4d8d-8c10-9bb9c2e4687f`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:22:06,220::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:22:06,220::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:22:06,221::task::1168::TaskManager.Task::(prepare) Task=`68cd1dfd-3baa-4d8d-8c10-9bb9c2e4687f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:22:06,221::task::579::TaskManager.Task::(_updateState) Task=`68cd1dfd-3baa-4d8d-8c10-9bb9c2e4687f`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:22:06,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:22:06,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:22:06,221::task::974::TaskManager.Task::(_decref) Task=`68cd1dfd-3baa-4d8d-8c10-9bb9c2e4687f`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:22:06,307::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:22:06,491::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:22:06,507::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290942 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:07,141::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:22:07,142::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:22:07,142::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:22:07,142::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288026::DEBUG::2014-01-16 17:22:08,067::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288026::DEBUG::2014-01-16 17:22:08,069::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.00', 'elapsedTime': '379', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:08,143::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:22:08,143::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:22:08,144::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:08,309::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:08,310::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:22:08,596::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:22:08,612::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000252795 s, 16.2 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 17:22:09,027::task::579::TaskManager.Task::(_updateState) Task=`9f11816d-ec27-469e-b626-23a0cb36df8d`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:22:09,028::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:22:09,028::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:22:09,028::task::1168::TaskManager.Task::(prepare) Task=`9f11816d-ec27-469e-b626-23a0cb36df8d`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:22:09,028::task::579::TaskManager.Task::(_updateState) Task=`9f11816d-ec27-469e-b626-23a0cb36df8d`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:22:09,029::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:22:09,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:22:09,029::task::974::TaskManager.Task::(_decref) Task=`9f11816d-ec27-469e-b626-23a0cb36df8d`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:22:09,038::task::579::TaskManager.Task::(_updateState) Task=`bfd1ce14-4500-49c6-beab-87e21c347ef4`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:22:09,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:22:09,039::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:22:09,039::task::1168::TaskManager.Task::(prepare) Task=`bfd1ce14-4500-49c6-beab-87e21c347ef4`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:22:09,040::task::579::TaskManager.Task::(_updateState) Task=`bfd1ce14-4500-49c6-beab-87e21c347ef4`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:22:09,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:22:09,040::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:22:09,040::task::974::TaskManager.Task::(_decref) Task=`bfd1ce14-4500-49c6-beab-87e21c347ef4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:09,144::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:22:09,145::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:10,146::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:22:10,146::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:22:10,146::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:22:10,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:10,311::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16399::DEBUG::2014-01-16 17:22:11,133::task::579::TaskManager.Task::(_updateState) Task=`c4b05042-d092-4ec8-8e50-c2d487fdee89`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:22:11,135::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:22:11,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:22:11,136::task::1168::TaskManager.Task::(prepare) Task=`c4b05042-d092-4ec8-8e50-c2d487fdee89`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:22:11,136::task::579::TaskManager.Task::(_updateState) Task=`c4b05042-d092-4ec8-8e50-c2d487fdee89`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:22:11,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:22:11,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:22:11,137::task::974::TaskManager.Task::(_decref) Task=`c4b05042-d092-4ec8-8e50-c2d487fdee89`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:22:11,137::task::579::TaskManager.Task::(_updateState) Task=`705352ff-2b91-492f-8d83-58fe4ede83aa`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:22:11,137::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:22:11,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:22:11,137::task::1168::TaskManager.Task::(prepare) Task=`705352ff-2b91-492f-8d83-58fe4ede83aa`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:22:11,138::task::579::TaskManager.Task::(_updateState) Task=`705352ff-2b91-492f-8d83-58fe4ede83aa`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:22:11,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:22:11,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:22:11,138::task::974::TaskManager.Task::(_decref) Task=`705352ff-2b91-492f-8d83-58fe4ede83aa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:11,147::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288028::DEBUG::2014-01-16 17:22:11,179::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288028::DEBUG::2014-01-16 17:22:11,180::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.10', 'elapsedTime': '382', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:12,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:22:12,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:22:12,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:22:12,149::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:12,150::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:22:12,150::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:22:12,313::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:22:13,099::task::579::TaskManager.Task::(_updateState) Task=`14b261c8-9baa-4cbb-97cd-601b128571ac`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:22:13,100::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:22:13,100::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:22:13,100::task::1168::TaskManager.Task::(prepare) Task=`14b261c8-9baa-4cbb-97cd-601b128571ac`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:22:13,100::task::579::TaskManager.Task::(_updateState) Task=`14b261c8-9baa-4cbb-97cd-601b128571ac`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:22:13,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:22:13,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:22:13,101::task::974::TaskManager.Task::(_decref) Task=`14b261c8-9baa-4cbb-97cd-601b128571ac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:13,150::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:13,314::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:22:13,572::task::579::TaskManager.Task::(_updateState) Task=`bc95ccca-8bc4-43ff-ac7e-f79b287061c9`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:22:13,572::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:22:13,572::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:22:13,573::task::1168::TaskManager.Task::(prepare) Task=`bc95ccca-8bc4-43ff-ac7e-f79b287061c9`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:22:13,573::task::579::TaskManager.Task::(_updateState) Task=`bc95ccca-8bc4-43ff-ac7e-f79b287061c9`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:22:13,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:22:13,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:22:13,573::task::974::TaskManager.Task::(_decref) Task=`bc95ccca-8bc4-43ff-ac7e-f79b287061c9`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:22:13,573::task::579::TaskManager.Task::(_updateState) Task=`91bc339a-1f1f-4368-952c-ddc7b7ff2366`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:22:13,574::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:22:13,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:22:13,574::task::1168::TaskManager.Task::(prepare) Task=`91bc339a-1f1f-4368-952c-ddc7b7ff2366`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:22:13,574::task::579::TaskManager.Task::(_updateState) Task=`91bc339a-1f1f-4368-952c-ddc7b7ff2366`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:22:13,574::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:22:13,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:22:13,574::task::974::TaskManager.Task::(_decref) Task=`91bc339a-1f1f-4368-952c-ddc7b7ff2366`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:14,151::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:22:14,152::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:22:14,152::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288030::DEBUG::2014-01-16 17:22:14,297::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288030::DEBUG::2014-01-16 17:22:14,298::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.22', 'elapsedTime': '385', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:22:14,316::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:15,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:22:15,153::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:22:15,153::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:16,154::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:22:16,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:22:16,155::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:22:16,155::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:16,317::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:22:16,515::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:22:16,532::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000312521 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:22:16,719::task::579::TaskManager.Task::(_updateState) Task=`2444388f-b2c4-44bc-b479-e899714f1d37`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:22:16,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:22:16,720::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:22:16,720::task::1168::TaskManager.Task::(prepare) Task=`2444388f-b2c4-44bc-b479-e899714f1d37`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:22:16,720::task::579::TaskManager.Task::(_updateState) Task=`2444388f-b2c4-44bc-b479-e899714f1d37`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:22:16,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:22:16,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:22:16,720::task::974::TaskManager.Task::(_decref) Task=`2444388f-b2c4-44bc-b479-e899714f1d37`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:22:17,061::task::579::TaskManager.Task::(_updateState) Task=`77f998b3-9196-4fad-b5f3-649ea1f75eb5`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:22:17,062::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:22:17,062::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:22:17,062::task::1168::TaskManager.Task::(prepare) Task=`77f998b3-9196-4fad-b5f3-649ea1f75eb5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:22:17,062::task::579::TaskManager.Task::(_updateState) Task=`77f998b3-9196-4fad-b5f3-649ea1f75eb5`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:22:17,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:22:17,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:22:17,063::task::974::TaskManager.Task::(_decref) Task=`77f998b3-9196-4fad-b5f3-649ea1f75eb5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:17,157::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288031::DEBUG::2014-01-16 17:22:17,356::task::579::TaskManager.Task::(_updateState) Task=`154f7139-2b31-46e8-b785-b90a966525f9`::moving from state init -> state preparing >Thread-288031::INFO::2014-01-16 17:22:17,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288031::INFO::2014-01-16 17:22:17,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312521', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252795', 'lastCheck': '8.7', 'valid': True}} >Thread-288031::DEBUG::2014-01-16 17:22:17,357::task::1168::TaskManager.Task::(prepare) Task=`154f7139-2b31-46e8-b785-b90a966525f9`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312521', 'lastCheck': '0.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252795', 'lastCheck': '8.7', 'valid': True}} >Thread-288031::DEBUG::2014-01-16 17:22:17,357::task::579::TaskManager.Task::(_updateState) Task=`154f7139-2b31-46e8-b785-b90a966525f9`::moving from state preparing -> state finished >Thread-288031::DEBUG::2014-01-16 17:22:17,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288031::DEBUG::2014-01-16 17:22:17,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288031::DEBUG::2014-01-16 17:22:17,358::task::974::TaskManager.Task::(_decref) Task=`154f7139-2b31-46e8-b785-b90a966525f9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:18,158::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:22:18,158::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:18,319::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:18,319::task::579::TaskManager.Task::(_updateState) Task=`dedb70da-3232-4f10-9e8a-5c5ddadc381e`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:22:18,320::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:22:18,320::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:22:18,320::task::1168::TaskManager.Task::(prepare) Task=`dedb70da-3232-4f10-9e8a-5c5ddadc381e`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:22:18,320::task::579::TaskManager.Task::(_updateState) Task=`dedb70da-3232-4f10-9e8a-5c5ddadc381e`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:22:18,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:22:18,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:22:18,321::task::974::TaskManager.Task::(_decref) Task=`dedb70da-3232-4f10-9e8a-5c5ddadc381e`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:22:18,323::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:22:18,323::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:22:18,324::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:18,326::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:18,327::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 17:22:18,540::task::579::TaskManager.Task::(_updateState) Task=`593eea7b-d98e-4688-af79-feef03310359`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:22:18,540::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:22:18,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:22:18,541::task::1168::TaskManager.Task::(prepare) Task=`593eea7b-d98e-4688-af79-feef03310359`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:22:18,541::task::579::TaskManager.Task::(_updateState) Task=`593eea7b-d98e-4688-af79-feef03310359`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:22:18,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:22:18,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:22:18,541::task::974::TaskManager.Task::(_decref) Task=`593eea7b-d98e-4688-af79-feef03310359`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:22:18,618::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:22:18,638::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000325315 s, 12.6 MB/s\n'; <rc> = 0 >Thread-84402::DEBUG::2014-01-16 17:22:19,087::task::579::TaskManager.Task::(_updateState) Task=`0c3d2635-2d32-44fc-a596-607ee4d62a3c`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:22:19,087::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:22:19,088::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:22:19,088::task::1168::TaskManager.Task::(prepare) Task=`0c3d2635-2d32-44fc-a596-607ee4d62a3c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:22:19,088::task::579::TaskManager.Task::(_updateState) Task=`0c3d2635-2d32-44fc-a596-607ee4d62a3c`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:22:19,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:22:19,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:22:19,088::task::974::TaskManager.Task::(_decref) Task=`0c3d2635-2d32-44fc-a596-607ee4d62a3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:19,159::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:22:19,538::task::579::TaskManager.Task::(_updateState) Task=`1cfa268d-0e64-4480-a63a-09761ec0e165`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:22:19,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:22:19,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:22:19,539::task::1168::TaskManager.Task::(prepare) Task=`1cfa268d-0e64-4480-a63a-09761ec0e165`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:22:19,540::task::579::TaskManager.Task::(_updateState) Task=`1cfa268d-0e64-4480-a63a-09761ec0e165`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:22:19,540::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:22:19,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:22:19,540::task::974::TaskManager.Task::(_decref) Task=`1cfa268d-0e64-4480-a63a-09761ec0e165`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:22:19,540::task::579::TaskManager.Task::(_updateState) Task=`3d192530-9cc7-4424-9167-01e44b3f102c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:22:19,541::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:22:19,541::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:22:19,541::task::1168::TaskManager.Task::(prepare) Task=`3d192530-9cc7-4424-9167-01e44b3f102c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:22:19,541::task::579::TaskManager.Task::(_updateState) Task=`3d192530-9cc7-4424-9167-01e44b3f102c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:22:19,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:22:19,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:22:19,542::task::974::TaskManager.Task::(_decref) Task=`3d192530-9cc7-4424-9167-01e44b3f102c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:20,161::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:20,329::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:22:20,666::task::579::TaskManager.Task::(_updateState) Task=`61b37e33-49d2-4385-87e0-d8ac00eb3261`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:22:20,666::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:22:20,667::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:22:20,667::task::1168::TaskManager.Task::(prepare) Task=`61b37e33-49d2-4385-87e0-d8ac00eb3261`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:22:20,667::task::579::TaskManager.Task::(_updateState) Task=`61b37e33-49d2-4385-87e0-d8ac00eb3261`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:22:20,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:22:20,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:22:20,668::task::974::TaskManager.Task::(_decref) Task=`61b37e33-49d2-4385-87e0-d8ac00eb3261`::ref 0 aborting False >Thread-288034::DEBUG::2014-01-16 17:22:20,980::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288034::DEBUG::2014-01-16 17:22:20,981::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.90', 'elapsedTime': '392', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:21,162::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:22,163::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:22,330::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:23,164::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:22:23,164::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:22:23,184::task::579::TaskManager.Task::(_updateState) Task=`797d6d58-2dd3-4efb-a1f6-732201aa74f0`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:22:23,184::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:22:23,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:22:23,185::task::1168::TaskManager.Task::(prepare) Task=`797d6d58-2dd3-4efb-a1f6-732201aa74f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:22:23,185::task::579::TaskManager.Task::(_updateState) Task=`797d6d58-2dd3-4efb-a1f6-732201aa74f0`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:22:23,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:22:23,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:22:23,185::task::974::TaskManager.Task::(_decref) Task=`797d6d58-2dd3-4efb-a1f6-732201aa74f0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:22:23,332::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288036::DEBUG::2014-01-16 17:22:24,080::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288036::DEBUG::2014-01-16 17:22:24,081::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '2.00', 'elapsedTime': '395', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:24,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:22:24,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:24,334::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:25,166::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:22:26,034::task::579::TaskManager.Task::(_updateState) Task=`052e1757-640e-445f-9edc-d6f876deb019`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:22:26,034::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:22:26,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:22:26,034::task::1168::TaskManager.Task::(prepare) Task=`052e1757-640e-445f-9edc-d6f876deb019`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:22:26,035::task::579::TaskManager.Task::(_updateState) Task=`052e1757-640e-445f-9edc-d6f876deb019`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:22:26,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:22:26,035::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:22:26,035::task::974::TaskManager.Task::(_decref) Task=`052e1757-640e-445f-9edc-d6f876deb019`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:26,167::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:26,335::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:22:26,543::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:22:26,561::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000344983 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:27,169::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288038::DEBUG::2014-01-16 17:22:27,181::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288038::DEBUG::2014-01-16 17:22:27,182::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.10', 'elapsedTime': '398', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-15207::DEBUG::2014-01-16 17:22:27,989::task::579::TaskManager.Task::(_updateState) Task=`bd65fcf7-60bd-41e0-9520-aaa952bc12b5`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:22:27,989::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:22:27,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:22:27,991::task::1168::TaskManager.Task::(prepare) Task=`bd65fcf7-60bd-41e0-9520-aaa952bc12b5`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:22:27,991::task::579::TaskManager.Task::(_updateState) Task=`bd65fcf7-60bd-41e0-9520-aaa952bc12b5`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:22:27,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:22:27,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:22:27,991::task::974::TaskManager.Task::(_decref) Task=`bd65fcf7-60bd-41e0-9520-aaa952bc12b5`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:22:28,089::task::579::TaskManager.Task::(_updateState) Task=`6bf4311a-388f-48ce-8e3a-f35173ae0849`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:22:28,089::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:22:28,089::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:22:28,089::task::1168::TaskManager.Task::(prepare) Task=`6bf4311a-388f-48ce-8e3a-f35173ae0849`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:22:28,090::task::579::TaskManager.Task::(_updateState) Task=`6bf4311a-388f-48ce-8e3a-f35173ae0849`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:22:28,090::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:22:28,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:22:28,090::task::974::TaskManager.Task::(_decref) Task=`6bf4311a-388f-48ce-8e3a-f35173ae0849`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:22:28,090::task::579::TaskManager.Task::(_updateState) Task=`95f96ff7-f8f5-4feb-b421-c7f55f84b6da`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:22:28,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:22:28,091::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:22:28,091::task::1168::TaskManager.Task::(prepare) Task=`95f96ff7-f8f5-4feb-b421-c7f55f84b6da`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:22:28,091::task::579::TaskManager.Task::(_updateState) Task=`95f96ff7-f8f5-4feb-b421-c7f55f84b6da`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:22:28,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:22:28,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:22:28,091::task::974::TaskManager.Task::(_decref) Task=`95f96ff7-f8f5-4feb-b421-c7f55f84b6da`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:22:28,092::task::579::TaskManager.Task::(_updateState) Task=`783b2127-c5cf-4551-b06f-297535e93e43`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:22:28,092::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:22:28,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:22:28,092::task::1168::TaskManager.Task::(prepare) Task=`783b2127-c5cf-4551-b06f-297535e93e43`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:22:28,092::task::579::TaskManager.Task::(_updateState) Task=`783b2127-c5cf-4551-b06f-297535e93e43`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:22:28,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:22:28,093::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:22:28,093::task::974::TaskManager.Task::(_decref) Task=`783b2127-c5cf-4551-b06f-297535e93e43`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:28,170::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:28,337::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:28,338::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:22:28,643::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:22:28,660::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000238149 s, 17.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:29,171::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:22:29,171::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:22:29,171::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:30,173::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:22:30,173::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288040::DEBUG::2014-01-16 17:22:30,279::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288040::DEBUG::2014-01-16 17:22:30,280::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.20', 'elapsedTime': '401', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:22:30,339::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:31,174::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:22:31,175::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:22:31,175::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:32,175::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:22:32,176::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:32,341::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:33,177::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:22:33,177::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:33,343::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:22:33,344::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:22:33,350::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288041::DEBUG::2014-01-16 17:22:33,358::task::579::TaskManager.Task::(_updateState) Task=`8cbab597-1851-48f4-8585-e7747d6a26fa`::moving from state init -> state preparing >Thread-288041::INFO::2014-01-16 17:22:33,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288041::INFO::2014-01-16 17:22:33,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344983', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238149', 'lastCheck': '4.7', 'valid': True}} >Thread-288041::DEBUG::2014-01-16 17:22:33,359::task::1168::TaskManager.Task::(prepare) Task=`8cbab597-1851-48f4-8585-e7747d6a26fa`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344983', 'lastCheck': '6.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238149', 'lastCheck': '4.7', 'valid': True}} >Thread-288041::DEBUG::2014-01-16 17:22:33,359::task::579::TaskManager.Task::(_updateState) Task=`8cbab597-1851-48f4-8585-e7747d6a26fa`::moving from state preparing -> state finished >Thread-288041::DEBUG::2014-01-16 17:22:33,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288041::DEBUG::2014-01-16 17:22:33,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288041::DEBUG::2014-01-16 17:22:33,359::task::974::TaskManager.Task::(_decref) Task=`8cbab597-1851-48f4-8585-e7747d6a26fa`::ref 0 aborting False >Thread-189046::DEBUG::2014-01-16 17:22:33,701::task::579::TaskManager.Task::(_updateState) Task=`61fb30b7-a13b-4796-93f7-e139f43a57b8`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:22:33,701::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:22:33,701::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:22:33,701::task::1168::TaskManager.Task::(prepare) Task=`61fb30b7-a13b-4796-93f7-e139f43a57b8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:22:33,701::task::579::TaskManager.Task::(_updateState) Task=`61fb30b7-a13b-4796-93f7-e139f43a57b8`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:22:33,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:22:33,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:22:33,702::task::974::TaskManager.Task::(_decref) Task=`61fb30b7-a13b-4796-93f7-e139f43a57b8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:34,178::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:34,351::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:35,179::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:22:35,180::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:36,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:22:36,181::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:36,352::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:22:36,568::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:22:36,585::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000281175 s, 1.3 MB/s\n'; <rc> = 0 >Thread-288044::DEBUG::2014-01-16 17:22:36,908::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288044::DEBUG::2014-01-16 17:22:36,910::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.82', 'elapsedTime': '407', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:37,183::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:22:37,183::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:22:37,183::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:22:37,183::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:22:37,684::task::579::TaskManager.Task::(_updateState) Task=`ae9ea17e-31c0-4640-98a8-bd3cf8a236e2`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:22:37,685::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:22:37,685::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:22:37,685::task::1168::TaskManager.Task::(prepare) Task=`ae9ea17e-31c0-4640-98a8-bd3cf8a236e2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:22:37,685::task::579::TaskManager.Task::(_updateState) Task=`ae9ea17e-31c0-4640-98a8-bd3cf8a236e2`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:22:37,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:22:37,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:22:37,686::task::974::TaskManager.Task::(_decref) Task=`ae9ea17e-31c0-4640-98a8-bd3cf8a236e2`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:22:37,707::task::579::TaskManager.Task::(_updateState) Task=`02bc00fe-7725-4098-99c0-0f01a5383e58`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:22:37,707::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:22:37,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:22:37,708::task::1168::TaskManager.Task::(prepare) Task=`02bc00fe-7725-4098-99c0-0f01a5383e58`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:22:37,708::task::579::TaskManager.Task::(_updateState) Task=`02bc00fe-7725-4098-99c0-0f01a5383e58`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:22:37,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:22:37,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:22:37,709::task::974::TaskManager.Task::(_decref) Task=`02bc00fe-7725-4098-99c0-0f01a5383e58`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:38,185::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:22:38,185::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:22:38,185::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:38,354::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:38,355::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:22:38,671::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:22:38,692::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267862 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:39,186::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:22:39,187::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288046::DEBUG::2014-01-16 17:22:40,063::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288046::DEBUG::2014-01-16 17:22:40,064::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.97', 'elapsedTime': '411', 'vmType': 'kvm', 'cpuSys': '1.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:40,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:22:40,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:22:40,188::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:22:40,189::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:40,357::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:41,190::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:22:42,109::task::579::TaskManager.Task::(_updateState) Task=`183e4a7c-256a-4fad-83b8-2b90233f02ea`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:22:42,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:22:42,110::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:22:42,110::task::1168::TaskManager.Task::(prepare) Task=`183e4a7c-256a-4fad-83b8-2b90233f02ea`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:22:42,110::task::579::TaskManager.Task::(_updateState) Task=`183e4a7c-256a-4fad-83b8-2b90233f02ea`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:22:42,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:22:42,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:22:42,111::task::974::TaskManager.Task::(_decref) Task=`183e4a7c-256a-4fad-83b8-2b90233f02ea`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:22:42,111::task::579::TaskManager.Task::(_updateState) Task=`4247dff5-ec09-4961-b63d-d81c421438e3`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:22:42,111::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:22:42,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:22:42,112::task::1168::TaskManager.Task::(prepare) Task=`4247dff5-ec09-4961-b63d-d81c421438e3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:22:42,112::task::579::TaskManager.Task::(_updateState) Task=`4247dff5-ec09-4961-b63d-d81c421438e3`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:22:42,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:22:42,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:22:42,112::task::974::TaskManager.Task::(_decref) Task=`4247dff5-ec09-4961-b63d-d81c421438e3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:42,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:22:42,191::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:22:42,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:22:42,192::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:42,192::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:22:42,193::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:22:42,358::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288048::DEBUG::2014-01-16 17:22:43,164::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288048::DEBUG::2014-01-16 17:22:43,166::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.08', 'elapsedTime': '414', 'vmType': 'kvm', 'cpuSys': '1.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:43,194::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:22:43,230::task::579::TaskManager.Task::(_updateState) Task=`07423816-b77c-43b9-9fb4-63d03e7850dc`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:22:43,230::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:22:43,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:22:43,231::task::1168::TaskManager.Task::(prepare) Task=`07423816-b77c-43b9-9fb4-63d03e7850dc`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:22:43,231::task::579::TaskManager.Task::(_updateState) Task=`07423816-b77c-43b9-9fb4-63d03e7850dc`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:22:43,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:22:43,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:22:43,231::task::974::TaskManager.Task::(_decref) Task=`07423816-b77c-43b9-9fb4-63d03e7850dc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:22:43,360::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:44,195::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:22:44,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:22:44,196::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:44,361::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 17:22:45,004::task::579::TaskManager.Task::(_updateState) Task=`2cb37b10-bc7e-4ef4-bbb8-521436d37942`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:22:45,004::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:22:45,004::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:22:45,004::task::1168::TaskManager.Task::(prepare) Task=`2cb37b10-bc7e-4ef4-bbb8-521436d37942`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:22:45,005::task::579::TaskManager.Task::(_updateState) Task=`2cb37b10-bc7e-4ef4-bbb8-521436d37942`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:22:45,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:22:45,005::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:22:45,005::task::974::TaskManager.Task::(_decref) Task=`2cb37b10-bc7e-4ef4-bbb8-521436d37942`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:45,196::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:22:45,197::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:22:45,197::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:46,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:22:46,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:22:46,199::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:22:46,199::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288050::DEBUG::2014-01-16 17:22:46,272::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288050::DEBUG::2014-01-16 17:22:46,274::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.49', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '417', 'vmType': 'kvm', 'cpuSys': '1.27', 'appsList': [], 'guestIPs': ''}]} >Thread-16398::DEBUG::2014-01-16 17:22:46,334::task::579::TaskManager.Task::(_updateState) Task=`161af94b-6be2-4286-b1f8-e202fca877f0`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:22:46,335::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:22:46,335::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:22:46,335::task::1168::TaskManager.Task::(prepare) Task=`161af94b-6be2-4286-b1f8-e202fca877f0`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:22:46,335::task::579::TaskManager.Task::(_updateState) Task=`161af94b-6be2-4286-b1f8-e202fca877f0`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:22:46,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:22:46,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:22:46,336::task::974::TaskManager.Task::(_decref) Task=`161af94b-6be2-4286-b1f8-e202fca877f0`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:22:46,362::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16393::DEBUG::2014-01-16 17:22:46,416::task::579::TaskManager.Task::(_updateState) Task=`974074a1-8157-4ac2-abe6-a4baf2826fdb`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:22:46,417::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:22:46,417::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:22:46,417::task::1168::TaskManager.Task::(prepare) Task=`974074a1-8157-4ac2-abe6-a4baf2826fdb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:22:46,417::task::579::TaskManager.Task::(_updateState) Task=`974074a1-8157-4ac2-abe6-a4baf2826fdb`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:22:46,418::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:22:46,418::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:22:46,418::task::974::TaskManager.Task::(_decref) Task=`974074a1-8157-4ac2-abe6-a4baf2826fdb`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:22:46,420::task::579::TaskManager.Task::(_updateState) Task=`4ad6f534-e228-4646-a82a-3a49689c04d0`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:22:46,420::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:22:46,421::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:22:46,421::task::1168::TaskManager.Task::(prepare) Task=`4ad6f534-e228-4646-a82a-3a49689c04d0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:22:46,421::task::579::TaskManager.Task::(_updateState) Task=`4ad6f534-e228-4646-a82a-3a49689c04d0`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:22:46,421::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:22:46,421::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:22:46,421::task::974::TaskManager.Task::(_decref) Task=`4ad6f534-e228-4646-a82a-3a49689c04d0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:22:46,593::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:22:46,610::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000259909 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:47,200::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:22:47,220::task::579::TaskManager.Task::(_updateState) Task=`d7d55e01-d0c0-4e8c-b6a9-b5d64b0be027`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:22:47,220::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:22:47,220::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:22:47,221::task::1168::TaskManager.Task::(prepare) Task=`d7d55e01-d0c0-4e8c-b6a9-b5d64b0be027`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:22:47,221::task::579::TaskManager.Task::(_updateState) Task=`d7d55e01-d0c0-4e8c-b6a9-b5d64b0be027`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:22:47,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:22:47,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:22:47,221::task::974::TaskManager.Task::(_decref) Task=`d7d55e01-d0c0-4e8c-b6a9-b5d64b0be027`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:22:47,233::task::579::TaskManager.Task::(_updateState) Task=`5518f68b-309f-4055-8ca1-63705a2bf4eb`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:22:47,233::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:22:47,234::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:22:47,234::task::1168::TaskManager.Task::(prepare) Task=`5518f68b-309f-4055-8ca1-63705a2bf4eb`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:22:47,234::task::579::TaskManager.Task::(_updateState) Task=`5518f68b-309f-4055-8ca1-63705a2bf4eb`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:22:47,234::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:22:47,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:22:47,235::task::974::TaskManager.Task::(_decref) Task=`5518f68b-309f-4055-8ca1-63705a2bf4eb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:48,201::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:22:48,201::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:48,364::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:48,366::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:22:48,367::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:22:48,368::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:22:48,697::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:22:48,714::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000374985 s, 10.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:49,202::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288051::DEBUG::2014-01-16 17:22:49,423::task::579::TaskManager.Task::(_updateState) Task=`7fd08d3c-c110-40cd-9662-9665e36fb7d0`::moving from state init -> state preparing >Thread-288051::INFO::2014-01-16 17:22:49,424::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288051::INFO::2014-01-16 17:22:49,424::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259909', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374985', 'lastCheck': '0.7', 'valid': True}} >Thread-288051::DEBUG::2014-01-16 17:22:49,424::task::1168::TaskManager.Task::(prepare) Task=`7fd08d3c-c110-40cd-9662-9665e36fb7d0`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000259909', 'lastCheck': '2.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374985', 'lastCheck': '0.7', 'valid': True}} >Thread-288051::DEBUG::2014-01-16 17:22:49,424::task::579::TaskManager.Task::(_updateState) Task=`7fd08d3c-c110-40cd-9662-9665e36fb7d0`::moving from state preparing -> state finished >Thread-288051::DEBUG::2014-01-16 17:22:49,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288051::DEBUG::2014-01-16 17:22:49,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288051::DEBUG::2014-01-16 17:22:49,425::task::974::TaskManager.Task::(_decref) Task=`7fd08d3c-c110-40cd-9662-9665e36fb7d0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:50,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:50,369::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:51,204::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:22:52,090::task::579::TaskManager.Task::(_updateState) Task=`30d6b0db-0760-4707-98ff-8194cca2b617`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:22:52,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:22:52,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:22:52,092::task::1168::TaskManager.Task::(prepare) Task=`30d6b0db-0760-4707-98ff-8194cca2b617`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:22:52,092::task::579::TaskManager.Task::(_updateState) Task=`30d6b0db-0760-4707-98ff-8194cca2b617`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:22:52,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:22:52,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:22:52,092::task::974::TaskManager.Task::(_decref) Task=`30d6b0db-0760-4707-98ff-8194cca2b617`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:52,206::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:52,371::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288054::DEBUG::2014-01-16 17:22:53,094::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288054::DEBUG::2014-01-16 17:22:53,095::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.00', 'elapsedTime': '424', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:53,207::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:22:53,207::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:53,372::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:22:54,208::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:22:54,208::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16244::DEBUG::2014-01-16 17:22:54,337::task::579::TaskManager.Task::(_updateState) Task=`fc2afc22-12db-4048-9498-5705fd54e139`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:22:54,337::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:22:54,338::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:22:54,338::task::1168::TaskManager.Task::(prepare) Task=`fc2afc22-12db-4048-9498-5705fd54e139`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:22:54,338::task::579::TaskManager.Task::(_updateState) Task=`fc2afc22-12db-4048-9498-5705fd54e139`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:22:54,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:22:54,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:22:54,338::task::974::TaskManager.Task::(_decref) Task=`fc2afc22-12db-4048-9498-5705fd54e139`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:22:54,373::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:22:54,872::task::579::TaskManager.Task::(_updateState) Task=`01c12cbf-d900-4380-95a6-4b89d355592d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:22:54,873::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:22:54,873::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:22:54,873::task::1168::TaskManager.Task::(prepare) Task=`01c12cbf-d900-4380-95a6-4b89d355592d`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:22:54,873::task::579::TaskManager.Task::(_updateState) Task=`01c12cbf-d900-4380-95a6-4b89d355592d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:22:54,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:22:54,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:22:54,874::task::974::TaskManager.Task::(_decref) Task=`01c12cbf-d900-4380-95a6-4b89d355592d`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:22:54,874::task::579::TaskManager.Task::(_updateState) Task=`597fb8c5-eb3c-4319-9af7-cb5166967a04`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:22:54,874::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:22:54,874::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:22:54,875::task::1168::TaskManager.Task::(prepare) Task=`597fb8c5-eb3c-4319-9af7-cb5166967a04`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:22:54,875::task::579::TaskManager.Task::(_updateState) Task=`597fb8c5-eb3c-4319-9af7-cb5166967a04`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:22:54,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:22:54,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:22:54,875::task::974::TaskManager.Task::(_decref) Task=`597fb8c5-eb3c-4319-9af7-cb5166967a04`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:22:54,875::task::579::TaskManager.Task::(_updateState) Task=`7896b178-748d-400e-8ca0-5746d206616d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:22:54,876::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:22:54,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:22:54,876::task::1168::TaskManager.Task::(prepare) Task=`7896b178-748d-400e-8ca0-5746d206616d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:22:54,876::task::579::TaskManager.Task::(_updateState) Task=`7896b178-748d-400e-8ca0-5746d206616d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:22:54,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:22:54,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:22:54,877::task::974::TaskManager.Task::(_decref) Task=`7896b178-748d-400e-8ca0-5746d206616d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:22:55,209::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288056::DEBUG::2014-01-16 17:22:56,191::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288056::DEBUG::2014-01-16 17:22:56,192::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.04', 'elapsedTime': '427', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:22:56,210::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:56,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:22:56,617::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:22:56,634::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00027111 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:57,211::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:22:58,211::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:22:58,376::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:22:58,378::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:22:58,720::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:22:58,738::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000336416 s, 12.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:22:59,212::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:22:59,212::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:22:59,213::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288058::DEBUG::2014-01-16 17:22:59,294::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288058::DEBUG::2014-01-16 17:22:59,296::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.14', 'elapsedTime': '430', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-221160::DEBUG::2014-01-16 17:22:59,554::task::579::TaskManager.Task::(_updateState) Task=`b0d986ce-0e06-4eb3-a483-450d6af23868`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:22:59,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:22:59,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:22:59,555::task::1168::TaskManager.Task::(prepare) Task=`b0d986ce-0e06-4eb3-a483-450d6af23868`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:22:59,555::task::579::TaskManager.Task::(_updateState) Task=`b0d986ce-0e06-4eb3-a483-450d6af23868`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:22:59,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:22:59,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:22:59,556::task::974::TaskManager.Task::(_decref) Task=`b0d986ce-0e06-4eb3-a483-450d6af23868`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:00,213::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:23:00,214::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:00,380::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:01,214::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:23:01,215::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:23:01,215::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:02,216::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:23:02,216::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:02,382::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288060::DEBUG::2014-01-16 17:23:02,399::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288060::DEBUG::2014-01-16 17:23:02,401::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.77', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.25', 'elapsedTime': '433', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:23:03,217::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:23:03,217::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:03,384::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:23:03,385::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:23:03,386::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:04,218::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:04,387::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:05,219::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:23:05,219::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288061::DEBUG::2014-01-16 17:23:05,456::task::579::TaskManager.Task::(_updateState) Task=`78c62129-9c23-4c52-928e-1bc059f4be3c`::moving from state init -> state preparing >Thread-288061::INFO::2014-01-16 17:23:05,457::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288061::INFO::2014-01-16 17:23:05,457::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027111', 'lastCheck': '8.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000336416', 'lastCheck': '6.7', 'valid': True}} >Thread-288061::DEBUG::2014-01-16 17:23:05,457::task::1168::TaskManager.Task::(prepare) Task=`78c62129-9c23-4c52-928e-1bc059f4be3c`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00027111', 'lastCheck': '8.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000336416', 'lastCheck': '6.7', 'valid': True}} >Thread-288061::DEBUG::2014-01-16 17:23:05,457::task::579::TaskManager.Task::(_updateState) Task=`78c62129-9c23-4c52-928e-1bc059f4be3c`::moving from state preparing -> state finished >Thread-288061::DEBUG::2014-01-16 17:23:05,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288061::DEBUG::2014-01-16 17:23:05,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288061::DEBUG::2014-01-16 17:23:05,458::task::974::TaskManager.Task::(_decref) Task=`78c62129-9c23-4c52-928e-1bc059f4be3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:06,220::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:23:06,221::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:06,389::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:23:06,403::task::579::TaskManager.Task::(_updateState) Task=`1ca0b865-f6f2-4865-8254-d56679a20d4b`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:23:06,404::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:23:06,404::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:23:06,404::task::1168::TaskManager.Task::(prepare) Task=`1ca0b865-f6f2-4865-8254-d56679a20d4b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:23:06,404::task::579::TaskManager.Task::(_updateState) Task=`1ca0b865-f6f2-4865-8254-d56679a20d4b`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:23:06,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:23:06,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:23:06,405::task::974::TaskManager.Task::(_decref) Task=`1ca0b865-f6f2-4865-8254-d56679a20d4b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:23:06,641::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:23:06,659::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000265013 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:07,222::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:23:07,222::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:23:07,223::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:23:07,223::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:08,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:23:08,224::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:23:08,224::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:08,391::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:08,392::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:23:08,745::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:23:08,764::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000233618 s, 17.5 MB/s\n'; <rc> = 0 >Thread-288064::DEBUG::2014-01-16 17:23:09,089::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [28ecfacc] >Thread-288064::DEBUG::2014-01-16 17:23:09,091::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.53', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.93', 'elapsedTime': '440', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-53040::DEBUG::2014-01-16 17:23:09,109::task::579::TaskManager.Task::(_updateState) Task=`a625c5c5-4b1a-4e80-b619-f501a38a9de8`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:23:09,110::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:23:09,111::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:23:09,111::task::1168::TaskManager.Task::(prepare) Task=`a625c5c5-4b1a-4e80-b619-f501a38a9de8`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:23:09,111::task::579::TaskManager.Task::(_updateState) Task=`a625c5c5-4b1a-4e80-b619-f501a38a9de8`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:23:09,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:23:09,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:23:09,112::task::974::TaskManager.Task::(_decref) Task=`a625c5c5-4b1a-4e80-b619-f501a38a9de8`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:23:09,124::task::579::TaskManager.Task::(_updateState) Task=`49c4aa5d-9f11-4cca-97db-ba26593d6755`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:23:09,124::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:23:09,125::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:23:09,125::task::1168::TaskManager.Task::(prepare) Task=`49c4aa5d-9f11-4cca-97db-ba26593d6755`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:23:09,126::task::579::TaskManager.Task::(_updateState) Task=`49c4aa5d-9f11-4cca-97db-ba26593d6755`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:23:09,126::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:23:09,126::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:23:09,126::task::974::TaskManager.Task::(_decref) Task=`49c4aa5d-9f11-4cca-97db-ba26593d6755`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:09,225::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:23:09,225::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:10,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:23:10,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:23:10,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:23:10,227::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:10,393::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:11,228::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:23:11,229::task::579::TaskManager.Task::(_updateState) Task=`d029a8ac-a950-4eba-875d-18e4d4b46b46`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:23:11,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:23:11,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:23:11,230::task::1168::TaskManager.Task::(prepare) Task=`d029a8ac-a950-4eba-875d-18e4d4b46b46`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:23:11,231::task::579::TaskManager.Task::(_updateState) Task=`d029a8ac-a950-4eba-875d-18e4d4b46b46`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:23:11,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:23:11,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:23:11,231::task::974::TaskManager.Task::(_decref) Task=`d029a8ac-a950-4eba-875d-18e4d4b46b46`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:23:11,231::task::579::TaskManager.Task::(_updateState) Task=`d48c52dd-a76a-41f1-9486-066508c88c25`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:23:11,231::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:23:11,232::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:23:11,232::task::1168::TaskManager.Task::(prepare) Task=`d48c52dd-a76a-41f1-9486-066508c88c25`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:23:11,232::task::579::TaskManager.Task::(_updateState) Task=`d48c52dd-a76a-41f1-9486-066508c88c25`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:23:11,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:23:11,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:23:11,232::task::974::TaskManager.Task::(_decref) Task=`d48c52dd-a76a-41f1-9486-066508c88c25`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:12,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:23:12,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:23:12,230::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:23:12,230::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:12,231::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:23:12,231::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:23:12,394::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:13,232::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 17:23:13,289::task::579::TaskManager.Task::(_updateState) Task=`8ef14f15-5069-4519-9916-34c78d3417d1`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:23:13,290::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:23:13,290::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:23:13,290::task::1168::TaskManager.Task::(prepare) Task=`8ef14f15-5069-4519-9916-34c78d3417d1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:23:13,290::task::579::TaskManager.Task::(_updateState) Task=`8ef14f15-5069-4519-9916-34c78d3417d1`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:23:13,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:23:13,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:23:13,291::task::974::TaskManager.Task::(_decref) Task=`8ef14f15-5069-4519-9916-34c78d3417d1`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:23:13,396::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:23:13,821::task::579::TaskManager.Task::(_updateState) Task=`e4216761-3510-4ed6-9f51-12b8f0562638`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:23:13,821::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:23:13,821::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:23:13,821::task::1168::TaskManager.Task::(prepare) Task=`e4216761-3510-4ed6-9f51-12b8f0562638`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:23:13,822::task::579::TaskManager.Task::(_updateState) Task=`e4216761-3510-4ed6-9f51-12b8f0562638`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:23:13,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:23:13,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:23:13,822::task::974::TaskManager.Task::(_decref) Task=`e4216761-3510-4ed6-9f51-12b8f0562638`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:23:13,822::task::579::TaskManager.Task::(_updateState) Task=`199f7974-1ecb-4fd5-8d1c-fe1cce5388c5`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:23:13,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:23:13,823::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:23:13,823::task::1168::TaskManager.Task::(prepare) Task=`199f7974-1ecb-4fd5-8d1c-fe1cce5388c5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:23:13,823::task::579::TaskManager.Task::(_updateState) Task=`199f7974-1ecb-4fd5-8d1c-fe1cce5388c5`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:23:13,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:23:13,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:23:13,824::task::974::TaskManager.Task::(_decref) Task=`199f7974-1ecb-4fd5-8d1c-fe1cce5388c5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:14,234::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:23:14,234::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:23:14,234::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:14,397::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:15,235::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:23:15,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:23:15,236::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:16,236::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:23:16,237::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:23:16,237::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:23:16,237::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:16,398::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:23:16,667::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:23:16,684::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000335679 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:23:16,864::task::579::TaskManager.Task::(_updateState) Task=`5a521b5e-496c-4791-9743-3235b6a196ac`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:23:16,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:23:16,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:23:16,865::task::1168::TaskManager.Task::(prepare) Task=`5a521b5e-496c-4791-9743-3235b6a196ac`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:23:16,865::task::579::TaskManager.Task::(_updateState) Task=`5a521b5e-496c-4791-9743-3235b6a196ac`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:23:16,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:23:16,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:23:16,865::task::974::TaskManager.Task::(_decref) Task=`5a521b5e-496c-4791-9743-3235b6a196ac`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:23:17,233::task::579::TaskManager.Task::(_updateState) Task=`70078a84-a3f1-40f6-9646-6afeab760461`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:23:17,234::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:23:17,234::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:23:17,234::task::1168::TaskManager.Task::(prepare) Task=`70078a84-a3f1-40f6-9646-6afeab760461`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:23:17,234::task::579::TaskManager.Task::(_updateState) Task=`70078a84-a3f1-40f6-9646-6afeab760461`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:23:17,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:23:17,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:23:17,235::task::974::TaskManager.Task::(_decref) Task=`70078a84-a3f1-40f6-9646-6afeab760461`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:17,238::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:18,239::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:23:18,240::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:18,400::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:18,400::task::579::TaskManager.Task::(_updateState) Task=`58d09b70-1c41-446e-af44-626e6b311c41`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:23:18,400::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:23:18,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:23:18,401::task::1168::TaskManager.Task::(prepare) Task=`58d09b70-1c41-446e-af44-626e6b311c41`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:23:18,401::task::579::TaskManager.Task::(_updateState) Task=`58d09b70-1c41-446e-af44-626e6b311c41`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:23:18,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:23:18,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:23:18,401::task::974::TaskManager.Task::(_decref) Task=`58d09b70-1c41-446e-af44-626e6b311c41`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:23:18,403::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:23:18,403::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:23:18,405::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:18,406::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:18,407::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 17:23:18,726::task::579::TaskManager.Task::(_updateState) Task=`c4ba5ec6-3784-45e0-8b65-fa67022fa280`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:23:18,726::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:23:18,726::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:23:18,727::task::1168::TaskManager.Task::(prepare) Task=`c4ba5ec6-3784-45e0-8b65-fa67022fa280`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:23:18,727::task::579::TaskManager.Task::(_updateState) Task=`c4ba5ec6-3784-45e0-8b65-fa67022fa280`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:23:18,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:23:18,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:23:18,727::task::974::TaskManager.Task::(_decref) Task=`c4ba5ec6-3784-45e0-8b65-fa67022fa280`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:23:18,769::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:23:18,785::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000267194 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:19,241::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:23:19,275::task::579::TaskManager.Task::(_updateState) Task=`37baf5d9-fc97-49e2-ad2f-1643bb767fe6`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:23:19,275::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:23:19,276::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:23:19,276::task::1168::TaskManager.Task::(prepare) Task=`37baf5d9-fc97-49e2-ad2f-1643bb767fe6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:23:19,276::task::579::TaskManager.Task::(_updateState) Task=`37baf5d9-fc97-49e2-ad2f-1643bb767fe6`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:23:19,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:23:19,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:23:19,276::task::974::TaskManager.Task::(_decref) Task=`37baf5d9-fc97-49e2-ad2f-1643bb767fe6`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:23:19,768::task::579::TaskManager.Task::(_updateState) Task=`16b83e65-e721-45e1-8080-4f9660f6caa8`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:23:19,768::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:23:19,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:23:19,769::task::1168::TaskManager.Task::(prepare) Task=`16b83e65-e721-45e1-8080-4f9660f6caa8`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:23:19,769::task::579::TaskManager.Task::(_updateState) Task=`16b83e65-e721-45e1-8080-4f9660f6caa8`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:23:19,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:23:19,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:23:19,769::task::974::TaskManager.Task::(_decref) Task=`16b83e65-e721-45e1-8080-4f9660f6caa8`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:23:19,770::task::579::TaskManager.Task::(_updateState) Task=`9c466809-9840-40f3-ab17-9d59af7fd993`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:23:19,770::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:23:19,770::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:23:19,770::task::1168::TaskManager.Task::(prepare) Task=`9c466809-9840-40f3-ab17-9d59af7fd993`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:23:19,770::task::579::TaskManager.Task::(_updateState) Task=`9c466809-9840-40f3-ab17-9d59af7fd993`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:23:19,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:23:19,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:23:19,771::task::974::TaskManager.Task::(_decref) Task=`9c466809-9840-40f3-ab17-9d59af7fd993`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:20,242::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:20,408::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:23:20,767::task::579::TaskManager.Task::(_updateState) Task=`51b15f1a-c0d4-4adf-8d26-e14468b1b4da`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:23:20,768::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:23:20,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:23:20,769::task::1168::TaskManager.Task::(prepare) Task=`51b15f1a-c0d4-4adf-8d26-e14468b1b4da`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:23:20,769::task::579::TaskManager.Task::(_updateState) Task=`51b15f1a-c0d4-4adf-8d26-e14468b1b4da`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:23:20,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:23:20,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:23:20,770::task::974::TaskManager.Task::(_decref) Task=`51b15f1a-c0d4-4adf-8d26-e14468b1b4da`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:21,243::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288068::DEBUG::2014-01-16 17:23:21,452::task::579::TaskManager.Task::(_updateState) Task=`86c5667e-8805-495f-aa0d-04469f244c2f`::moving from state init -> state preparing >Thread-288068::INFO::2014-01-16 17:23:21,452::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288068::INFO::2014-01-16 17:23:21,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000335679', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267194', 'lastCheck': '2.7', 'valid': True}} >Thread-288068::DEBUG::2014-01-16 17:23:21,453::task::1168::TaskManager.Task::(prepare) Task=`86c5667e-8805-495f-aa0d-04469f244c2f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000335679', 'lastCheck': '4.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267194', 'lastCheck': '2.7', 'valid': True}} >Thread-288068::DEBUG::2014-01-16 17:23:21,453::task::579::TaskManager.Task::(_updateState) Task=`86c5667e-8805-495f-aa0d-04469f244c2f`::moving from state preparing -> state finished >Thread-288068::DEBUG::2014-01-16 17:23:21,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288068::DEBUG::2014-01-16 17:23:21,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288068::DEBUG::2014-01-16 17:23:21,454::task::974::TaskManager.Task::(_decref) Task=`86c5667e-8805-495f-aa0d-04469f244c2f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:22,244::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:22,409::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:23,244::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:23:23,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-227488::DEBUG::2014-01-16 17:23:23,356::task::579::TaskManager.Task::(_updateState) Task=`0e2430bd-edbf-40ac-8c63-bd0c24e3dc48`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:23:23,356::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:23:23,357::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:23:23,357::task::1168::TaskManager.Task::(prepare) Task=`0e2430bd-edbf-40ac-8c63-bd0c24e3dc48`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:23:23,357::task::579::TaskManager.Task::(_updateState) Task=`0e2430bd-edbf-40ac-8c63-bd0c24e3dc48`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:23:23,357::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:23:23,357::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:23:23,357::task::974::TaskManager.Task::(_decref) Task=`0e2430bd-edbf-40ac-8c63-bd0c24e3dc48`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:23:23,411::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:24,246::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:23:24,246::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:24,412::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:25,247::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:23:26,201::task::579::TaskManager.Task::(_updateState) Task=`587e53de-91e1-45f0-a34c-f8da86df9ab8`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:23:26,202::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:23:26,202::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:23:26,202::task::1168::TaskManager.Task::(prepare) Task=`587e53de-91e1-45f0-a34c-f8da86df9ab8`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:23:26,203::task::579::TaskManager.Task::(_updateState) Task=`587e53de-91e1-45f0-a34c-f8da86df9ab8`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:23:26,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:23:26,203::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:23:26,203::task::974::TaskManager.Task::(_decref) Task=`587e53de-91e1-45f0-a34c-f8da86df9ab8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:26,248::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:26,413::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:23:26,691::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:23:26,710::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000326543 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:27,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:23:28,062::task::579::TaskManager.Task::(_updateState) Task=`a630ea48-4d12-4ff3-93a7-7f048eff3de4`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:23:28,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:23:28,063::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:23:28,063::task::1168::TaskManager.Task::(prepare) Task=`a630ea48-4d12-4ff3-93a7-7f048eff3de4`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:23:28,063::task::579::TaskManager.Task::(_updateState) Task=`a630ea48-4d12-4ff3-93a7-7f048eff3de4`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:23:28,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:23:28,064::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:23:28,064::task::974::TaskManager.Task::(_decref) Task=`a630ea48-4d12-4ff3-93a7-7f048eff3de4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:28,249::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:28,414::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:28,415::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:23:28,674::task::579::TaskManager.Task::(_updateState) Task=`ace43102-8cbd-4e7a-9404-0c48b734c494`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:23:28,674::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:23:28,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:23:28,674::task::1168::TaskManager.Task::(prepare) Task=`ace43102-8cbd-4e7a-9404-0c48b734c494`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:23:28,675::task::579::TaskManager.Task::(_updateState) Task=`ace43102-8cbd-4e7a-9404-0c48b734c494`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:23:28,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:23:28,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:23:28,675::task::974::TaskManager.Task::(_decref) Task=`ace43102-8cbd-4e7a-9404-0c48b734c494`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:23:28,675::task::579::TaskManager.Task::(_updateState) Task=`1315de48-ac4a-4646-932c-bf72cba7f03f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:23:28,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:23:28,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:23:28,676::task::1168::TaskManager.Task::(prepare) Task=`1315de48-ac4a-4646-932c-bf72cba7f03f`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:23:28,676::task::579::TaskManager.Task::(_updateState) Task=`1315de48-ac4a-4646-932c-bf72cba7f03f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:23:28,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:23:28,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:23:28,676::task::974::TaskManager.Task::(_decref) Task=`1315de48-ac4a-4646-932c-bf72cba7f03f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:23:28,677::task::579::TaskManager.Task::(_updateState) Task=`d192b2b8-96ee-4d96-a1d4-f325eff8c0c1`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:23:28,677::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:23:28,677::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:23:28,677::task::1168::TaskManager.Task::(prepare) Task=`d192b2b8-96ee-4d96-a1d4-f325eff8c0c1`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:23:28,677::task::579::TaskManager.Task::(_updateState) Task=`d192b2b8-96ee-4d96-a1d4-f325eff8c0c1`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:23:28,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:23:28,678::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:23:28,678::task::974::TaskManager.Task::(_decref) Task=`d192b2b8-96ee-4d96-a1d4-f325eff8c0c1`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:23:28,791::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:23:28,808::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000344195 s, 11.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:29,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:23:29,251::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:23:29,251::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:30,253::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:23:30,253::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:30,417::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:31,255::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:23:31,255::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:23:31,255::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:32,256::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:23:32,257::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:32,418::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:33,258::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:23:33,258::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:33,420::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:23:33,420::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:23:33,422::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:23:33,877::task::579::TaskManager.Task::(_updateState) Task=`a8cba3ba-7aee-456e-989a-93fa3a3abbcd`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:23:33,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:23:33,878::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:23:33,878::task::1168::TaskManager.Task::(prepare) Task=`a8cba3ba-7aee-456e-989a-93fa3a3abbcd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:23:33,878::task::579::TaskManager.Task::(_updateState) Task=`a8cba3ba-7aee-456e-989a-93fa3a3abbcd`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:23:33,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:23:33,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:23:33,879::task::974::TaskManager.Task::(_decref) Task=`a8cba3ba-7aee-456e-989a-93fa3a3abbcd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:34,259::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:34,423::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:35,261::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:23:35,261::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:36,262::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:23:36,263::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:36,424::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:23:36,718::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:23:36,734::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000311411 s, 1.2 MB/s\n'; <rc> = 0 >Thread-288074::DEBUG::2014-01-16 17:23:37,220::task::579::TaskManager.Task::(_updateState) Task=`27fd6062-5ea5-4ea7-9efe-f0bd9b14b617`::moving from state init -> state preparing >Thread-288074::INFO::2014-01-16 17:23:37,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288074::INFO::2014-01-16 17:23:37,221::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311411', 'lastCheck': '0.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344195', 'lastCheck': '8.4', 'valid': True}} >Thread-288074::DEBUG::2014-01-16 17:23:37,221::task::1168::TaskManager.Task::(prepare) Task=`27fd6062-5ea5-4ea7-9efe-f0bd9b14b617`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311411', 'lastCheck': '0.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344195', 'lastCheck': '8.4', 'valid': True}} >Thread-288074::DEBUG::2014-01-16 17:23:37,221::task::579::TaskManager.Task::(_updateState) Task=`27fd6062-5ea5-4ea7-9efe-f0bd9b14b617`::moving from state preparing -> state finished >Thread-288074::DEBUG::2014-01-16 17:23:37,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288074::DEBUG::2014-01-16 17:23:37,222::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288074::DEBUG::2014-01-16 17:23:37,222::task::974::TaskManager.Task::(_decref) Task=`27fd6062-5ea5-4ea7-9efe-f0bd9b14b617`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:37,263::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:23:37,264::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:23:37,264::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:23:37,264::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:23:37,855::task::579::TaskManager.Task::(_updateState) Task=`91e4aad3-8dd9-47ba-a979-26a1ad476915`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:23:37,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:23:37,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:23:37,856::task::1168::TaskManager.Task::(prepare) Task=`91e4aad3-8dd9-47ba-a979-26a1ad476915`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:23:37,856::task::579::TaskManager.Task::(_updateState) Task=`91e4aad3-8dd9-47ba-a979-26a1ad476915`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:23:37,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:23:37,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:23:37,857::task::974::TaskManager.Task::(_decref) Task=`91e4aad3-8dd9-47ba-a979-26a1ad476915`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:23:37,882::task::579::TaskManager.Task::(_updateState) Task=`f24a3118-5bf2-4427-8bf2-919f8aed8aa6`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:23:37,882::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:23:37,882::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:23:37,883::task::1168::TaskManager.Task::(prepare) Task=`f24a3118-5bf2-4427-8bf2-919f8aed8aa6`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:23:37,883::task::579::TaskManager.Task::(_updateState) Task=`f24a3118-5bf2-4427-8bf2-919f8aed8aa6`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:23:37,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:23:37,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:23:37,883::task::974::TaskManager.Task::(_decref) Task=`f24a3118-5bf2-4427-8bf2-919f8aed8aa6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:38,265::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:23:38,266::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:23:38,266::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:38,425::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:38,426::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:23:38,814::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:23:38,833::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000234616 s, 17.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:39,267::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:23:39,267::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:40,268::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:23:40,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:23:40,269::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:23:40,269::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:40,427::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:41,270::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:42,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:23:42,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:23:42,272::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:23:42,272::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:42,273::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:23:42,273::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:23:42,428::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:23:42,476::task::579::TaskManager.Task::(_updateState) Task=`ce071cc1-d36f-41b4-8c07-95d03758ee31`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:23:42,476::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:23:42,477::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:23:42,477::task::1168::TaskManager.Task::(prepare) Task=`ce071cc1-d36f-41b4-8c07-95d03758ee31`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:23:42,477::task::579::TaskManager.Task::(_updateState) Task=`ce071cc1-d36f-41b4-8c07-95d03758ee31`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:23:42,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:23:42,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:23:42,477::task::974::TaskManager.Task::(_decref) Task=`ce071cc1-d36f-41b4-8c07-95d03758ee31`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:23:42,478::task::579::TaskManager.Task::(_updateState) Task=`a0c9d369-45f5-4ac5-8d6a-166359a8df3c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:23:42,478::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:23:42,478::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:23:42,478::task::1168::TaskManager.Task::(prepare) Task=`a0c9d369-45f5-4ac5-8d6a-166359a8df3c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:23:42,478::task::579::TaskManager.Task::(_updateState) Task=`a0c9d369-45f5-4ac5-8d6a-166359a8df3c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:23:42,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:23:42,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:23:42,479::task::974::TaskManager.Task::(_decref) Task=`a0c9d369-45f5-4ac5-8d6a-166359a8df3c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:43,274::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-251420::DEBUG::2014-01-16 17:23:43,406::task::579::TaskManager.Task::(_updateState) Task=`c27eead9-e01d-436d-ae49-3b3f9f87a3d9`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:23:43,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:23:43,406::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:23:43,407::task::1168::TaskManager.Task::(prepare) Task=`c27eead9-e01d-436d-ae49-3b3f9f87a3d9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:23:43,407::task::579::TaskManager.Task::(_updateState) Task=`c27eead9-e01d-436d-ae49-3b3f9f87a3d9`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:23:43,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:23:43,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:23:43,407::task::974::TaskManager.Task::(_decref) Task=`c27eead9-e01d-436d-ae49-3b3f9f87a3d9`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:23:43,430::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:44,275::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:23:44,276::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:23:44,276::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:44,431::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3168::DEBUG::2014-01-16 17:23:45,177::task::579::TaskManager.Task::(_updateState) Task=`b5915b84-0d33-40f9-bcaf-4a86526c7012`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:23:45,178::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:23:45,178::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:23:45,178::task::1168::TaskManager.Task::(prepare) Task=`b5915b84-0d33-40f9-bcaf-4a86526c7012`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:23:45,178::task::579::TaskManager.Task::(_updateState) Task=`b5915b84-0d33-40f9-bcaf-4a86526c7012`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:23:45,178::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:23:45,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:23:45,179::task::974::TaskManager.Task::(_decref) Task=`b5915b84-0d33-40f9-bcaf-4a86526c7012`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:45,276::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:23:45,277::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:23:45,277::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:46,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:23:46,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:23:46,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:23:46,279::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:46,432::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:23:46,504::task::579::TaskManager.Task::(_updateState) Task=`6b5c59e0-bc4b-4e02-abee-739d82636288`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:23:46,504::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:23:46,505::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:23:46,505::task::1168::TaskManager.Task::(prepare) Task=`6b5c59e0-bc4b-4e02-abee-739d82636288`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:23:46,505::task::579::TaskManager.Task::(_updateState) Task=`6b5c59e0-bc4b-4e02-abee-739d82636288`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:23:46,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:23:46,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:23:46,505::task::974::TaskManager.Task::(_decref) Task=`6b5c59e0-bc4b-4e02-abee-739d82636288`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:23:46,603::task::579::TaskManager.Task::(_updateState) Task=`53affced-3ea0-4e6d-81f3-ff7c59733608`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:23:46,603::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:23:46,604::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:23:46,604::task::1168::TaskManager.Task::(prepare) Task=`53affced-3ea0-4e6d-81f3-ff7c59733608`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:23:46,604::task::579::TaskManager.Task::(_updateState) Task=`53affced-3ea0-4e6d-81f3-ff7c59733608`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:23:46,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:23:46,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:23:46,604::task::974::TaskManager.Task::(_decref) Task=`53affced-3ea0-4e6d-81f3-ff7c59733608`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:23:46,607::task::579::TaskManager.Task::(_updateState) Task=`8c824f66-81e8-4d19-8e66-7b4097f85f9e`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:23:46,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:23:46,607::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:23:46,608::task::1168::TaskManager.Task::(prepare) Task=`8c824f66-81e8-4d19-8e66-7b4097f85f9e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:23:46,608::task::579::TaskManager.Task::(_updateState) Task=`8c824f66-81e8-4d19-8e66-7b4097f85f9e`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:23:46,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:23:46,608::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:23:46,608::task::974::TaskManager.Task::(_decref) Task=`8c824f66-81e8-4d19-8e66-7b4097f85f9e`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:23:46,741::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:23:46,760::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000299971 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:47,279::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:23:47,380::task::579::TaskManager.Task::(_updateState) Task=`d1af4437-7d3b-4138-ba47-2f021c6c60c7`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:23:47,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:23:47,380::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:23:47,380::task::1168::TaskManager.Task::(prepare) Task=`d1af4437-7d3b-4138-ba47-2f021c6c60c7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:23:47,381::task::579::TaskManager.Task::(_updateState) Task=`d1af4437-7d3b-4138-ba47-2f021c6c60c7`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:23:47,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:23:47,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:23:47,381::task::974::TaskManager.Task::(_decref) Task=`d1af4437-7d3b-4138-ba47-2f021c6c60c7`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:23:47,401::task::579::TaskManager.Task::(_updateState) Task=`da050e60-c8ac-440d-8030-a28b1acf7144`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:23:47,401::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:23:47,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:23:47,402::task::1168::TaskManager.Task::(prepare) Task=`da050e60-c8ac-440d-8030-a28b1acf7144`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:23:47,402::task::579::TaskManager.Task::(_updateState) Task=`da050e60-c8ac-440d-8030-a28b1acf7144`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:23:47,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:23:47,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:23:47,403::task::974::TaskManager.Task::(_decref) Task=`da050e60-c8ac-440d-8030-a28b1acf7144`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:48,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:23:48,281::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:48,434::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:48,436::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:23:48,436::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:23:48,437::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:23:48,838::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:23:48,855::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241061 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:49,282::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:50,284::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:50,438::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:51,285::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:23:52,172::task::579::TaskManager.Task::(_updateState) Task=`3d7b4026-fedc-439d-8b67-6ded51161c53`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:23:52,173::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:23:52,173::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:23:52,173::task::1168::TaskManager.Task::(prepare) Task=`3d7b4026-fedc-439d-8b67-6ded51161c53`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:23:52,173::task::579::TaskManager.Task::(_updateState) Task=`3d7b4026-fedc-439d-8b67-6ded51161c53`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:23:52,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:23:52,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:23:52,174::task::974::TaskManager.Task::(_decref) Task=`3d7b4026-fedc-439d-8b67-6ded51161c53`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:52,286::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:52,440::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288080::DEBUG::2014-01-16 17:23:52,968::task::579::TaskManager.Task::(_updateState) Task=`f14500b0-1f70-46ba-b26e-d53e3ae7a16b`::moving from state init -> state preparing >Thread-288080::INFO::2014-01-16 17:23:52,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288080::INFO::2014-01-16 17:23:52,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000299971', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241061', 'lastCheck': '4.1', 'valid': True}} >Thread-288080::DEBUG::2014-01-16 17:23:52,968::task::1168::TaskManager.Task::(prepare) Task=`f14500b0-1f70-46ba-b26e-d53e3ae7a16b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000299971', 'lastCheck': '6.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241061', 'lastCheck': '4.1', 'valid': True}} >Thread-288080::DEBUG::2014-01-16 17:23:52,968::task::579::TaskManager.Task::(_updateState) Task=`f14500b0-1f70-46ba-b26e-d53e3ae7a16b`::moving from state preparing -> state finished >Thread-288080::DEBUG::2014-01-16 17:23:52,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288080::DEBUG::2014-01-16 17:23:52,969::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288080::DEBUG::2014-01-16 17:23:52,969::task::974::TaskManager.Task::(_decref) Task=`f14500b0-1f70-46ba-b26e-d53e3ae7a16b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:53,287::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:23:53,288::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:53,441::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:23:54,289::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:23:54,289::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:54,443::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:23:54,500::task::579::TaskManager.Task::(_updateState) Task=`0dbbac7d-07c1-491f-8ac3-b0e95309b3e8`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:23:54,500::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:23:54,500::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:23:54,500::task::1168::TaskManager.Task::(prepare) Task=`0dbbac7d-07c1-491f-8ac3-b0e95309b3e8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:23:54,500::task::579::TaskManager.Task::(_updateState) Task=`0dbbac7d-07c1-491f-8ac3-b0e95309b3e8`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:23:54,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:23:54,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:23:54,501::task::974::TaskManager.Task::(_decref) Task=`0dbbac7d-07c1-491f-8ac3-b0e95309b3e8`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:23:55,151::task::579::TaskManager.Task::(_updateState) Task=`1c204f01-3da7-40fa-abf2-da655e14de96`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:23:55,151::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:23:55,152::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:23:55,152::task::1168::TaskManager.Task::(prepare) Task=`1c204f01-3da7-40fa-abf2-da655e14de96`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:23:55,152::task::579::TaskManager.Task::(_updateState) Task=`1c204f01-3da7-40fa-abf2-da655e14de96`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:23:55,152::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:23:55,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:23:55,152::task::974::TaskManager.Task::(_decref) Task=`1c204f01-3da7-40fa-abf2-da655e14de96`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:23:55,153::task::579::TaskManager.Task::(_updateState) Task=`c9e57db1-f8cf-4d5e-8717-eb57c061273a`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:23:55,153::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:23:55,153::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:23:55,153::task::1168::TaskManager.Task::(prepare) Task=`c9e57db1-f8cf-4d5e-8717-eb57c061273a`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:23:55,153::task::579::TaskManager.Task::(_updateState) Task=`c9e57db1-f8cf-4d5e-8717-eb57c061273a`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:23:55,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:23:55,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:23:55,154::task::974::TaskManager.Task::(_decref) Task=`c9e57db1-f8cf-4d5e-8717-eb57c061273a`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:23:55,154::task::579::TaskManager.Task::(_updateState) Task=`f340c6fc-9694-4ea4-923d-ea9848dc5906`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:23:55,154::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:23:55,154::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:23:55,154::task::1168::TaskManager.Task::(prepare) Task=`f340c6fc-9694-4ea4-923d-ea9848dc5906`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:23:55,155::task::579::TaskManager.Task::(_updateState) Task=`f340c6fc-9694-4ea4-923d-ea9848dc5906`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:23:55,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:23:55,155::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:23:55,155::task::974::TaskManager.Task::(_decref) Task=`f340c6fc-9694-4ea4-923d-ea9848dc5906`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:23:55,291::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:56,292::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:56,444::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:23:56,767::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:23:56,784::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000297083 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:57,293::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:23:58,295::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:23:58,445::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:23:58,446::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:23:58,860::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:23:58,877::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000272834 s, 15.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:23:59,296::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:23:59,297::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:23:59,297::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:23:59,740::task::579::TaskManager.Task::(_updateState) Task=`2e4e7135-89fb-490c-ad8a-76623905a6c7`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:23:59,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:23:59,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:23:59,740::task::1168::TaskManager.Task::(prepare) Task=`2e4e7135-89fb-490c-ad8a-76623905a6c7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:23:59,741::task::579::TaskManager.Task::(_updateState) Task=`2e4e7135-89fb-490c-ad8a-76623905a6c7`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:23:59,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:23:59,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:23:59,741::task::974::TaskManager.Task::(_decref) Task=`2e4e7135-89fb-490c-ad8a-76623905a6c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:00,298::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:24:00,298::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:00,448::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:01,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:24:01,300::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:24:01,300::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:02,302::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:24:02,302::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:02,449::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:03,303::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:24:03,303::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288085::DEBUG::2014-01-16 17:24:03,385::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmSetTicket with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', '0UI704Yq7WzX', '120', 'disconnect', {'userName': 'rhevadmin', 'userId': '88011004-16db-11e2-9b90-001a4a0cff04'}) {} flowID [71634701] >Thread-288085::DEBUG::2014-01-16 17:24:03,398::BindingXMLRPC::991::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-189817::DEBUG::2014-01-16 17:24:03,451::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:24:03,451::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:24:03,452::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:04,305::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:04,453::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:05,305::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:24:05,306::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:06,306::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:24:06,307::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:06,455::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:24:06,565::task::579::TaskManager.Task::(_updateState) Task=`58f5fe5e-4aed-4deb-97dc-2151ca47fd14`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:24:06,565::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:24:06,566::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:24:06,566::task::1168::TaskManager.Task::(prepare) Task=`58f5fe5e-4aed-4deb-97dc-2151ca47fd14`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:24:06,566::task::579::TaskManager.Task::(_updateState) Task=`58f5fe5e-4aed-4deb-97dc-2151ca47fd14`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:24:06,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:24:06,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:24:06,566::task::974::TaskManager.Task::(_decref) Task=`58f5fe5e-4aed-4deb-97dc-2151ca47fd14`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:24:06,792::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:24:06,810::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00025878 s, 1.4 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,034::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,096::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,104::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,122::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,149::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,150::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 0 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,190::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:07,190::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 1 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >VM Channels Listener::DEBUG::2014-01-16 17:24:07,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:24:07,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:24:07,308::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:24:07,309::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:08,310::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:24:08,310::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:24:08,310::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:08,456::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:08,457::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:24:08,883::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:24:08,899::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000249534 s, 16.4 MB/s\n'; <rc> = 0 >Thread-288087::DEBUG::2014-01-16 17:24:09,042::task::579::TaskManager.Task::(_updateState) Task=`3077ff25-9f96-4a18-a223-455f9baae965`::moving from state init -> state preparing >Thread-288087::INFO::2014-01-16 17:24:09,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288087::INFO::2014-01-16 17:24:09,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025878', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249534', 'lastCheck': '0.1', 'valid': True}} >Thread-288087::DEBUG::2014-01-16 17:24:09,042::task::1168::TaskManager.Task::(prepare) Task=`3077ff25-9f96-4a18-a223-455f9baae965`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00025878', 'lastCheck': '2.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249534', 'lastCheck': '0.1', 'valid': True}} >Thread-288087::DEBUG::2014-01-16 17:24:09,043::task::579::TaskManager.Task::(_updateState) Task=`3077ff25-9f96-4a18-a223-455f9baae965`::moving from state preparing -> state finished >Thread-288087::DEBUG::2014-01-16 17:24:09,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288087::DEBUG::2014-01-16 17:24:09,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288087::DEBUG::2014-01-16 17:24:09,043::task::974::TaskManager.Task::(_decref) Task=`3077ff25-9f96-4a18-a223-455f9baae965`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:24:09,180::task::579::TaskManager.Task::(_updateState) Task=`96a8937b-662a-49dd-a3b8-b6178e305084`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:24:09,182::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:24:09,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:24:09,185::task::1168::TaskManager.Task::(prepare) Task=`96a8937b-662a-49dd-a3b8-b6178e305084`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:24:09,186::task::579::TaskManager.Task::(_updateState) Task=`96a8937b-662a-49dd-a3b8-b6178e305084`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:24:09,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:24:09,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:24:09,188::task::974::TaskManager.Task::(_decref) Task=`96a8937b-662a-49dd-a3b8-b6178e305084`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:24:09,197::task::579::TaskManager.Task::(_updateState) Task=`0c514bf6-e052-45a1-9621-2d9ef032fee4`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:24:09,198::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:24:09,198::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:24:09,198::task::1168::TaskManager.Task::(prepare) Task=`0c514bf6-e052-45a1-9621-2d9ef032fee4`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:24:09,198::task::579::TaskManager.Task::(_updateState) Task=`0c514bf6-e052-45a1-9621-2d9ef032fee4`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:24:09,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:24:09,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:24:09,199::task::974::TaskManager.Task::(_decref) Task=`0c514bf6-e052-45a1-9621-2d9ef032fee4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:09,311::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:24:09,311::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:10,312::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:24:10,313::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:24:10,313::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:24:10,313::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:10,458::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:11,314::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:24:11,329::task::579::TaskManager.Task::(_updateState) Task=`5df5dcd8-e7f5-482e-820f-1d3f83ef8af7`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:24:11,329::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:24:11,329::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:24:11,330::task::1168::TaskManager.Task::(prepare) Task=`5df5dcd8-e7f5-482e-820f-1d3f83ef8af7`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:24:11,330::task::579::TaskManager.Task::(_updateState) Task=`5df5dcd8-e7f5-482e-820f-1d3f83ef8af7`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:24:11,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:24:11,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:24:11,330::task::974::TaskManager.Task::(_decref) Task=`5df5dcd8-e7f5-482e-820f-1d3f83ef8af7`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:24:11,330::task::579::TaskManager.Task::(_updateState) Task=`b38ab05d-8321-434b-b59e-2162658c7c95`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:24:11,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:24:11,331::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:24:11,331::task::1168::TaskManager.Task::(prepare) Task=`b38ab05d-8321-434b-b59e-2162658c7c95`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:24:11,331::task::579::TaskManager.Task::(_updateState) Task=`b38ab05d-8321-434b-b59e-2162658c7c95`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:24:11,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:24:11,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:24:11,331::task::974::TaskManager.Task::(_decref) Task=`b38ab05d-8321-434b-b59e-2162658c7c95`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:12,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:24:12,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:24:12,316::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:24:12,316::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:12,316::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:24:12,317::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:24:12,460::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:13,318::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-131629::DEBUG::2014-01-16 17:24:13,457::task::579::TaskManager.Task::(_updateState) Task=`0fa99aee-a089-4d2a-b2f5-245a6cae8b43`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:24:13,458::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:24:13,458::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:24:13,458::task::1168::TaskManager.Task::(prepare) Task=`0fa99aee-a089-4d2a-b2f5-245a6cae8b43`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:24:13,458::task::579::TaskManager.Task::(_updateState) Task=`0fa99aee-a089-4d2a-b2f5-245a6cae8b43`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:24:13,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:24:13,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:24:13,459::task::974::TaskManager.Task::(_decref) Task=`0fa99aee-a089-4d2a-b2f5-245a6cae8b43`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:24:13,461::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:24:14,042::task::579::TaskManager.Task::(_updateState) Task=`f373b399-3984-497a-bee8-fb682ab3a277`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:24:14,042::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:24:14,043::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:24:14,043::task::1168::TaskManager.Task::(prepare) Task=`f373b399-3984-497a-bee8-fb682ab3a277`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:24:14,043::task::579::TaskManager.Task::(_updateState) Task=`f373b399-3984-497a-bee8-fb682ab3a277`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:24:14,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:24:14,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:24:14,043::task::974::TaskManager.Task::(_decref) Task=`f373b399-3984-497a-bee8-fb682ab3a277`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:24:14,044::task::579::TaskManager.Task::(_updateState) Task=`4c5ca110-9ee6-4519-8544-cf4d3b047665`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:24:14,044::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:24:14,044::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:24:14,044::task::1168::TaskManager.Task::(prepare) Task=`4c5ca110-9ee6-4519-8544-cf4d3b047665`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:24:14,044::task::579::TaskManager.Task::(_updateState) Task=`4c5ca110-9ee6-4519-8544-cf4d3b047665`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:24:14,044::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:24:14,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:24:14,045::task::974::TaskManager.Task::(_decref) Task=`4c5ca110-9ee6-4519-8544-cf4d3b047665`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-01-16 17:24:14,299::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:14,299::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:14,300::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:14,300::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-01-16 17:24:14,301::clientIF::585::vm.Vm::(dispatchLibvirtEvents) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::graphics event phase 2 localAddr {'node': '10.34.57.35', 'service': '', 'family': 0} remoteAddr {'node': '10.34.1.189', 'service': '', 'family': 0}authScheme subject [] >VM Channels Listener::DEBUG::2014-01-16 17:24:14,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:24:14,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:24:14,320::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:14,463::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:15,320::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:24:15,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:24:15,321::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288090::DEBUG::2014-01-16 17:24:16,299::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-288091::DEBUG::2014-01-16 17:24:16,300::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-288092::DEBUG::2014-01-16 17:24:16,300::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-288093::DEBUG::2014-01-16 17:24:16,301::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >Thread-288094::DEBUG::2014-01-16 17:24:16,301::guestIF::278::vm.Vm::(desktopLock) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::desktopLock called >VM Channels Listener::DEBUG::2014-01-16 17:24:16,321::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:24:16,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:24:16,322::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:24:16,322::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:16,464::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:24:16,818::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:24:16,834::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000317706 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:24:17,001::task::579::TaskManager.Task::(_updateState) Task=`8189205d-c99d-4d47-a6d6-00b728de58f2`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:24:17,002::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:24:17,002::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:24:17,002::task::1168::TaskManager.Task::(prepare) Task=`8189205d-c99d-4d47-a6d6-00b728de58f2`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:24:17,002::task::579::TaskManager.Task::(_updateState) Task=`8189205d-c99d-4d47-a6d6-00b728de58f2`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:24:17,003::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:24:17,003::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:24:17,003::task::974::TaskManager.Task::(_decref) Task=`8189205d-c99d-4d47-a6d6-00b728de58f2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:17,323::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:24:17,402::task::579::TaskManager.Task::(_updateState) Task=`ac96f85c-9183-4210-a2de-62bf6cb01a61`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:24:17,402::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:24:17,402::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:24:17,402::task::1168::TaskManager.Task::(prepare) Task=`ac96f85c-9183-4210-a2de-62bf6cb01a61`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:24:17,403::task::579::TaskManager.Task::(_updateState) Task=`ac96f85c-9183-4210-a2de-62bf6cb01a61`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:24:17,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:24:17,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:24:17,403::task::974::TaskManager.Task::(_decref) Task=`ac96f85c-9183-4210-a2de-62bf6cb01a61`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:18,324::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:24:18,324::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:18,465::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:18,466::task::579::TaskManager.Task::(_updateState) Task=`e236b347-eb5b-4b18-94b2-b837a1baba54`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:24:18,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:24:18,466::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:24:18,467::task::1168::TaskManager.Task::(prepare) Task=`e236b347-eb5b-4b18-94b2-b837a1baba54`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:24:18,467::task::579::TaskManager.Task::(_updateState) Task=`e236b347-eb5b-4b18-94b2-b837a1baba54`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:24:18,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:24:18,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:24:18,467::task::974::TaskManager.Task::(_decref) Task=`e236b347-eb5b-4b18-94b2-b837a1baba54`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:24:18,469::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:24:18,469::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:24:18,471::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:18,473::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:18,474::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-184546::DEBUG::2014-01-16 17:24:18,894::task::579::TaskManager.Task::(_updateState) Task=`44d90761-72db-4c94-a71b-dc2e628f948a`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:24:18,895::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:24:18,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:24:18,895::task::1168::TaskManager.Task::(prepare) Task=`44d90761-72db-4c94-a71b-dc2e628f948a`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:24:18,895::task::579::TaskManager.Task::(_updateState) Task=`44d90761-72db-4c94-a71b-dc2e628f948a`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:24:18,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:24:18,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:24:18,896::task::974::TaskManager.Task::(_decref) Task=`44d90761-72db-4c94-a71b-dc2e628f948a`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:24:18,904::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:24:18,921::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000214959 s, 19.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:19,326::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84402::DEBUG::2014-01-16 17:24:19,433::task::579::TaskManager.Task::(_updateState) Task=`b5c9789f-1070-4897-b508-6330cc5c1762`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:24:19,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:24:19,434::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:24:19,434::task::1168::TaskManager.Task::(prepare) Task=`b5c9789f-1070-4897-b508-6330cc5c1762`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:24:19,434::task::579::TaskManager.Task::(_updateState) Task=`b5c9789f-1070-4897-b508-6330cc5c1762`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:24:19,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:24:19,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:24:19,435::task::974::TaskManager.Task::(_decref) Task=`b5c9789f-1070-4897-b508-6330cc5c1762`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:24:19,986::task::579::TaskManager.Task::(_updateState) Task=`94188802-09ce-41c2-8a49-845bd2f45781`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:24:19,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:24:19,987::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:24:19,987::task::1168::TaskManager.Task::(prepare) Task=`94188802-09ce-41c2-8a49-845bd2f45781`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:24:19,987::task::579::TaskManager.Task::(_updateState) Task=`94188802-09ce-41c2-8a49-845bd2f45781`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:24:19,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:24:19,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:24:19,988::task::974::TaskManager.Task::(_decref) Task=`94188802-09ce-41c2-8a49-845bd2f45781`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:24:19,988::task::579::TaskManager.Task::(_updateState) Task=`167e14ee-b9c6-4d8a-9279-dfc766c2eabc`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:24:19,988::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:24:19,988::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:24:19,988::task::1168::TaskManager.Task::(prepare) Task=`167e14ee-b9c6-4d8a-9279-dfc766c2eabc`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:24:19,989::task::579::TaskManager.Task::(_updateState) Task=`167e14ee-b9c6-4d8a-9279-dfc766c2eabc`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:24:19,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:24:19,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:24:19,989::task::974::TaskManager.Task::(_decref) Task=`167e14ee-b9c6-4d8a-9279-dfc766c2eabc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:20,327::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288097::DEBUG::2014-01-16 17:24:20,335::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmShutdown with ('10bce6b5-ab25-452b-a8e2-24309deae8b7', '30', 'System Administrator has initiated shutdown of this Virtual Machine. Virtual Machine is shutting down.') {} flowID [7c29e22e] >Thread-288097::DEBUG::2014-01-16 17:24:20,338::BindingXMLRPC::991::vds::(wrapper) return vmShutdown with {'status': {'message': 'Machine shut down', 'code': 0}} >Thread-189817::DEBUG::2014-01-16 17:24:20,475::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:24:20,864::task::579::TaskManager.Task::(_updateState) Task=`22f269e1-8b63-4310-96e4-22d41f366cb0`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:24:20,865::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:24:20,865::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:24:20,865::task::1168::TaskManager.Task::(prepare) Task=`22f269e1-8b63-4310-96e4-22d41f366cb0`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:24:20,865::task::579::TaskManager.Task::(_updateState) Task=`22f269e1-8b63-4310-96e4-22d41f366cb0`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:24:20,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:24:20,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:24:20,866::task::974::TaskManager.Task::(_decref) Task=`22f269e1-8b63-4310-96e4-22d41f366cb0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:21,329::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288099::DEBUG::2014-01-16 17:24:21,897::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288099::DEBUG::2014-01-16 17:24:21,898::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.18', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.67', 'elapsedTime': '512', 'vmType': 'kvm', 'cpuSys': '1.93', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:24:22,330::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:22,476::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:23,332::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:24:23,332::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:23,477::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:24:23,520::task::579::TaskManager.Task::(_updateState) Task=`91ecad5f-8ec9-47e6-83b6-224fb2484360`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:24:23,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:24:23,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:24:23,521::task::1168::TaskManager.Task::(prepare) Task=`91ecad5f-8ec9-47e6-83b6-224fb2484360`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:24:23,521::task::579::TaskManager.Task::(_updateState) Task=`91ecad5f-8ec9-47e6-83b6-224fb2484360`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:24:23,521::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:24:23,521::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:24:23,521::task::974::TaskManager.Task::(_decref) Task=`91ecad5f-8ec9-47e6-83b6-224fb2484360`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:24,334::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:24:24,334::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:24,478::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288100::DEBUG::2014-01-16 17:24:24,995::task::579::TaskManager.Task::(_updateState) Task=`9e3525fa-f8a4-4e94-846b-2d143b32bb9e`::moving from state init -> state preparing >Thread-288100::INFO::2014-01-16 17:24:24,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288100::INFO::2014-01-16 17:24:24,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317706', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000214959', 'lastCheck': '6.1', 'valid': True}} >Thread-288100::DEBUG::2014-01-16 17:24:24,996::task::1168::TaskManager.Task::(prepare) Task=`9e3525fa-f8a4-4e94-846b-2d143b32bb9e`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000317706', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000214959', 'lastCheck': '6.1', 'valid': True}} >Thread-288100::DEBUG::2014-01-16 17:24:24,996::task::579::TaskManager.Task::(_updateState) Task=`9e3525fa-f8a4-4e94-846b-2d143b32bb9e`::moving from state preparing -> state finished >Thread-288100::DEBUG::2014-01-16 17:24:24,996::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288100::DEBUG::2014-01-16 17:24:24,996::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288100::DEBUG::2014-01-16 17:24:24,996::task::974::TaskManager.Task::(_decref) Task=`9e3525fa-f8a4-4e94-846b-2d143b32bb9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:25,335::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:26,337::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-49313::DEBUG::2014-01-16 17:24:26,374::task::579::TaskManager.Task::(_updateState) Task=`06947525-c1f5-4d92-be52-d5ca008b8aa3`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:24:26,374::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:24:26,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:24:26,375::task::1168::TaskManager.Task::(prepare) Task=`06947525-c1f5-4d92-be52-d5ca008b8aa3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:24:26,375::task::579::TaskManager.Task::(_updateState) Task=`06947525-c1f5-4d92-be52-d5ca008b8aa3`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:24:26,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:24:26,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:24:26,375::task::974::TaskManager.Task::(_decref) Task=`06947525-c1f5-4d92-be52-d5ca008b8aa3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:24:26,480::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:24:26,842::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:24:26,859::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000255957 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:27,338::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:24:28,123::task::579::TaskManager.Task::(_updateState) Task=`1dfc0c3e-31bd-4fff-9606-c78f8385b5ca`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:24:28,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:24:28,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:24:28,124::task::1168::TaskManager.Task::(prepare) Task=`1dfc0c3e-31bd-4fff-9606-c78f8385b5ca`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:24:28,124::task::579::TaskManager.Task::(_updateState) Task=`1dfc0c3e-31bd-4fff-9606-c78f8385b5ca`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:24:28,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:24:28,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:24:28,124::task::974::TaskManager.Task::(_decref) Task=`1dfc0c3e-31bd-4fff-9606-c78f8385b5ca`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:28,340::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:28,481::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:28,482::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288103::DEBUG::2014-01-16 17:24:28,630::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288103::DEBUG::2014-01-16 17:24:28,631::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'elapsedTime': '519', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:24:28,928::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:24:28,946::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000301528 s, 13.6 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 17:24:29,246::task::579::TaskManager.Task::(_updateState) Task=`1c1b9e79-02c5-4de3-b78b-dda59af55164`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:24:29,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:24:29,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:24:29,247::task::1168::TaskManager.Task::(prepare) Task=`1c1b9e79-02c5-4de3-b78b-dda59af55164`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:24:29,248::task::579::TaskManager.Task::(_updateState) Task=`1c1b9e79-02c5-4de3-b78b-dda59af55164`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:24:29,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:24:29,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:24:29,248::task::974::TaskManager.Task::(_decref) Task=`1c1b9e79-02c5-4de3-b78b-dda59af55164`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:24:29,249::task::579::TaskManager.Task::(_updateState) Task=`0a9d5a6e-688d-42a2-8bae-3cd2c7df8170`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:24:29,249::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:24:29,250::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:24:29,250::task::1168::TaskManager.Task::(prepare) Task=`0a9d5a6e-688d-42a2-8bae-3cd2c7df8170`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:24:29,250::task::579::TaskManager.Task::(_updateState) Task=`0a9d5a6e-688d-42a2-8bae-3cd2c7df8170`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:24:29,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:24:29,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:24:29,251::task::974::TaskManager.Task::(_decref) Task=`0a9d5a6e-688d-42a2-8bae-3cd2c7df8170`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:24:29,251::task::579::TaskManager.Task::(_updateState) Task=`1a9bb50f-c4f1-4031-81d3-f2890d21e19e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:24:29,252::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:24:29,252::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:24:29,252::task::1168::TaskManager.Task::(prepare) Task=`1a9bb50f-c4f1-4031-81d3-f2890d21e19e`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:24:29,252::task::579::TaskManager.Task::(_updateState) Task=`1a9bb50f-c4f1-4031-81d3-f2890d21e19e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:24:29,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:24:29,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:24:29,253::task::974::TaskManager.Task::(_decref) Task=`1a9bb50f-c4f1-4031-81d3-f2890d21e19e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:29,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:24:29,341::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:24:29,341::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:30,343::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:24:30,343::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:30,484::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:31,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:24:31,344::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:24:31,345::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288105::DEBUG::2014-01-16 17:24:31,728::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288105::DEBUG::2014-01-16 17:24:31,730::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.49', 'elapsedTime': '522', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:24:32,346::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:24:32,346::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:32,485::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:33,348::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:24:33,348::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:33,487::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:24:33,488::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:24:33,489::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:24:34,046::task::579::TaskManager.Task::(_updateState) Task=`311f63ce-32d8-46a2-b6ed-026b5bf2c04e`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:24:34,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:24:34,047::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:24:34,047::task::1168::TaskManager.Task::(prepare) Task=`311f63ce-32d8-46a2-b6ed-026b5bf2c04e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:24:34,047::task::579::TaskManager.Task::(_updateState) Task=`311f63ce-32d8-46a2-b6ed-026b5bf2c04e`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:24:34,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:24:34,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:24:34,048::task::974::TaskManager.Task::(_decref) Task=`311f63ce-32d8-46a2-b6ed-026b5bf2c04e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:34,349::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:34,490::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288107::DEBUG::2014-01-16 17:24:34,842::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288107::DEBUG::2014-01-16 17:24:34,843::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.61', 'elapsedTime': '525', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:24:35,349::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:24:35,350::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:36,350::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:24:36,351::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:36,491::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:24:36,867::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:24:36,883::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264393 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:37,352::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:24:37,352::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:24:37,352::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:24:37,352::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288109::DEBUG::2014-01-16 17:24:37,958::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288109::DEBUG::2014-01-16 17:24:37,960::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.72', 'elapsedTime': '529', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-3175::DEBUG::2014-01-16 17:24:38,016::task::579::TaskManager.Task::(_updateState) Task=`0c5de4b8-700c-4430-a297-778f50e08b49`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:24:38,017::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:24:38,017::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:24:38,017::task::1168::TaskManager.Task::(prepare) Task=`0c5de4b8-700c-4430-a297-778f50e08b49`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:24:38,017::task::579::TaskManager.Task::(_updateState) Task=`0c5de4b8-700c-4430-a297-778f50e08b49`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:24:38,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:24:38,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:24:38,018::task::974::TaskManager.Task::(_decref) Task=`0c5de4b8-700c-4430-a297-778f50e08b49`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:24:38,057::task::579::TaskManager.Task::(_updateState) Task=`2308313c-d37e-44bd-9e0f-6ec23ed51339`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:24:38,057::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:24:38,058::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:24:38,058::task::1168::TaskManager.Task::(prepare) Task=`2308313c-d37e-44bd-9e0f-6ec23ed51339`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:24:38,058::task::579::TaskManager.Task::(_updateState) Task=`2308313c-d37e-44bd-9e0f-6ec23ed51339`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:24:38,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:24:38,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:24:38,058::task::974::TaskManager.Task::(_decref) Task=`2308313c-d37e-44bd-9e0f-6ec23ed51339`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:38,353::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:24:38,354::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:24:38,354::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:38,493::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:38,494::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:24:38,952::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:24:38,973::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000314953 s, 13.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:39,355::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:24:39,355::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:40,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:24:40,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:24:40,356::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:24:40,356::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:40,496::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288110::DEBUG::2014-01-16 17:24:41,021::task::579::TaskManager.Task::(_updateState) Task=`60df64b7-b888-43df-916f-4490d593db0a`::moving from state init -> state preparing >Thread-288110::INFO::2014-01-16 17:24:41,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288110::INFO::2014-01-16 17:24:41,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264393', 'lastCheck': '4.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314953', 'lastCheck': '2.0', 'valid': True}} >Thread-288110::DEBUG::2014-01-16 17:24:41,022::task::1168::TaskManager.Task::(prepare) Task=`60df64b7-b888-43df-916f-4490d593db0a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264393', 'lastCheck': '4.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314953', 'lastCheck': '2.0', 'valid': True}} >Thread-288110::DEBUG::2014-01-16 17:24:41,022::task::579::TaskManager.Task::(_updateState) Task=`60df64b7-b888-43df-916f-4490d593db0a`::moving from state preparing -> state finished >Thread-288110::DEBUG::2014-01-16 17:24:41,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288110::DEBUG::2014-01-16 17:24:41,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288110::DEBUG::2014-01-16 17:24:41,022::task::974::TaskManager.Task::(_decref) Task=`60df64b7-b888-43df-916f-4490d593db0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:41,357::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:42,358::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:24:42,359::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:24:42,359::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:24:42,359::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:42,359::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:24:42,359::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:24:42,497::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:24:42,834::task::579::TaskManager.Task::(_updateState) Task=`8e538387-83e1-40a7-8c1d-7fcf61d09c7c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:24:42,835::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:24:42,835::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:24:42,835::task::1168::TaskManager.Task::(prepare) Task=`8e538387-83e1-40a7-8c1d-7fcf61d09c7c`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:24:42,835::task::579::TaskManager.Task::(_updateState) Task=`8e538387-83e1-40a7-8c1d-7fcf61d09c7c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:24:42,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:24:42,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:24:42,836::task::974::TaskManager.Task::(_decref) Task=`8e538387-83e1-40a7-8c1d-7fcf61d09c7c`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:24:42,836::task::579::TaskManager.Task::(_updateState) Task=`cd2575f5-6f7f-4048-a6aa-9200ecd218b3`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:24:42,836::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:24:42,836::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:24:42,836::task::1168::TaskManager.Task::(prepare) Task=`cd2575f5-6f7f-4048-a6aa-9200ecd218b3`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:24:42,837::task::579::TaskManager.Task::(_updateState) Task=`cd2575f5-6f7f-4048-a6aa-9200ecd218b3`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:24:42,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:24:42,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:24:42,837::task::974::TaskManager.Task::(_decref) Task=`cd2575f5-6f7f-4048-a6aa-9200ecd218b3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:43,361::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:43,498::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:24:43,578::task::579::TaskManager.Task::(_updateState) Task=`50e7f71f-e890-4547-b3f6-ff40baa8d9b9`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:24:43,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:24:43,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:24:43,579::task::1168::TaskManager.Task::(prepare) Task=`50e7f71f-e890-4547-b3f6-ff40baa8d9b9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:24:43,579::task::579::TaskManager.Task::(_updateState) Task=`50e7f71f-e890-4547-b3f6-ff40baa8d9b9`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:24:43,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:24:43,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:24:43,579::task::974::TaskManager.Task::(_decref) Task=`50e7f71f-e890-4547-b3f6-ff40baa8d9b9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:44,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:24:44,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:24:44,362::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:44,500::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288113::DEBUG::2014-01-16 17:24:44,564::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288113::DEBUG::2014-01-16 17:24:44,565::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.32', 'elapsedTime': '535', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-3168::DEBUG::2014-01-16 17:24:45,335::task::579::TaskManager.Task::(_updateState) Task=`ddb8e69f-7e6b-4c38-b8fd-31e7f2b76722`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:24:45,335::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:24:45,335::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:24:45,336::task::1168::TaskManager.Task::(prepare) Task=`ddb8e69f-7e6b-4c38-b8fd-31e7f2b76722`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:24:45,336::task::579::TaskManager.Task::(_updateState) Task=`ddb8e69f-7e6b-4c38-b8fd-31e7f2b76722`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:24:45,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:24:45,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:24:45,336::task::974::TaskManager.Task::(_decref) Task=`ddb8e69f-7e6b-4c38-b8fd-31e7f2b76722`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:45,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:24:45,363::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:24:45,363::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:46,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:24:46,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:24:46,364::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:24:46,364::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:46,501::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:24:46,672::task::579::TaskManager.Task::(_updateState) Task=`e8ad08d8-0e76-4a5f-b428-1b22e449aee5`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:24:46,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:24:46,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:24:46,673::task::1168::TaskManager.Task::(prepare) Task=`e8ad08d8-0e76-4a5f-b428-1b22e449aee5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:24:46,673::task::579::TaskManager.Task::(_updateState) Task=`e8ad08d8-0e76-4a5f-b428-1b22e449aee5`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:24:46,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:24:46,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:24:46,674::task::974::TaskManager.Task::(_decref) Task=`e8ad08d8-0e76-4a5f-b428-1b22e449aee5`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:24:46,771::task::579::TaskManager.Task::(_updateState) Task=`d8d1a34d-c183-4326-b4f1-7ceedd6cf6ae`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:24:46,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:24:46,772::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:24:46,772::task::1168::TaskManager.Task::(prepare) Task=`d8d1a34d-c183-4326-b4f1-7ceedd6cf6ae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:24:46,772::task::579::TaskManager.Task::(_updateState) Task=`d8d1a34d-c183-4326-b4f1-7ceedd6cf6ae`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:24:46,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:24:46,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:24:46,773::task::974::TaskManager.Task::(_decref) Task=`d8d1a34d-c183-4326-b4f1-7ceedd6cf6ae`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:24:46,779::task::579::TaskManager.Task::(_updateState) Task=`fbd5ca84-c0d6-4b16-95c1-54dfe6c0e4b1`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:24:46,780::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:24:46,780::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:24:46,780::task::1168::TaskManager.Task::(prepare) Task=`fbd5ca84-c0d6-4b16-95c1-54dfe6c0e4b1`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:24:46,780::task::579::TaskManager.Task::(_updateState) Task=`fbd5ca84-c0d6-4b16-95c1-54dfe6c0e4b1`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:24:46,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:24:46,781::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:24:46,781::task::974::TaskManager.Task::(_decref) Task=`fbd5ca84-c0d6-4b16-95c1-54dfe6c0e4b1`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:24:46,890::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:24:46,907::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000241593 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:47,365::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:24:47,534::task::579::TaskManager.Task::(_updateState) Task=`cdbd4043-ee09-48e0-a181-e7d07b86cfd9`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:24:47,535::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:24:47,535::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:24:47,535::task::1168::TaskManager.Task::(prepare) Task=`cdbd4043-ee09-48e0-a181-e7d07b86cfd9`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:24:47,535::task::579::TaskManager.Task::(_updateState) Task=`cdbd4043-ee09-48e0-a181-e7d07b86cfd9`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:24:47,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:24:47,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:24:47,536::task::974::TaskManager.Task::(_decref) Task=`cdbd4043-ee09-48e0-a181-e7d07b86cfd9`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:24:47,555::task::579::TaskManager.Task::(_updateState) Task=`248e74ef-bc41-4432-87c9-2a48f6f4538f`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:24:47,556::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:24:47,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:24:47,556::task::1168::TaskManager.Task::(prepare) Task=`248e74ef-bc41-4432-87c9-2a48f6f4538f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:24:47,556::task::579::TaskManager.Task::(_updateState) Task=`248e74ef-bc41-4432-87c9-2a48f6f4538f`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:24:47,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:24:47,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:24:47,557::task::974::TaskManager.Task::(_decref) Task=`248e74ef-bc41-4432-87c9-2a48f6f4538f`::ref 0 aborting False >Thread-288115::DEBUG::2014-01-16 17:24:47,686::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288115::DEBUG::2014-01-16 17:24:47,688::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.45', 'elapsedTime': '538', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:24:48,366::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:24:48,366::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:48,502::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:48,504::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:24:48,504::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:24:48,505::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:24:48,979::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:24:48,997::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000213707 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:49,367::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:50,369::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:50,507::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288117::DEBUG::2014-01-16 17:24:50,795::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288117::DEBUG::2014-01-16 17:24:50,796::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.10', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.55', 'elapsedTime': '541', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:24:51,370::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:24:52,241::task::579::TaskManager.Task::(_updateState) Task=`0d8067c5-d624-414e-9a73-2a8c709df6c6`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:24:52,242::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:24:52,243::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:24:52,243::task::1168::TaskManager.Task::(prepare) Task=`0d8067c5-d624-414e-9a73-2a8c709df6c6`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:24:52,243::task::579::TaskManager.Task::(_updateState) Task=`0d8067c5-d624-414e-9a73-2a8c709df6c6`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:24:52,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:24:52,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:24:52,244::task::974::TaskManager.Task::(_decref) Task=`0d8067c5-d624-414e-9a73-2a8c709df6c6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:52,371::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:52,508::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:24:53,373::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:24:53,373::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:53,509::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288119::DEBUG::2014-01-16 17:24:53,895::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288119::DEBUG::2014-01-16 17:24:53,896::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.65', 'elapsedTime': '544', 'vmType': 'kvm', 'cpuSys': '0.87', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:24:54,374::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:24:54,375::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:54,511::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:24:54,672::task::579::TaskManager.Task::(_updateState) Task=`e133446b-3574-48c4-9426-122df8780f18`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:24:54,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:24:54,672::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:24:54,672::task::1168::TaskManager.Task::(prepare) Task=`e133446b-3574-48c4-9426-122df8780f18`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:24:54,673::task::579::TaskManager.Task::(_updateState) Task=`e133446b-3574-48c4-9426-122df8780f18`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:24:54,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:24:54,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:24:54,673::task::974::TaskManager.Task::(_decref) Task=`e133446b-3574-48c4-9426-122df8780f18`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:55,376::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:24:55,428::task::579::TaskManager.Task::(_updateState) Task=`1712d10f-b213-4540-a459-5957d6666133`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:24:55,429::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:24:55,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:24:55,429::task::1168::TaskManager.Task::(prepare) Task=`1712d10f-b213-4540-a459-5957d6666133`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:24:55,429::task::579::TaskManager.Task::(_updateState) Task=`1712d10f-b213-4540-a459-5957d6666133`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:24:55,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:24:55,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:24:55,430::task::974::TaskManager.Task::(_decref) Task=`1712d10f-b213-4540-a459-5957d6666133`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:24:55,430::task::579::TaskManager.Task::(_updateState) Task=`c0ad2adf-ccf3-4cdf-8372-d8367cc962a2`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:24:55,430::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:24:55,430::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:24:55,431::task::1168::TaskManager.Task::(prepare) Task=`c0ad2adf-ccf3-4cdf-8372-d8367cc962a2`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:24:55,431::task::579::TaskManager.Task::(_updateState) Task=`c0ad2adf-ccf3-4cdf-8372-d8367cc962a2`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:24:55,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:24:55,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:24:55,431::task::974::TaskManager.Task::(_decref) Task=`c0ad2adf-ccf3-4cdf-8372-d8367cc962a2`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:24:55,431::task::579::TaskManager.Task::(_updateState) Task=`b97d86e8-01e8-45a1-a519-6c7b1c1e7675`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:24:55,432::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:24:55,432::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:24:55,432::task::1168::TaskManager.Task::(prepare) Task=`b97d86e8-01e8-45a1-a519-6c7b1c1e7675`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:24:55,432::task::579::TaskManager.Task::(_updateState) Task=`b97d86e8-01e8-45a1-a519-6c7b1c1e7675`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:24:55,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:24:55,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:24:55,432::task::974::TaskManager.Task::(_decref) Task=`b97d86e8-01e8-45a1-a519-6c7b1c1e7675`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:56,378::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:56,512::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:24:56,914::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:24:56,931::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000399449 s, 914 kB/s\n'; <rc> = 0 >Thread-288120::DEBUG::2014-01-16 17:24:56,953::task::579::TaskManager.Task::(_updateState) Task=`f485ba9c-ed43-488b-8c00-b816e4596cde`::moving from state init -> state preparing >Thread-288120::INFO::2014-01-16 17:24:56,954::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288120::INFO::2014-01-16 17:24:56,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000399449', 'lastCheck': '0.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213707', 'lastCheck': '8.0', 'valid': True}} >Thread-288120::DEBUG::2014-01-16 17:24:56,954::task::1168::TaskManager.Task::(prepare) Task=`f485ba9c-ed43-488b-8c00-b816e4596cde`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000399449', 'lastCheck': '0.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000213707', 'lastCheck': '8.0', 'valid': True}} >Thread-288120::DEBUG::2014-01-16 17:24:56,954::task::579::TaskManager.Task::(_updateState) Task=`f485ba9c-ed43-488b-8c00-b816e4596cde`::moving from state preparing -> state finished >Thread-288120::DEBUG::2014-01-16 17:24:56,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288120::DEBUG::2014-01-16 17:24:56,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288120::DEBUG::2014-01-16 17:24:56,955::task::974::TaskManager.Task::(_decref) Task=`f485ba9c-ed43-488b-8c00-b816e4596cde`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:24:57,379::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:24:58,380::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:24:58,514::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:24:58,515::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:24:59,004::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:24:59,021::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000283901 s, 14.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:24:59,381::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:24:59,381::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:24:59,382::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:24:59,913::task::579::TaskManager.Task::(_updateState) Task=`15787506-9674-4908-8161-df06db29af1e`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:24:59,913::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:24:59,914::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:24:59,914::task::1168::TaskManager.Task::(prepare) Task=`15787506-9674-4908-8161-df06db29af1e`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:24:59,914::task::579::TaskManager.Task::(_updateState) Task=`15787506-9674-4908-8161-df06db29af1e`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:24:59,914::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:24:59,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:24:59,914::task::974::TaskManager.Task::(_decref) Task=`15787506-9674-4908-8161-df06db29af1e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:00,383::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:25:00,383::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:00,516::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288123::DEBUG::2014-01-16 17:25:00,538::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288123::DEBUG::2014-01-16 17:25:00,540::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.25', 'elapsedTime': '551', 'vmType': 'kvm', 'cpuSys': '0.87', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:01,384::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:25:01,385::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:25:01,385::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:02,386::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:25:02,386::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:02,518::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:03,387::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:25:03,387::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:03,520::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:25:03,520::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:25:03,523::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288125::DEBUG::2014-01-16 17:25:03,672::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288125::DEBUG::2014-01-16 17:25:03,674::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.38', 'elapsedTime': '554', 'vmType': 'kvm', 'cpuSys': '0.87', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:04,388::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:04,524::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:05,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:25:05,389::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:06,390::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:25:06,390::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:06,526::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:25:06,739::task::579::TaskManager.Task::(_updateState) Task=`d698bdd2-ec2a-4766-9c25-8bb6d9fe47ac`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:25:06,740::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:25:06,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:25:06,740::task::1168::TaskManager.Task::(prepare) Task=`d698bdd2-ec2a-4766-9c25-8bb6d9fe47ac`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:25:06,740::task::579::TaskManager.Task::(_updateState) Task=`d698bdd2-ec2a-4766-9c25-8bb6d9fe47ac`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:25:06,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:25:06,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:25:06,741::task::974::TaskManager.Task::(_decref) Task=`d698bdd2-ec2a-4766-9c25-8bb6d9fe47ac`::ref 0 aborting False >Thread-288127::DEBUG::2014-01-16 17:25:06,771::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288127::DEBUG::2014-01-16 17:25:06,772::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.07', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.48', 'elapsedTime': '557', 'vmType': 'kvm', 'cpuSys': '0.87', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:25:06,941::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:25:06,958::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000287384 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:07,392::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:25:07,392::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:25:07,392::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:25:07,393::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:08,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:25:08,394::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:25:08,394::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:08,528::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:08,529::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288128::DEBUG::2014-01-16 17:25:08,565::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [4dfb9a2d] >Thread-288128::INFO::2014-01-16 17:25:08,565::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-288128::DEBUG::2014-01-16 17:25:08,565::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-288128::ERROR::2014-01-16 17:25:08,585::BindingXMLRPC::1003::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in vmDestroy > return vm.destroy() > File "/usr/share/vdsm/API.py", line 329, in destroy > res = v.destroy() > File "/usr/share/vdsm/vm.py", line 4485, in destroy > response = self.releaseVm() > File "/usr/share/vdsm/vm.py", line 4417, in releaseVm > supervdsm.getProxy().removeFs(drive.path) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in removeFs > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >Exception: Cannot remove Fs that does not exists in: /var/run/vdsm/payload >Thread-22::DEBUG::2014-01-16 17:25:09,026::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:09,043::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0002025 s, 20.2 MB/s\n'; <rc> = 0 >Thread-53040::DEBUG::2014-01-16 17:25:09,263::task::579::TaskManager.Task::(_updateState) Task=`8864aa37-f177-4a23-994d-e4606f351dd1`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:25:09,263::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:25:09,264::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:25:09,264::task::1168::TaskManager.Task::(prepare) Task=`8864aa37-f177-4a23-994d-e4606f351dd1`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:25:09,264::task::579::TaskManager.Task::(_updateState) Task=`8864aa37-f177-4a23-994d-e4606f351dd1`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:25:09,265::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:25:09,265::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:25:09,265::task::974::TaskManager.Task::(_decref) Task=`8864aa37-f177-4a23-994d-e4606f351dd1`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:25:09,269::task::579::TaskManager.Task::(_updateState) Task=`f38ef959-4af3-48f5-987e-041d797c4cb2`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:25:09,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:25:09,271::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:25:09,271::task::1168::TaskManager.Task::(prepare) Task=`f38ef959-4af3-48f5-987e-041d797c4cb2`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:25:09,271::task::579::TaskManager.Task::(_updateState) Task=`f38ef959-4af3-48f5-987e-041d797c4cb2`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:25:09,271::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:25:09,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:25:09,272::task::974::TaskManager.Task::(_decref) Task=`f38ef959-4af3-48f5-987e-041d797c4cb2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:09,396::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:25:09,396::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288130::DEBUG::2014-01-16 17:25:09,869::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288130::DEBUG::2014-01-16 17:25:09,871::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.47', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.57', 'elapsedTime': '560', 'vmType': 'kvm', 'cpuSys': '2.26', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:10,397::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:25:10,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:25:10,398::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:25:10,398::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:10,531::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:11,399::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:25:11,425::task::579::TaskManager.Task::(_updateState) Task=`314f258f-5073-45f7-bbd4-46728f9a4624`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:25:11,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:25:11,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:25:11,427::task::1168::TaskManager.Task::(prepare) Task=`314f258f-5073-45f7-bbd4-46728f9a4624`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:25:11,427::task::579::TaskManager.Task::(_updateState) Task=`314f258f-5073-45f7-bbd4-46728f9a4624`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:25:11,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:25:11,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:25:11,427::task::974::TaskManager.Task::(_decref) Task=`314f258f-5073-45f7-bbd4-46728f9a4624`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:25:11,428::task::579::TaskManager.Task::(_updateState) Task=`d54d3448-1aea-45fc-809d-291049c7913b`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:25:11,428::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:25:11,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:25:11,429::task::1168::TaskManager.Task::(prepare) Task=`d54d3448-1aea-45fc-809d-291049c7913b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:25:11,429::task::579::TaskManager.Task::(_updateState) Task=`d54d3448-1aea-45fc-809d-291049c7913b`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:25:11,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:25:11,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:25:11,430::task::974::TaskManager.Task::(_decref) Task=`d54d3448-1aea-45fc-809d-291049c7913b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:12,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:25:12,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:25:12,400::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:25:12,401::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:12,401::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:25:12,402::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:25:12,532::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288131::DEBUG::2014-01-16 17:25:12,927::task::579::TaskManager.Task::(_updateState) Task=`8d8e0cfa-20e3-44d5-9049-b64c792d45c2`::moving from state init -> state preparing >Thread-288131::INFO::2014-01-16 17:25:12,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288131::INFO::2014-01-16 17:25:12,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287384', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002025', 'lastCheck': '3.9', 'valid': True}} >Thread-288131::DEBUG::2014-01-16 17:25:12,928::task::1168::TaskManager.Task::(prepare) Task=`8d8e0cfa-20e3-44d5-9049-b64c792d45c2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287384', 'lastCheck': '6.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002025', 'lastCheck': '3.9', 'valid': True}} >Thread-288131::DEBUG::2014-01-16 17:25:12,928::task::579::TaskManager.Task::(_updateState) Task=`8d8e0cfa-20e3-44d5-9049-b64c792d45c2`::moving from state preparing -> state finished >Thread-288131::DEBUG::2014-01-16 17:25:12,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288131::DEBUG::2014-01-16 17:25:12,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288131::DEBUG::2014-01-16 17:25:12,929::task::974::TaskManager.Task::(_decref) Task=`8d8e0cfa-20e3-44d5-9049-b64c792d45c2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:13,403::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:13,534::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:25:13,637::task::579::TaskManager.Task::(_updateState) Task=`5df977c4-b036-4a74-ad7c-dade163ab6c5`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:25:13,637::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:25:13,637::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:25:13,637::task::1168::TaskManager.Task::(prepare) Task=`5df977c4-b036-4a74-ad7c-dade163ab6c5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:25:13,637::task::579::TaskManager.Task::(_updateState) Task=`5df977c4-b036-4a74-ad7c-dade163ab6c5`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:25:13,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:25:13,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:25:13,638::task::974::TaskManager.Task::(_decref) Task=`5df977c4-b036-4a74-ad7c-dade163ab6c5`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:25:14,277::task::579::TaskManager.Task::(_updateState) Task=`d1f6e441-0656-4317-bd60-6817171f56fe`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:25:14,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:25:14,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:25:14,278::task::1168::TaskManager.Task::(prepare) Task=`d1f6e441-0656-4317-bd60-6817171f56fe`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:25:14,278::task::579::TaskManager.Task::(_updateState) Task=`d1f6e441-0656-4317-bd60-6817171f56fe`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:25:14,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:25:14,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:25:14,279::task::974::TaskManager.Task::(_decref) Task=`d1f6e441-0656-4317-bd60-6817171f56fe`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:25:14,279::task::579::TaskManager.Task::(_updateState) Task=`3ced5ce3-8b85-40df-87df-69290dc9aa16`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:25:14,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:25:14,280::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:25:14,280::task::1168::TaskManager.Task::(prepare) Task=`3ced5ce3-8b85-40df-87df-69290dc9aa16`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:25:14,280::task::579::TaskManager.Task::(_updateState) Task=`3ced5ce3-8b85-40df-87df-69290dc9aa16`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:25:14,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:25:14,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:25:14,281::task::974::TaskManager.Task::(_decref) Task=`3ced5ce3-8b85-40df-87df-69290dc9aa16`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:14,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:25:14,405::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:25:14,405::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:14,535::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:15,406::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:25:15,407::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:25:15,407::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:16,407::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:25:16,408::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:25:16,408::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:25:16,408::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288134::DEBUG::2014-01-16 17:25:16,470::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288134::DEBUG::2014-01-16 17:25:16,471::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.47', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.17', 'elapsedTime': '567', 'vmType': 'kvm', 'cpuSys': '2.26', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:25:16,537::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:25:16,966::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:25:16,983::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000278682 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:25:17,145::task::579::TaskManager.Task::(_updateState) Task=`4969bc9e-4348-4791-b81c-efe78c7b3f7c`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:25:17,146::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:25:17,146::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:25:17,146::task::1168::TaskManager.Task::(prepare) Task=`4969bc9e-4348-4791-b81c-efe78c7b3f7c`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:25:17,147::task::579::TaskManager.Task::(_updateState) Task=`4969bc9e-4348-4791-b81c-efe78c7b3f7c`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:25:17,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:25:17,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:25:17,147::task::974::TaskManager.Task::(_decref) Task=`4969bc9e-4348-4791-b81c-efe78c7b3f7c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:17,409::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:25:17,574::task::579::TaskManager.Task::(_updateState) Task=`0452b503-1d28-4e29-b13d-561f77fcbd2f`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:25:17,574::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:25:17,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:25:17,575::task::1168::TaskManager.Task::(prepare) Task=`0452b503-1d28-4e29-b13d-561f77fcbd2f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:25:17,575::task::579::TaskManager.Task::(_updateState) Task=`0452b503-1d28-4e29-b13d-561f77fcbd2f`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:25:17,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:25:17,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:25:17,575::task::974::TaskManager.Task::(_decref) Task=`0452b503-1d28-4e29-b13d-561f77fcbd2f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:18,410::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:25:18,410::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:18,538::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:18,539::task::579::TaskManager.Task::(_updateState) Task=`789fabd8-d735-48de-aca9-9333d6a0e392`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:25:18,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:25:18,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:25:18,540::task::1168::TaskManager.Task::(prepare) Task=`789fabd8-d735-48de-aca9-9333d6a0e392`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:25:18,540::task::579::TaskManager.Task::(_updateState) Task=`789fabd8-d735-48de-aca9-9333d6a0e392`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:25:18,540::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:25:18,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:25:18,540::task::974::TaskManager.Task::(_decref) Task=`789fabd8-d735-48de-aca9-9333d6a0e392`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:25:18,542::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:25:18,542::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:25:18,543::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:18,545::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:18,546::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-22::DEBUG::2014-01-16 17:25:19,047::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:25:19,047::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:25:19,047::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:25:19,047::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:25:19,050::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:19,066::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000256902 s, 8.0 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:25:19,066::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000256902 s, 8.0 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:25:19,066::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:25:19,066::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:25:19,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:25:19,067::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:25:19,067::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:25:19,067::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:25:19,068::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:25:19,068::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:25:19,068::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::DEBUG::2014-01-16 17:25:19,087::task::579::TaskManager.Task::(_updateState) Task=`f73cd607-3f41-42cf-9162-e87338798878`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:25:19,087::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-22::DEBUG::2014-01-16 17:25:19,301::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:25:19,309::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:25:19,309::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:25:19,310::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:25:19,310::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:25:19,311::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 17:25:19,312::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::INFO::2014-01-16 17:25:19,329::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:25:19,332::task::1168::TaskManager.Task::(prepare) Task=`f73cd607-3f41-42cf-9162-e87338798878`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:25:19,332::task::579::TaskManager.Task::(_updateState) Task=`f73cd607-3f41-42cf-9162-e87338798878`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:25:19,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:25:19,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:25:19,332::task::974::TaskManager.Task::(_decref) Task=`f73cd607-3f41-42cf-9162-e87338798878`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:19,411::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:25:19,473::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:25:19,476::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:19,493::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000210095 s, 19.5 MB/s\n'; <rc> = 0 >Thread-288136::DEBUG::2014-01-16 17:25:19,573::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288136::DEBUG::2014-01-16 17:25:19,576::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-1.47', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.28', 'elapsedTime': '570', 'vmType': 'kvm', 'cpuSys': '2.26', 'appsList': [], 'guestIPs': ''}]} >Thread-84402::DEBUG::2014-01-16 17:25:19,608::task::579::TaskManager.Task::(_updateState) Task=`edc7a450-a7c4-47dc-b3fb-e7d21c210b69`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:25:19,608::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:25:19,609::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:25:19,609::task::1168::TaskManager.Task::(prepare) Task=`edc7a450-a7c4-47dc-b3fb-e7d21c210b69`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:25:19,609::task::579::TaskManager.Task::(_updateState) Task=`edc7a450-a7c4-47dc-b3fb-e7d21c210b69`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:25:19,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:25:19,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:25:19,609::task::974::TaskManager.Task::(_decref) Task=`edc7a450-a7c4-47dc-b3fb-e7d21c210b69`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:25:20,210::task::579::TaskManager.Task::(_updateState) Task=`c897bc51-aac6-4027-96dd-eeba75692a14`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:25:20,210::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:25:20,211::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:25:20,211::task::1168::TaskManager.Task::(prepare) Task=`c897bc51-aac6-4027-96dd-eeba75692a14`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:25:20,211::task::579::TaskManager.Task::(_updateState) Task=`c897bc51-aac6-4027-96dd-eeba75692a14`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:25:20,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:25:20,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:25:20,211::task::974::TaskManager.Task::(_decref) Task=`c897bc51-aac6-4027-96dd-eeba75692a14`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:25:20,212::task::579::TaskManager.Task::(_updateState) Task=`1d112304-2681-4837-875b-5a8371769a4c`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:25:20,212::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:25:20,212::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:25:20,212::task::1168::TaskManager.Task::(prepare) Task=`1d112304-2681-4837-875b-5a8371769a4c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:25:20,213::task::579::TaskManager.Task::(_updateState) Task=`1d112304-2681-4837-875b-5a8371769a4c`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:25:20,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:25:20,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:25:20,213::task::974::TaskManager.Task::(_decref) Task=`1d112304-2681-4837-875b-5a8371769a4c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:20,413::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:20,548::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:25:20,964::task::579::TaskManager.Task::(_updateState) Task=`71f9b730-0afc-4d12-8d78-ef90edc63bc9`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:25:20,965::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:25:20,966::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:25:20,966::task::1168::TaskManager.Task::(prepare) Task=`71f9b730-0afc-4d12-8d78-ef90edc63bc9`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:25:20,966::task::579::TaskManager.Task::(_updateState) Task=`71f9b730-0afc-4d12-8d78-ef90edc63bc9`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:25:20,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:25:20,967::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:25:20,967::task::974::TaskManager.Task::(_decref) Task=`71f9b730-0afc-4d12-8d78-ef90edc63bc9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:21,414::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:22,415::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:22,552::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288138::DEBUG::2014-01-16 17:25:22,675::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288138::DEBUG::2014-01-16 17:25:22,677::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'elapsedTime': '573', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:23,416::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:25:23,417::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:23,554::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:25:23,706::task::579::TaskManager.Task::(_updateState) Task=`343f6429-8c3d-42a1-9d1d-a70a142b37f0`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:25:23,706::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:25:23,706::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:25:23,707::task::1168::TaskManager.Task::(prepare) Task=`343f6429-8c3d-42a1-9d1d-a70a142b37f0`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:25:23,707::task::579::TaskManager.Task::(_updateState) Task=`343f6429-8c3d-42a1-9d1d-a70a142b37f0`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:25:23,707::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:25:23,707::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:25:23,707::task::974::TaskManager.Task::(_decref) Task=`343f6429-8c3d-42a1-9d1d-a70a142b37f0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:24,418::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:25:24,418::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:24,556::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:25,419::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288140::DEBUG::2014-01-16 17:25:25,804::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288140::DEBUG::2014-01-16 17:25:25,805::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.50', 'elapsedTime': '576', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:26,421::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:26,557::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:25:26,564::task::579::TaskManager.Task::(_updateState) Task=`8b7a04d2-c709-4a95-8c45-0aa3f0172590`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:25:26,564::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:25:26,564::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:25:26,564::task::1168::TaskManager.Task::(prepare) Task=`8b7a04d2-c709-4a95-8c45-0aa3f0172590`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:25:26,565::task::579::TaskManager.Task::(_updateState) Task=`8b7a04d2-c709-4a95-8c45-0aa3f0172590`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:25:26,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:25:26,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:25:26,565::task::974::TaskManager.Task::(_decref) Task=`8b7a04d2-c709-4a95-8c45-0aa3f0172590`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:25:26,992::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:25:27,011::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000266458 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:27,422::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:25:28,187::task::579::TaskManager.Task::(_updateState) Task=`1333014b-d485-4f5d-ab6d-1f1706152612`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:25:28,187::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:25:28,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:25:28,188::task::1168::TaskManager.Task::(prepare) Task=`1333014b-d485-4f5d-ab6d-1f1706152612`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:25:28,189::task::579::TaskManager.Task::(_updateState) Task=`1333014b-d485-4f5d-ab6d-1f1706152612`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:25:28,189::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:25:28,189::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:25:28,189::task::974::TaskManager.Task::(_decref) Task=`1333014b-d485-4f5d-ab6d-1f1706152612`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:28,424::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:28,559::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:28,560::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288141::DEBUG::2014-01-16 17:25:28,861::task::579::TaskManager.Task::(_updateState) Task=`7298c19b-658d-4f6b-91e7-da9033549091`::moving from state init -> state preparing >Thread-288141::INFO::2014-01-16 17:25:28,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288141::INFO::2014-01-16 17:25:28,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266458', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000210095', 'lastCheck': '9.4', 'valid': True}} >Thread-288141::DEBUG::2014-01-16 17:25:28,861::task::1168::TaskManager.Task::(prepare) Task=`7298c19b-658d-4f6b-91e7-da9033549091`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000266458', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000210095', 'lastCheck': '9.4', 'valid': True}} >Thread-288141::DEBUG::2014-01-16 17:25:28,861::task::579::TaskManager.Task::(_updateState) Task=`7298c19b-658d-4f6b-91e7-da9033549091`::moving from state preparing -> state finished >Thread-288141::DEBUG::2014-01-16 17:25:28,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288141::DEBUG::2014-01-16 17:25:28,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288141::DEBUG::2014-01-16 17:25:28,862::task::974::TaskManager.Task::(_decref) Task=`7298c19b-658d-4f6b-91e7-da9033549091`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:29,424::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:25:29,430::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:25:29,430::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:25:29,500::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:29,516::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000361799 s, 11.3 MB/s\n'; <rc> = 0 >Thread-48934::DEBUG::2014-01-16 17:25:29,855::task::579::TaskManager.Task::(_updateState) Task=`9dc7faec-c722-4756-9fdc-5a70aedef827`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:25:29,855::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:25:29,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:25:29,856::task::1168::TaskManager.Task::(prepare) Task=`9dc7faec-c722-4756-9fdc-5a70aedef827`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:25:29,856::task::579::TaskManager.Task::(_updateState) Task=`9dc7faec-c722-4756-9fdc-5a70aedef827`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:25:29,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:25:29,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:25:29,856::task::974::TaskManager.Task::(_decref) Task=`9dc7faec-c722-4756-9fdc-5a70aedef827`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:25:29,857::task::579::TaskManager.Task::(_updateState) Task=`d942d5e7-720d-4d4a-a8fc-ca338363cefb`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:25:29,857::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:25:29,857::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:25:29,857::task::1168::TaskManager.Task::(prepare) Task=`d942d5e7-720d-4d4a-a8fc-ca338363cefb`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:25:29,857::task::579::TaskManager.Task::(_updateState) Task=`d942d5e7-720d-4d4a-a8fc-ca338363cefb`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:25:29,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:25:29,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:25:29,858::task::974::TaskManager.Task::(_decref) Task=`d942d5e7-720d-4d4a-a8fc-ca338363cefb`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:25:29,858::task::579::TaskManager.Task::(_updateState) Task=`0acbbd2c-0948-409b-a698-f555b38f06e3`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:25:29,858::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:25:29,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:25:29,859::task::1168::TaskManager.Task::(prepare) Task=`0acbbd2c-0948-409b-a698-f555b38f06e3`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:25:29,859::task::579::TaskManager.Task::(_updateState) Task=`0acbbd2c-0948-409b-a698-f555b38f06e3`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:25:29,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:25:29,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:25:29,859::task::974::TaskManager.Task::(_decref) Task=`0acbbd2c-0948-409b-a698-f555b38f06e3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:30,431::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:25:30,432::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:30,561::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:31,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:25:31,432::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:25:31,433::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:32,434::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:25:32,434::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:32,562::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288144::DEBUG::2014-01-16 17:25:32,607::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288144::DEBUG::2014-01-16 17:25:32,609::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.30', 'elapsedTime': '583', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:33,435::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:25:33,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:33,564::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:25:33,565::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:25:33,573::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:25:34,238::task::579::TaskManager.Task::(_updateState) Task=`d4d36322-8b30-4258-b353-cfa016cb1f5b`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:25:34,238::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:25:34,239::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:25:34,239::task::1168::TaskManager.Task::(prepare) Task=`d4d36322-8b30-4258-b353-cfa016cb1f5b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:25:34,239::task::579::TaskManager.Task::(_updateState) Task=`d4d36322-8b30-4258-b353-cfa016cb1f5b`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:25:34,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:25:34,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:25:34,239::task::974::TaskManager.Task::(_decref) Task=`d4d36322-8b30-4258-b353-cfa016cb1f5b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:34,436::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:34,577::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:35,437::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:25:35,438::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288146::DEBUG::2014-01-16 17:25:35,706::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288146::DEBUG::2014-01-16 17:25:35,707::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.68', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.40', 'elapsedTime': '586', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:36,438::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:25:36,439::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:36,578::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:25:37,019::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:25:37,036::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000255078 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:37,439::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:25:37,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:25:37,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:25:37,440::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:25:38,200::task::579::TaskManager.Task::(_updateState) Task=`ba5a2d7d-22ae-4dd4-b2df-183472579d06`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:25:38,200::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:25:38,201::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:25:38,201::task::1168::TaskManager.Task::(prepare) Task=`ba5a2d7d-22ae-4dd4-b2df-183472579d06`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:25:38,201::task::579::TaskManager.Task::(_updateState) Task=`ba5a2d7d-22ae-4dd4-b2df-183472579d06`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:25:38,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:25:38,202::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:25:38,202::task::974::TaskManager.Task::(_decref) Task=`ba5a2d7d-22ae-4dd4-b2df-183472579d06`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:25:38,247::task::579::TaskManager.Task::(_updateState) Task=`53647280-a8f0-4972-a46e-c029c9a7cfaa`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:25:38,248::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:25:38,248::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:25:38,248::task::1168::TaskManager.Task::(prepare) Task=`53647280-a8f0-4972-a46e-c029c9a7cfaa`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:25:38,248::task::579::TaskManager.Task::(_updateState) Task=`53647280-a8f0-4972-a46e-c029c9a7cfaa`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:25:38,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:25:38,249::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:25:38,249::task::974::TaskManager.Task::(_decref) Task=`53647280-a8f0-4972-a46e-c029c9a7cfaa`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:38,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:25:38,441::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:25:38,442::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:38,580::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:38,581::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288148::DEBUG::2014-01-16 17:25:38,843::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [44c3f774] >Thread-288148::DEBUG::2014-01-16 17:25:38,844::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.15', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.53', 'elapsedTime': '589', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:39,442::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:25:39,443::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:25:39,523::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:39,539::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000302984 s, 13.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:40,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:25:40,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:25:40,444::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:25:40,444::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:40,582::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:41,446::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288150::DEBUG::2014-01-16 17:25:41,945::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288150::DEBUG::2014-01-16 17:25:41,946::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.15', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '593', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:42,446::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:25:42,447::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:25:42,447::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:25:42,447::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:25:42,447::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:25:42,449::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:25:42,583::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:25:43,244::task::579::TaskManager.Task::(_updateState) Task=`b914b05d-effa-4277-aac6-5ea84c1f455a`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:25:43,244::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:25:43,245::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:25:43,245::task::1168::TaskManager.Task::(prepare) Task=`b914b05d-effa-4277-aac6-5ea84c1f455a`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:25:43,245::task::579::TaskManager.Task::(_updateState) Task=`b914b05d-effa-4277-aac6-5ea84c1f455a`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:25:43,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:25:43,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:25:43,245::task::974::TaskManager.Task::(_decref) Task=`b914b05d-effa-4277-aac6-5ea84c1f455a`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:25:43,246::task::579::TaskManager.Task::(_updateState) Task=`8adbb48f-f348-4885-8c61-4a14dfa82b1d`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:25:43,246::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:25:43,246::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:25:43,246::task::1168::TaskManager.Task::(prepare) Task=`8adbb48f-f348-4885-8c61-4a14dfa82b1d`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:25:43,246::task::579::TaskManager.Task::(_updateState) Task=`8adbb48f-f348-4885-8c61-4a14dfa82b1d`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:25:43,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:25:43,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:25:43,247::task::974::TaskManager.Task::(_decref) Task=`8adbb48f-f348-4885-8c61-4a14dfa82b1d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:43,450::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:43,585::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:25:43,760::task::579::TaskManager.Task::(_updateState) Task=`bd6bb8e1-ba81-4c75-b619-cdc5a8bbb51d`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:25:43,760::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:25:43,761::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:25:43,761::task::1168::TaskManager.Task::(prepare) Task=`bd6bb8e1-ba81-4c75-b619-cdc5a8bbb51d`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:25:43,761::task::579::TaskManager.Task::(_updateState) Task=`bd6bb8e1-ba81-4c75-b619-cdc5a8bbb51d`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:25:43,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:25:43,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:25:43,761::task::974::TaskManager.Task::(_decref) Task=`bd6bb8e1-ba81-4c75-b619-cdc5a8bbb51d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:44,451::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:25:44,452::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:25:44,452::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:44,586::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288151::DEBUG::2014-01-16 17:25:45,153::task::579::TaskManager.Task::(_updateState) Task=`fd8487e0-974c-40d2-91d0-162d3077ea66`::moving from state init -> state preparing >Thread-288151::INFO::2014-01-16 17:25:45,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288151::INFO::2014-01-16 17:25:45,153::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255078', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302984', 'lastCheck': '5.6', 'valid': True}} >Thread-288151::DEBUG::2014-01-16 17:25:45,153::task::1168::TaskManager.Task::(prepare) Task=`fd8487e0-974c-40d2-91d0-162d3077ea66`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000255078', 'lastCheck': '8.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302984', 'lastCheck': '5.6', 'valid': True}} >Thread-288151::DEBUG::2014-01-16 17:25:45,154::task::579::TaskManager.Task::(_updateState) Task=`fd8487e0-974c-40d2-91d0-162d3077ea66`::moving from state preparing -> state finished >Thread-288151::DEBUG::2014-01-16 17:25:45,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288151::DEBUG::2014-01-16 17:25:45,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288151::DEBUG::2014-01-16 17:25:45,154::task::974::TaskManager.Task::(_decref) Task=`fd8487e0-974c-40d2-91d0-162d3077ea66`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:45,453::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:25:45,453::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:25:45,453::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:25:45,509::task::579::TaskManager.Task::(_updateState) Task=`4c352ada-89ce-4909-80f4-6a6f9258ca77`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:25:45,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:25:45,510::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:25:45,510::task::1168::TaskManager.Task::(prepare) Task=`4c352ada-89ce-4909-80f4-6a6f9258ca77`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:25:45,510::task::579::TaskManager.Task::(_updateState) Task=`4c352ada-89ce-4909-80f4-6a6f9258ca77`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:25:45,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:25:45,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:25:45,510::task::974::TaskManager.Task::(_decref) Task=`4c352ada-89ce-4909-80f4-6a6f9258ca77`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:46,454::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:25:46,455::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:25:46,455::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:25:46,455::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:46,587::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:25:46,849::task::579::TaskManager.Task::(_updateState) Task=`5860d2ca-1330-42dd-a522-10824f9ff752`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:25:46,849::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:25:46,850::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:25:46,850::task::1168::TaskManager.Task::(prepare) Task=`5860d2ca-1330-42dd-a522-10824f9ff752`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:25:46,850::task::579::TaskManager.Task::(_updateState) Task=`5860d2ca-1330-42dd-a522-10824f9ff752`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:25:46,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:25:46,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:25:46,850::task::974::TaskManager.Task::(_decref) Task=`5860d2ca-1330-42dd-a522-10824f9ff752`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:25:46,952::task::579::TaskManager.Task::(_updateState) Task=`e545beef-707f-4cc6-9bde-2c3802a76500`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:25:46,953::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:25:46,953::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:25:46,953::task::1168::TaskManager.Task::(prepare) Task=`e545beef-707f-4cc6-9bde-2c3802a76500`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:25:46,953::task::579::TaskManager.Task::(_updateState) Task=`e545beef-707f-4cc6-9bde-2c3802a76500`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:25:46,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:25:46,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:25:46,954::task::974::TaskManager.Task::(_decref) Task=`e545beef-707f-4cc6-9bde-2c3802a76500`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:25:46,960::task::579::TaskManager.Task::(_updateState) Task=`6a79bc27-fec7-4a8a-878f-4e6304071e9c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:25:46,960::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:25:46,960::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:25:46,960::task::1168::TaskManager.Task::(prepare) Task=`6a79bc27-fec7-4a8a-878f-4e6304071e9c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:25:46,960::task::579::TaskManager.Task::(_updateState) Task=`6a79bc27-fec7-4a8a-878f-4e6304071e9c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:25:46,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:25:46,961::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:25:46,961::task::974::TaskManager.Task::(_decref) Task=`6a79bc27-fec7-4a8a-878f-4e6304071e9c`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:25:47,044::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:25:47,061::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258049 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:47,457::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:25:47,719::task::579::TaskManager.Task::(_updateState) Task=`5ca67e06-27db-4c31-b97a-8bde03b9007f`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:25:47,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:25:47,720::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:25:47,721::task::1168::TaskManager.Task::(prepare) Task=`5ca67e06-27db-4c31-b97a-8bde03b9007f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:25:47,721::task::579::TaskManager.Task::(_updateState) Task=`5ca67e06-27db-4c31-b97a-8bde03b9007f`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:25:47,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:25:47,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:25:47,723::task::974::TaskManager.Task::(_decref) Task=`5ca67e06-27db-4c31-b97a-8bde03b9007f`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:25:47,735::task::579::TaskManager.Task::(_updateState) Task=`f87f6e55-8398-45c4-ad3a-8d9e06c164ed`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:25:47,735::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:25:47,736::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:25:47,736::task::1168::TaskManager.Task::(prepare) Task=`f87f6e55-8398-45c4-ad3a-8d9e06c164ed`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:25:47,736::task::579::TaskManager.Task::(_updateState) Task=`f87f6e55-8398-45c4-ad3a-8d9e06c164ed`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:25:47,737::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:25:47,737::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:25:47,738::task::974::TaskManager.Task::(_decref) Task=`f87f6e55-8398-45c4-ad3a-8d9e06c164ed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:48,457::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:25:48,458::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:48,589::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:48,591::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:25:48,591::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:25:48,592::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288154::DEBUG::2014-01-16 17:25:48,738::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288154::DEBUG::2014-01-16 17:25:48,740::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.15', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'elapsedTime': '599', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:49,460::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:25:49,545::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:49,563::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000188004 s, 21.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:50,461::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:50,593::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:51,462::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288156::DEBUG::2014-01-16 17:25:51,860::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288156::DEBUG::2014-01-16 17:25:51,861::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.15', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'elapsedTime': '602', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >Thread-287783::DEBUG::2014-01-16 17:25:52,311::task::579::TaskManager.Task::(_updateState) Task=`ee9e589d-5f75-4175-8c7e-120558c53102`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:25:52,311::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:25:52,311::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:25:52,312::task::1168::TaskManager.Task::(prepare) Task=`ee9e589d-5f75-4175-8c7e-120558c53102`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:25:52,312::task::579::TaskManager.Task::(_updateState) Task=`ee9e589d-5f75-4175-8c7e-120558c53102`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:25:52,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:25:52,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:25:52,312::task::974::TaskManager.Task::(_decref) Task=`ee9e589d-5f75-4175-8c7e-120558c53102`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:52,463::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:52,595::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:53,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:25:53,465::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:53,596::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:54,466::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:25:54,466::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:54,597::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:25:54,844::task::579::TaskManager.Task::(_updateState) Task=`426c4a38-4512-4265-9a17-819d60bed3ec`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:25:54,845::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:25:54,845::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:25:54,845::task::1168::TaskManager.Task::(prepare) Task=`426c4a38-4512-4265-9a17-819d60bed3ec`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:25:54,845::task::579::TaskManager.Task::(_updateState) Task=`426c4a38-4512-4265-9a17-819d60bed3ec`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:25:54,845::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:25:54,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:25:54,846::task::974::TaskManager.Task::(_decref) Task=`426c4a38-4512-4265-9a17-819d60bed3ec`::ref 0 aborting False >Thread-288158::DEBUG::2014-01-16 17:25:54,971::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288158::DEBUG::2014-01-16 17:25:54,972::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.08', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.60', 'elapsedTime': '606', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:55,467::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:25:55,730::task::579::TaskManager.Task::(_updateState) Task=`216ad1ef-8420-4dcc-8414-105ea6d97562`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:25:55,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:25:55,731::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:25:55,731::task::1168::TaskManager.Task::(prepare) Task=`216ad1ef-8420-4dcc-8414-105ea6d97562`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:25:55,731::task::579::TaskManager.Task::(_updateState) Task=`216ad1ef-8420-4dcc-8414-105ea6d97562`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:25:55,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:25:55,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:25:55,732::task::974::TaskManager.Task::(_decref) Task=`216ad1ef-8420-4dcc-8414-105ea6d97562`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:25:55,732::task::579::TaskManager.Task::(_updateState) Task=`606d4b26-4345-4fa6-bb40-1f87d9938eec`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:25:55,732::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:25:55,732::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:25:55,733::task::1168::TaskManager.Task::(prepare) Task=`606d4b26-4345-4fa6-bb40-1f87d9938eec`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:25:55,733::task::579::TaskManager.Task::(_updateState) Task=`606d4b26-4345-4fa6-bb40-1f87d9938eec`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:25:55,733::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:25:55,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:25:55,733::task::974::TaskManager.Task::(_decref) Task=`606d4b26-4345-4fa6-bb40-1f87d9938eec`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:25:55,733::task::579::TaskManager.Task::(_updateState) Task=`e9c2d763-8ff9-462f-9821-ca7b171c7c04`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:25:55,733::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:25:55,734::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:25:55,734::task::1168::TaskManager.Task::(prepare) Task=`e9c2d763-8ff9-462f-9821-ca7b171c7c04`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:25:55,734::task::579::TaskManager.Task::(_updateState) Task=`e9c2d763-8ff9-462f-9821-ca7b171c7c04`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:25:55,734::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:25:55,734::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:25:55,734::task::974::TaskManager.Task::(_decref) Task=`e9c2d763-8ff9-462f-9821-ca7b171c7c04`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:25:56,469::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:56,599::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:25:57,068::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:25:57,085::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000321059 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:25:57,470::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288160::DEBUG::2014-01-16 17:25:58,070::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288160::DEBUG::2014-01-16 17:25:58,073::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.08', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.70', 'elapsedTime': '609', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:25:58,471::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:25:58,600::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:25:58,601::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:25:59,472::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:25:59,472::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:25:59,473::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:25:59,569::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:25:59,586::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000272882 s, 15.0 MB/s\n'; <rc> = 0 >Thread-221160::DEBUG::2014-01-16 17:26:00,119::task::579::TaskManager.Task::(_updateState) Task=`17ed37f9-de8d-4ded-8bb3-1595a22b19c1`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:26:00,119::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:26:00,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:26:00,120::task::1168::TaskManager.Task::(prepare) Task=`17ed37f9-de8d-4ded-8bb3-1595a22b19c1`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:26:00,120::task::579::TaskManager.Task::(_updateState) Task=`17ed37f9-de8d-4ded-8bb3-1595a22b19c1`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:26:00,120::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:26:00,120::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:26:00,120::task::974::TaskManager.Task::(_decref) Task=`17ed37f9-de8d-4ded-8bb3-1595a22b19c1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:00,474::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:26:00,474::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:00,602::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288161::DEBUG::2014-01-16 17:26:01,136::task::579::TaskManager.Task::(_updateState) Task=`f5a0235d-9b35-4a84-bcc6-3b4bafa1d5bd`::moving from state init -> state preparing >Thread-288161::INFO::2014-01-16 17:26:01,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288161::INFO::2014-01-16 17:26:01,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321059', 'lastCheck': '4.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272882', 'lastCheck': '1.5', 'valid': True}} >Thread-288161::DEBUG::2014-01-16 17:26:01,137::task::1168::TaskManager.Task::(prepare) Task=`f5a0235d-9b35-4a84-bcc6-3b4bafa1d5bd`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321059', 'lastCheck': '4.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272882', 'lastCheck': '1.5', 'valid': True}} >Thread-288161::DEBUG::2014-01-16 17:26:01,137::task::579::TaskManager.Task::(_updateState) Task=`f5a0235d-9b35-4a84-bcc6-3b4bafa1d5bd`::moving from state preparing -> state finished >Thread-288161::DEBUG::2014-01-16 17:26:01,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288161::DEBUG::2014-01-16 17:26:01,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288161::DEBUG::2014-01-16 17:26:01,137::task::974::TaskManager.Task::(_decref) Task=`f5a0235d-9b35-4a84-bcc6-3b4bafa1d5bd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:01,475::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:26:01,476::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:26:01,476::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:02,477::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:26:02,477::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:02,604::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:03,478::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:26:03,479::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:03,606::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:26:03,606::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:26:03,607::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:04,479::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:04,609::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288164::DEBUG::2014-01-16 17:26:04,714::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288164::DEBUG::2014-01-16 17:26:04,716::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.08', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.34', 'elapsedTime': '615', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:05,480::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:26:05,481::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:06,482::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:26:06,482::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:06,610::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:26:06,920::task::579::TaskManager.Task::(_updateState) Task=`1afffd56-5111-481f-9319-cf1512792e95`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:26:06,920::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:26:06,921::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:26:06,921::task::1168::TaskManager.Task::(prepare) Task=`1afffd56-5111-481f-9319-cf1512792e95`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:26:06,921::task::579::TaskManager.Task::(_updateState) Task=`1afffd56-5111-481f-9319-cf1512792e95`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:26:06,922::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:26:06,922::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:26:06,922::task::974::TaskManager.Task::(_decref) Task=`1afffd56-5111-481f-9319-cf1512792e95`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:26:07,093::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:26:07,110::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000296404 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:07,483::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:26:07,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:26:07,484::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:26:07,484::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288166::DEBUG::2014-01-16 17:26:07,814::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288166::DEBUG::2014-01-16 17:26:07,816::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.60', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.44', 'elapsedTime': '618', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:08,486::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:26:08,486::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:26:08,486::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:08,611::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:08,613::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-53040::DEBUG::2014-01-16 17:26:09,337::task::579::TaskManager.Task::(_updateState) Task=`f0d3894f-d70a-4b1e-9b1b-a843554d2835`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:26:09,338::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:26:09,339::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:26:09,339::task::1168::TaskManager.Task::(prepare) Task=`f0d3894f-d70a-4b1e-9b1b-a843554d2835`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:26:09,339::task::579::TaskManager.Task::(_updateState) Task=`f0d3894f-d70a-4b1e-9b1b-a843554d2835`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:26:09,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:26:09,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:26:09,340::task::974::TaskManager.Task::(_decref) Task=`f0d3894f-d70a-4b1e-9b1b-a843554d2835`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:26:09,358::task::579::TaskManager.Task::(_updateState) Task=`1e984989-bc2e-4941-b110-c0f05584a981`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:26:09,358::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:26:09,360::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:26:09,360::task::1168::TaskManager.Task::(prepare) Task=`1e984989-bc2e-4941-b110-c0f05584a981`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:26:09,360::task::579::TaskManager.Task::(_updateState) Task=`1e984989-bc2e-4941-b110-c0f05584a981`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:26:09,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:26:09,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:26:09,361::task::974::TaskManager.Task::(_decref) Task=`1e984989-bc2e-4941-b110-c0f05584a981`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:09,487::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:26:09,487::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:26:09,592::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:26:09,609::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000205283 s, 20.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:10,488::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:26:10,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:26:10,489::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:26:10,489::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:10,614::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288168::DEBUG::2014-01-16 17:26:10,918::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288168::DEBUG::2014-01-16 17:26:10,920::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.60', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.54', 'elapsedTime': '622', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:11,490::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:26:11,535::task::579::TaskManager.Task::(_updateState) Task=`fd59edcd-1108-44f7-a882-47082a98a72f`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:26:11,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:26:11,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:26:11,537::task::1168::TaskManager.Task::(prepare) Task=`fd59edcd-1108-44f7-a882-47082a98a72f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:26:11,538::task::579::TaskManager.Task::(_updateState) Task=`fd59edcd-1108-44f7-a882-47082a98a72f`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:26:11,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:26:11,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:26:11,538::task::974::TaskManager.Task::(_decref) Task=`fd59edcd-1108-44f7-a882-47082a98a72f`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:26:11,538::task::579::TaskManager.Task::(_updateState) Task=`0270b68a-26d6-48bd-9a38-840a513e4bcb`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:26:11,539::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:26:11,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:26:11,539::task::1168::TaskManager.Task::(prepare) Task=`0270b68a-26d6-48bd-9a38-840a513e4bcb`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:26:11,539::task::579::TaskManager.Task::(_updateState) Task=`0270b68a-26d6-48bd-9a38-840a513e4bcb`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:26:11,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:26:11,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:26:11,540::task::974::TaskManager.Task::(_decref) Task=`0270b68a-26d6-48bd-9a38-840a513e4bcb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:12,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:26:12,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:26:12,492::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:26:12,492::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:12,493::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:26:12,493::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:26:12,615::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:13,494::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:13,617::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:26:13,813::task::579::TaskManager.Task::(_updateState) Task=`a893a9ce-3771-4f5c-a8ee-bc3289c168b6`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:26:13,813::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:26:13,814::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:26:13,814::task::1168::TaskManager.Task::(prepare) Task=`a893a9ce-3771-4f5c-a8ee-bc3289c168b6`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:26:13,814::task::579::TaskManager.Task::(_updateState) Task=`a893a9ce-3771-4f5c-a8ee-bc3289c168b6`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:26:13,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:26:13,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:26:13,815::task::974::TaskManager.Task::(_decref) Task=`a893a9ce-3771-4f5c-a8ee-bc3289c168b6`::ref 0 aborting False >Thread-288170::DEBUG::2014-01-16 17:26:14,018::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288170::DEBUG::2014-01-16 17:26:14,020::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.60', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.64', 'elapsedTime': '625', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:14,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:26:14,495::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:26:14,495::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-256178::DEBUG::2014-01-16 17:26:14,516::task::579::TaskManager.Task::(_updateState) Task=`ba19790d-fd1f-49c3-8b29-17da0aa44901`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:26:14,517::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:26:14,517::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:26:14,517::task::1168::TaskManager.Task::(prepare) Task=`ba19790d-fd1f-49c3-8b29-17da0aa44901`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:26:14,517::task::579::TaskManager.Task::(_updateState) Task=`ba19790d-fd1f-49c3-8b29-17da0aa44901`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:26:14,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:26:14,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:26:14,518::task::974::TaskManager.Task::(_decref) Task=`ba19790d-fd1f-49c3-8b29-17da0aa44901`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:26:14,518::task::579::TaskManager.Task::(_updateState) Task=`1f86db8a-91ec-4ed7-91dd-415728e19b17`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:26:14,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:26:14,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:26:14,519::task::1168::TaskManager.Task::(prepare) Task=`1f86db8a-91ec-4ed7-91dd-415728e19b17`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:26:14,519::task::579::TaskManager.Task::(_updateState) Task=`1f86db8a-91ec-4ed7-91dd-415728e19b17`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:26:14,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:26:14,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:26:14,519::task::974::TaskManager.Task::(_decref) Task=`1f86db8a-91ec-4ed7-91dd-415728e19b17`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:26:14,618::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:15,496::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:26:15,497::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:26:15,497::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:16,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:26:16,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:26:16,499::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:26:16,499::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:16,619::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288171::DEBUG::2014-01-16 17:26:17,075::task::579::TaskManager.Task::(_updateState) Task=`8ed86de9-c20b-4471-9a7e-9ffe3c9706ff`::moving from state init -> state preparing >Thread-288171::INFO::2014-01-16 17:26:17,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288171::INFO::2014-01-16 17:26:17,076::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000296404', 'lastCheck': '10.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000205283', 'lastCheck': '7.5', 'valid': True}} >Thread-288171::DEBUG::2014-01-16 17:26:17,076::task::1168::TaskManager.Task::(prepare) Task=`8ed86de9-c20b-4471-9a7e-9ffe3c9706ff`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000296404', 'lastCheck': '10.0', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000205283', 'lastCheck': '7.5', 'valid': True}} >Thread-288171::DEBUG::2014-01-16 17:26:17,076::task::579::TaskManager.Task::(_updateState) Task=`8ed86de9-c20b-4471-9a7e-9ffe3c9706ff`::moving from state preparing -> state finished >Thread-288171::DEBUG::2014-01-16 17:26:17,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288171::DEBUG::2014-01-16 17:26:17,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288171::DEBUG::2014-01-16 17:26:17,076::task::974::TaskManager.Task::(_decref) Task=`8ed86de9-c20b-4471-9a7e-9ffe3c9706ff`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:26:17,112::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:26:17,116::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:26:17,117::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:26:17,122::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:26:17,123::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:26:17,123::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:26:17,123::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 17:26:17,128::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:26:17,160::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000282466 s, 1.3 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:26:17,296::task::579::TaskManager.Task::(_updateState) Task=`5ead5313-4b01-4ec0-95e7-df97f131822d`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:26:17,296::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:26:17,297::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:26:17,297::task::1168::TaskManager.Task::(prepare) Task=`5ead5313-4b01-4ec0-95e7-df97f131822d`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:26:17,297::task::579::TaskManager.Task::(_updateState) Task=`5ead5313-4b01-4ec0-95e7-df97f131822d`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:26:17,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:26:17,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:26:17,297::task::974::TaskManager.Task::(_decref) Task=`5ead5313-4b01-4ec0-95e7-df97f131822d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:17,500::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:26:17,772::task::579::TaskManager.Task::(_updateState) Task=`09dfae5f-cb81-4e18-ab43-ad86af06a4c5`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:26:17,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:26:17,773::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:26:17,773::task::1168::TaskManager.Task::(prepare) Task=`09dfae5f-cb81-4e18-ab43-ad86af06a4c5`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:26:17,773::task::579::TaskManager.Task::(_updateState) Task=`09dfae5f-cb81-4e18-ab43-ad86af06a4c5`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:26:17,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:26:17,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:26:17,773::task::974::TaskManager.Task::(_decref) Task=`09dfae5f-cb81-4e18-ab43-ad86af06a4c5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:18,501::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:26:18,501::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:18,620::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:18,621::task::579::TaskManager.Task::(_updateState) Task=`4b2cebc0-bea6-4375-bba5-663544c140b2`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:26:18,621::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:26:18,621::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:26:18,621::task::1168::TaskManager.Task::(prepare) Task=`4b2cebc0-bea6-4375-bba5-663544c140b2`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:26:18,622::task::579::TaskManager.Task::(_updateState) Task=`4b2cebc0-bea6-4375-bba5-663544c140b2`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:26:18,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:26:18,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:26:18,622::task::974::TaskManager.Task::(_decref) Task=`4b2cebc0-bea6-4375-bba5-663544c140b2`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:26:18,624::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:26:18,624::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:26:18,625::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:18,627::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:18,628::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:19,503::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:26:19,510::task::579::TaskManager.Task::(_updateState) Task=`2d2afe2a-4122-4965-96da-9f9893f2a254`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:26:19,511::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:26:19,511::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:26:19,511::task::1168::TaskManager.Task::(prepare) Task=`2d2afe2a-4122-4965-96da-9f9893f2a254`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:26:19,511::task::579::TaskManager.Task::(_updateState) Task=`2d2afe2a-4122-4965-96da-9f9893f2a254`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:26:19,512::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:26:19,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:26:19,512::task::974::TaskManager.Task::(_decref) Task=`2d2afe2a-4122-4965-96da-9f9893f2a254`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:26:19,615::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:26:19,632::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000221704 s, 18.5 MB/s\n'; <rc> = 0 >Thread-84402::DEBUG::2014-01-16 17:26:19,791::task::579::TaskManager.Task::(_updateState) Task=`6a114ef6-a450-4861-8276-87886c8b0ede`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:26:19,792::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:26:19,792::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:26:19,792::task::1168::TaskManager.Task::(prepare) Task=`6a114ef6-a450-4861-8276-87886c8b0ede`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:26:19,792::task::579::TaskManager.Task::(_updateState) Task=`6a114ef6-a450-4861-8276-87886c8b0ede`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:26:19,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:26:19,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:26:19,793::task::974::TaskManager.Task::(_decref) Task=`6a114ef6-a450-4861-8276-87886c8b0ede`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:26:20,427::task::579::TaskManager.Task::(_updateState) Task=`15419855-b0d2-45dd-a118-a5f2366a1dfe`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:26:20,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:26:20,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:26:20,428::task::1168::TaskManager.Task::(prepare) Task=`15419855-b0d2-45dd-a118-a5f2366a1dfe`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:26:20,428::task::579::TaskManager.Task::(_updateState) Task=`15419855-b0d2-45dd-a118-a5f2366a1dfe`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:26:20,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:26:20,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:26:20,428::task::974::TaskManager.Task::(_decref) Task=`15419855-b0d2-45dd-a118-a5f2366a1dfe`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:26:20,429::task::579::TaskManager.Task::(_updateState) Task=`f58ef1b6-5bc6-4cc8-bc60-0564e284cf8d`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:26:20,429::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:26:20,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:26:20,429::task::1168::TaskManager.Task::(prepare) Task=`f58ef1b6-5bc6-4cc8-bc60-0564e284cf8d`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:26:20,429::task::579::TaskManager.Task::(_updateState) Task=`f58ef1b6-5bc6-4cc8-bc60-0564e284cf8d`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:26:20,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:26:20,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:26:20,430::task::974::TaskManager.Task::(_decref) Task=`f58ef1b6-5bc6-4cc8-bc60-0564e284cf8d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:20,504::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:20,629::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288175::DEBUG::2014-01-16 17:26:20,659::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288175::DEBUG::2014-01-16 17:26:20,660::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.60', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.28', 'elapsedTime': '631', 'vmType': 'kvm', 'cpuSys': '0.27', 'appsList': [], 'guestIPs': ''}]} >Thread-131569::DEBUG::2014-01-16 17:26:21,063::task::579::TaskManager.Task::(_updateState) Task=`c06c2f84-81cf-4781-93e2-8fb188917cfb`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:26:21,063::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:26:21,065::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:26:21,066::task::1168::TaskManager.Task::(prepare) Task=`c06c2f84-81cf-4781-93e2-8fb188917cfb`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:26:21,066::task::579::TaskManager.Task::(_updateState) Task=`c06c2f84-81cf-4781-93e2-8fb188917cfb`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:26:21,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:26:21,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:26:21,067::task::974::TaskManager.Task::(_decref) Task=`c06c2f84-81cf-4781-93e2-8fb188917cfb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:21,506::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:22,507::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:22,630::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:23,509::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:26:23,509::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:23,632::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288177::DEBUG::2014-01-16 17:26:23,758::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288177::DEBUG::2014-01-16 17:26:23,759::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.26', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.38', 'elapsedTime': '634', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-227488::DEBUG::2014-01-16 17:26:23,894::task::579::TaskManager.Task::(_updateState) Task=`5d5243eb-d3dd-407a-8508-ff8628e17cef`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:26:23,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:26:23,894::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:26:23,895::task::1168::TaskManager.Task::(prepare) Task=`5d5243eb-d3dd-407a-8508-ff8628e17cef`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:26:23,895::task::579::TaskManager.Task::(_updateState) Task=`5d5243eb-d3dd-407a-8508-ff8628e17cef`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:26:23,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:26:23,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:26:23,895::task::974::TaskManager.Task::(_decref) Task=`5d5243eb-d3dd-407a-8508-ff8628e17cef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:24,510::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:26:24,511::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:24,633::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:25,512::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:26,514::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:26,634::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:26:26,733::task::579::TaskManager.Task::(_updateState) Task=`53df0235-b029-40c3-8e80-5a80fde19dc4`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:26:26,733::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:26:26,733::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:26:26,733::task::1168::TaskManager.Task::(prepare) Task=`53df0235-b029-40c3-8e80-5a80fde19dc4`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:26:26,733::task::579::TaskManager.Task::(_updateState) Task=`53df0235-b029-40c3-8e80-5a80fde19dc4`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:26:26,734::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:26:26,734::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:26:26,734::task::974::TaskManager.Task::(_decref) Task=`53df0235-b029-40c3-8e80-5a80fde19dc4`::ref 0 aborting False >Thread-288179::DEBUG::2014-01-16 17:26:26,859::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288179::DEBUG::2014-01-16 17:26:26,860::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.26', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.48', 'elapsedTime': '637', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:26:27,170::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:26:27,187::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00032367 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:27,515::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:26:28,258::task::579::TaskManager.Task::(_updateState) Task=`8b691258-a852-4594-a347-86399eeeae18`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:26:28,259::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:26:28,259::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:26:28,259::task::1168::TaskManager.Task::(prepare) Task=`8b691258-a852-4594-a347-86399eeeae18`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:26:28,259::task::579::TaskManager.Task::(_updateState) Task=`8b691258-a852-4594-a347-86399eeeae18`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:26:28,259::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:26:28,260::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:26:28,260::task::974::TaskManager.Task::(_decref) Task=`8b691258-a852-4594-a347-86399eeeae18`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:28,516::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:28,636::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:28,637::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:29,518::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:26:29,518::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:26:29,518::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:26:29,638::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:26:29,656::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000337969 s, 12.1 MB/s\n'; <rc> = 0 >Thread-288181::DEBUG::2014-01-16 17:26:29,958::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288181::DEBUG::2014-01-16 17:26:29,960::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.26', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.58', 'elapsedTime': '641', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-48934::DEBUG::2014-01-16 17:26:30,433::task::579::TaskManager.Task::(_updateState) Task=`20460d0a-5337-4b99-b88d-143dfbf411bf`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:26:30,433::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:26:30,434::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:26:30,434::task::1168::TaskManager.Task::(prepare) Task=`20460d0a-5337-4b99-b88d-143dfbf411bf`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:26:30,434::task::579::TaskManager.Task::(_updateState) Task=`20460d0a-5337-4b99-b88d-143dfbf411bf`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:26:30,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:26:30,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:26:30,434::task::974::TaskManager.Task::(_decref) Task=`20460d0a-5337-4b99-b88d-143dfbf411bf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:26:30,435::task::579::TaskManager.Task::(_updateState) Task=`2f1e5491-6805-406e-bcbe-3c79f9e44c10`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:26:30,435::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:26:30,435::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:26:30,435::task::1168::TaskManager.Task::(prepare) Task=`2f1e5491-6805-406e-bcbe-3c79f9e44c10`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:26:30,435::task::579::TaskManager.Task::(_updateState) Task=`2f1e5491-6805-406e-bcbe-3c79f9e44c10`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:26:30,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:26:30,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:26:30,436::task::974::TaskManager.Task::(_decref) Task=`2f1e5491-6805-406e-bcbe-3c79f9e44c10`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:26:30,436::task::579::TaskManager.Task::(_updateState) Task=`96acae7b-bf77-44ff-b74b-b3bd42b9bc4a`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:26:30,436::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:26:30,436::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:26:30,436::task::1168::TaskManager.Task::(prepare) Task=`96acae7b-bf77-44ff-b74b-b3bd42b9bc4a`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:26:30,437::task::579::TaskManager.Task::(_updateState) Task=`96acae7b-bf77-44ff-b74b-b3bd42b9bc4a`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:26:30,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:26:30,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:26:30,437::task::974::TaskManager.Task::(_decref) Task=`96acae7b-bf77-44ff-b74b-b3bd42b9bc4a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:30,519::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:26:30,519::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:30,638::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:31,521::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:26:31,521::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:26:31,521::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:32,522::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:26:32,523::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:32,640::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288182::DEBUG::2014-01-16 17:26:33,017::task::579::TaskManager.Task::(_updateState) Task=`48df44d3-771a-4dc0-b12a-bf37b5e07622`::moving from state init -> state preparing >Thread-288182::INFO::2014-01-16 17:26:33,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288182::INFO::2014-01-16 17:26:33,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00032367', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337969', 'lastCheck': '3.4', 'valid': True}} >Thread-288182::DEBUG::2014-01-16 17:26:33,018::task::1168::TaskManager.Task::(prepare) Task=`48df44d3-771a-4dc0-b12a-bf37b5e07622`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00032367', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337969', 'lastCheck': '3.4', 'valid': True}} >Thread-288182::DEBUG::2014-01-16 17:26:33,018::task::579::TaskManager.Task::(_updateState) Task=`48df44d3-771a-4dc0-b12a-bf37b5e07622`::moving from state preparing -> state finished >Thread-288182::DEBUG::2014-01-16 17:26:33,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288182::DEBUG::2014-01-16 17:26:33,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288182::DEBUG::2014-01-16 17:26:33,019::task::974::TaskManager.Task::(_decref) Task=`48df44d3-771a-4dc0-b12a-bf37b5e07622`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:33,524::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:26:33,524::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:33,642::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:26:33,642::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:26:33,644::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:26:34,420::task::579::TaskManager.Task::(_updateState) Task=`e8e69f60-2031-485a-b329-2997a2fc6d22`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:26:34,420::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:26:34,421::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:26:34,421::task::1168::TaskManager.Task::(prepare) Task=`e8e69f60-2031-485a-b329-2997a2fc6d22`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:26:34,421::task::579::TaskManager.Task::(_updateState) Task=`e8e69f60-2031-485a-b329-2997a2fc6d22`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:26:34,421::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:26:34,421::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:26:34,421::task::974::TaskManager.Task::(_decref) Task=`e8e69f60-2031-485a-b329-2997a2fc6d22`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:34,524::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:34,645::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:35,525::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:26:35,526::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:36,526::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:26:36,526::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:36,646::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288185::DEBUG::2014-01-16 17:26:36,649::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288185::DEBUG::2014-01-16 17:26:36,650::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.26', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.27', 'elapsedTime': '647', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:26:37,195::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:26:37,211::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000271786 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:37,528::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:26:37,528::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:26:37,528::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:26:37,529::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:26:38,362::task::579::TaskManager.Task::(_updateState) Task=`f6fb2672-8b0c-4ee8-8858-96339e6d0ba3`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:26:38,363::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:26:38,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:26:38,363::task::1168::TaskManager.Task::(prepare) Task=`f6fb2672-8b0c-4ee8-8858-96339e6d0ba3`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:26:38,363::task::579::TaskManager.Task::(_updateState) Task=`f6fb2672-8b0c-4ee8-8858-96339e6d0ba3`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:26:38,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:26:38,364::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:26:38,364::task::974::TaskManager.Task::(_decref) Task=`f6fb2672-8b0c-4ee8-8858-96339e6d0ba3`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:26:38,431::task::579::TaskManager.Task::(_updateState) Task=`8f98e665-95c9-46c2-a32b-c7d3a3ccdd43`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:26:38,431::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:26:38,432::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:26:38,432::task::1168::TaskManager.Task::(prepare) Task=`8f98e665-95c9-46c2-a32b-c7d3a3ccdd43`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:26:38,432::task::579::TaskManager.Task::(_updateState) Task=`8f98e665-95c9-46c2-a32b-c7d3a3ccdd43`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:26:38,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:26:38,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:26:38,433::task::974::TaskManager.Task::(_decref) Task=`8f98e665-95c9-46c2-a32b-c7d3a3ccdd43`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:38,530::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:26:38,531::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:26:38,531::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:38,648::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:38,649::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:39,532::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:26:39,532::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:26:39,662::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:26:39,681::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00018317 s, 22.4 MB/s\n'; <rc> = 0 >Thread-288187::DEBUG::2014-01-16 17:26:39,752::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288187::DEBUG::2014-01-16 17:26:39,753::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.03', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.36', 'elapsedTime': '650', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:40,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:26:40,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:26:40,534::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:26:40,534::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:40,650::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:41,535::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:42,536::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:26:42,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:26:42,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:26:42,537::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:42,537::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:26:42,537::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:26:42,651::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288189::DEBUG::2014-01-16 17:26:42,858::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288189::DEBUG::2014-01-16 17:26:42,859::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.03', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.47', 'elapsedTime': '653', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:43,538::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48925::DEBUG::2014-01-16 17:26:43,610::task::579::TaskManager.Task::(_updateState) Task=`22b089ee-e76e-4cdf-b559-e68d31dd2f58`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:26:43,610::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:26:43,611::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:26:43,611::task::1168::TaskManager.Task::(prepare) Task=`22b089ee-e76e-4cdf-b559-e68d31dd2f58`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:26:43,611::task::579::TaskManager.Task::(_updateState) Task=`22b089ee-e76e-4cdf-b559-e68d31dd2f58`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:26:43,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:26:43,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:26:43,611::task::974::TaskManager.Task::(_decref) Task=`22b089ee-e76e-4cdf-b559-e68d31dd2f58`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:26:43,612::task::579::TaskManager.Task::(_updateState) Task=`a0b657b3-750b-4520-ab5c-f2bc8dd49d60`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:26:43,612::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:26:43,612::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:26:43,612::task::1168::TaskManager.Task::(prepare) Task=`a0b657b3-750b-4520-ab5c-f2bc8dd49d60`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:26:43,612::task::579::TaskManager.Task::(_updateState) Task=`a0b657b3-750b-4520-ab5c-f2bc8dd49d60`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:26:43,612::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:26:43,612::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:26:43,613::task::974::TaskManager.Task::(_decref) Task=`a0b657b3-750b-4520-ab5c-f2bc8dd49d60`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:26:43,653::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:26:43,949::task::579::TaskManager.Task::(_updateState) Task=`39b09ade-e7d6-4504-a69d-742b2302e0da`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:26:43,949::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:26:43,949::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:26:43,949::task::1168::TaskManager.Task::(prepare) Task=`39b09ade-e7d6-4504-a69d-742b2302e0da`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:26:43,950::task::579::TaskManager.Task::(_updateState) Task=`39b09ade-e7d6-4504-a69d-742b2302e0da`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:26:43,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:26:43,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:26:43,950::task::974::TaskManager.Task::(_decref) Task=`39b09ade-e7d6-4504-a69d-742b2302e0da`::ref 0 aborting False >Thread-288190::DEBUG::2014-01-16 17:26:44,340::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [58e8fd1a] >Thread-288190::INFO::2014-01-16 17:26:44,341::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-288190::DEBUG::2014-01-16 17:26:44,341::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-288190::ERROR::2014-01-16 17:26:44,361::BindingXMLRPC::1003::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in vmDestroy > return vm.destroy() > File "/usr/share/vdsm/API.py", line 329, in destroy > res = v.destroy() > File "/usr/share/vdsm/vm.py", line 4485, in destroy > response = self.releaseVm() > File "/usr/share/vdsm/vm.py", line 4417, in releaseVm > supervdsm.getProxy().removeFs(drive.path) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in removeFs > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >Exception: Cannot remove Fs that does not exists in: /var/run/vdsm/payload >VM Channels Listener::DEBUG::2014-01-16 17:26:44,539::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:26:44,539::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:26:44,540::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:44,655::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:45,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:26:45,541::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:26:45,541::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:26:45,695::task::579::TaskManager.Task::(_updateState) Task=`fd07bffe-d510-49ed-a3a5-4f4a6345abb5`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:26:45,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:26:45,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:26:45,696::task::1168::TaskManager.Task::(prepare) Task=`fd07bffe-d510-49ed-a3a5-4f4a6345abb5`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:26:45,696::task::579::TaskManager.Task::(_updateState) Task=`fd07bffe-d510-49ed-a3a5-4f4a6345abb5`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:26:45,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:26:45,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:26:45,696::task::974::TaskManager.Task::(_decref) Task=`fd07bffe-d510-49ed-a3a5-4f4a6345abb5`::ref 0 aborting False >Thread-288192::DEBUG::2014-01-16 17:26:45,961::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288192::DEBUG::2014-01-16 17:26:45,962::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.03', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.57', 'elapsedTime': '657', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:46,543::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:26:46,543::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:26:46,543::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:26:46,543::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:46,656::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:26:47,018::task::579::TaskManager.Task::(_updateState) Task=`f874c0eb-e342-45c2-aab1-970aaad66c0a`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:26:47,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:26:47,019::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:26:47,019::task::1168::TaskManager.Task::(prepare) Task=`f874c0eb-e342-45c2-aab1-970aaad66c0a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:26:47,019::task::579::TaskManager.Task::(_updateState) Task=`f874c0eb-e342-45c2-aab1-970aaad66c0a`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:26:47,019::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:26:47,019::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:26:47,020::task::974::TaskManager.Task::(_decref) Task=`f874c0eb-e342-45c2-aab1-970aaad66c0a`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:26:47,114::task::579::TaskManager.Task::(_updateState) Task=`80d03d3b-bf13-4a6f-bd84-40e8df22877e`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:26:47,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:26:47,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:26:47,114::task::1168::TaskManager.Task::(prepare) Task=`80d03d3b-bf13-4a6f-bd84-40e8df22877e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:26:47,114::task::579::TaskManager.Task::(_updateState) Task=`80d03d3b-bf13-4a6f-bd84-40e8df22877e`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:26:47,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:26:47,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:26:47,115::task::974::TaskManager.Task::(_decref) Task=`80d03d3b-bf13-4a6f-bd84-40e8df22877e`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:26:47,126::task::579::TaskManager.Task::(_updateState) Task=`759fb97b-c372-4917-982e-d9ab946cc52c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:26:47,126::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:26:47,127::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:26:47,127::task::1168::TaskManager.Task::(prepare) Task=`759fb97b-c372-4917-982e-d9ab946cc52c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:26:47,127::task::579::TaskManager.Task::(_updateState) Task=`759fb97b-c372-4917-982e-d9ab946cc52c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:26:47,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:26:47,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:26:47,127::task::974::TaskManager.Task::(_decref) Task=`759fb97b-c372-4917-982e-d9ab946cc52c`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:26:47,219::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:26:47,238::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000244559 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:47,544::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:26:47,894::task::579::TaskManager.Task::(_updateState) Task=`b07298b0-6489-40a6-8b28-0c055b6323af`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:26:47,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:26:47,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:26:47,895::task::1168::TaskManager.Task::(prepare) Task=`b07298b0-6489-40a6-8b28-0c055b6323af`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:26:47,895::task::579::TaskManager.Task::(_updateState) Task=`b07298b0-6489-40a6-8b28-0c055b6323af`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:26:47,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:26:47,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:26:47,896::task::974::TaskManager.Task::(_decref) Task=`b07298b0-6489-40a6-8b28-0c055b6323af`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:26:47,909::task::579::TaskManager.Task::(_updateState) Task=`602a7365-2858-4d6d-8aca-c5930427991c`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:26:47,909::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:26:47,909::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:26:47,909::task::1168::TaskManager.Task::(prepare) Task=`602a7365-2858-4d6d-8aca-c5930427991c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:26:47,910::task::579::TaskManager.Task::(_updateState) Task=`602a7365-2858-4d6d-8aca-c5930427991c`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:26:47,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:26:47,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:26:47,910::task::974::TaskManager.Task::(_decref) Task=`602a7365-2858-4d6d-8aca-c5930427991c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:48,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:26:48,546::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:48,658::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:48,660::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:26:48,661::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:26:48,662::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288193::DEBUG::2014-01-16 17:26:49,018::task::579::TaskManager.Task::(_updateState) Task=`66887b73-0b65-4ca3-9000-20b20e0bed72`::moving from state init -> state preparing >Thread-288193::INFO::2014-01-16 17:26:49,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288193::INFO::2014-01-16 17:26:49,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000244559', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00018317', 'lastCheck': '9.3', 'valid': True}} >Thread-288193::DEBUG::2014-01-16 17:26:49,019::task::1168::TaskManager.Task::(prepare) Task=`66887b73-0b65-4ca3-9000-20b20e0bed72`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000244559', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00018317', 'lastCheck': '9.3', 'valid': True}} >Thread-288193::DEBUG::2014-01-16 17:26:49,019::task::579::TaskManager.Task::(_updateState) Task=`66887b73-0b65-4ca3-9000-20b20e0bed72`::moving from state preparing -> state finished >Thread-288193::DEBUG::2014-01-16 17:26:49,019::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288193::DEBUG::2014-01-16 17:26:49,019::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288193::DEBUG::2014-01-16 17:26:49,019::task::974::TaskManager.Task::(_decref) Task=`66887b73-0b65-4ca3-9000-20b20e0bed72`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:49,547::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:26:49,688::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:26:49,705::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000239853 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:50,549::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:50,664::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:51,550::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:26:52,390::task::579::TaskManager.Task::(_updateState) Task=`aa5ccf78-dcf0-4391-8e8b-4b1653b755d8`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:26:52,390::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:26:52,391::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:26:52,391::task::1168::TaskManager.Task::(prepare) Task=`aa5ccf78-dcf0-4391-8e8b-4b1653b755d8`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:26:52,392::task::579::TaskManager.Task::(_updateState) Task=`aa5ccf78-dcf0-4391-8e8b-4b1653b755d8`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:26:52,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:26:52,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:26:52,392::task::974::TaskManager.Task::(_decref) Task=`aa5ccf78-dcf0-4391-8e8b-4b1653b755d8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:52,551::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:52,665::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288196::DEBUG::2014-01-16 17:26:52,748::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288196::DEBUG::2014-01-16 17:26:52,749::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.39', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.36', 'elapsedTime': '663', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:53,552::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:26:53,552::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:53,667::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:26:54,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:26:54,554::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:54,668::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:26:55,009::task::579::TaskManager.Task::(_updateState) Task=`60836c96-8a67-4fd9-9685-6ff46d701ac9`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:26:55,010::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:26:55,010::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:26:55,010::task::1168::TaskManager.Task::(prepare) Task=`60836c96-8a67-4fd9-9685-6ff46d701ac9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:26:55,010::task::579::TaskManager.Task::(_updateState) Task=`60836c96-8a67-4fd9-9685-6ff46d701ac9`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:26:55,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:26:55,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:26:55,011::task::974::TaskManager.Task::(_decref) Task=`60836c96-8a67-4fd9-9685-6ff46d701ac9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:55,555::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288198::DEBUG::2014-01-16 17:26:55,854::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288198::DEBUG::2014-01-16 17:26:55,855::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.39', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.41', 'elapsedTime': '666', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-84377::DEBUG::2014-01-16 17:26:56,016::task::579::TaskManager.Task::(_updateState) Task=`b811e2f5-46ee-449a-abba-3ea415f58e97`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:26:56,016::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:26:56,017::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:26:56,017::task::1168::TaskManager.Task::(prepare) Task=`b811e2f5-46ee-449a-abba-3ea415f58e97`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:26:56,017::task::579::TaskManager.Task::(_updateState) Task=`b811e2f5-46ee-449a-abba-3ea415f58e97`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:26:56,017::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:26:56,017::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:26:56,017::task::974::TaskManager.Task::(_decref) Task=`b811e2f5-46ee-449a-abba-3ea415f58e97`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:26:56,018::task::579::TaskManager.Task::(_updateState) Task=`bf5c6434-e77e-4473-bc82-d6488a6a96f8`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:26:56,018::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:26:56,018::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:26:56,018::task::1168::TaskManager.Task::(prepare) Task=`bf5c6434-e77e-4473-bc82-d6488a6a96f8`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:26:56,018::task::579::TaskManager.Task::(_updateState) Task=`bf5c6434-e77e-4473-bc82-d6488a6a96f8`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:26:56,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:26:56,019::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:26:56,019::task::974::TaskManager.Task::(_decref) Task=`bf5c6434-e77e-4473-bc82-d6488a6a96f8`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:26:56,019::task::579::TaskManager.Task::(_updateState) Task=`cfab605a-d1eb-4f52-a49f-956cdf341f5d`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:26:56,019::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:26:56,020::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:26:56,020::task::1168::TaskManager.Task::(prepare) Task=`cfab605a-d1eb-4f52-a49f-956cdf341f5d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:26:56,020::task::579::TaskManager.Task::(_updateState) Task=`cfab605a-d1eb-4f52-a49f-956cdf341f5d`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:26:56,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:26:56,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:26:56,020::task::974::TaskManager.Task::(_decref) Task=`cfab605a-d1eb-4f52-a49f-956cdf341f5d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:26:56,557::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:56,669::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:26:57,245::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:26:57,262::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275007 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:26:57,559::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:26:58,560::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:26:58,671::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:26:58,672::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288200::DEBUG::2014-01-16 17:26:58,965::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288200::DEBUG::2014-01-16 17:26:58,966::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.39', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.52', 'elapsedTime': '670', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:26:59,561::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:26:59,562::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:26:59,562::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:26:59,711::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:26:59,730::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000208702 s, 19.6 MB/s\n'; <rc> = 0 >Thread-221160::DEBUG::2014-01-16 17:27:00,300::task::579::TaskManager.Task::(_updateState) Task=`97956e27-251a-4ad4-a237-27338865ef1d`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:27:00,300::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:27:00,300::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:27:00,301::task::1168::TaskManager.Task::(prepare) Task=`97956e27-251a-4ad4-a237-27338865ef1d`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:27:00,301::task::579::TaskManager.Task::(_updateState) Task=`97956e27-251a-4ad4-a237-27338865ef1d`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:27:00,301::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:27:00,301::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:27:00,301::task::974::TaskManager.Task::(_decref) Task=`97956e27-251a-4ad4-a237-27338865ef1d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:00,563::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:27:00,564::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:00,673::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:01,564::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:27:01,565::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:27:01,565::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288202::DEBUG::2014-01-16 17:27:02,070::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288202::DEBUG::2014-01-16 17:27:02,071::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.39', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.63', 'elapsedTime': '673', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:27:02,566::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:27:02,567::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:02,675::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:03,568::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:27:03,568::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:03,677::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:27:03,677::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:27:03,678::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:04,569::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:04,680::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288203::DEBUG::2014-01-16 17:27:05,126::task::579::TaskManager.Task::(_updateState) Task=`3c65eeff-adb0-430e-8a17-c883938eff99`::moving from state init -> state preparing >Thread-288203::INFO::2014-01-16 17:27:05,126::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288203::INFO::2014-01-16 17:27:05,126::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275007', 'lastCheck': '7.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000208702', 'lastCheck': '5.4', 'valid': True}} >Thread-288203::DEBUG::2014-01-16 17:27:05,127::task::1168::TaskManager.Task::(prepare) Task=`3c65eeff-adb0-430e-8a17-c883938eff99`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275007', 'lastCheck': '7.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000208702', 'lastCheck': '5.4', 'valid': True}} >Thread-288203::DEBUG::2014-01-16 17:27:05,127::task::579::TaskManager.Task::(_updateState) Task=`3c65eeff-adb0-430e-8a17-c883938eff99`::moving from state preparing -> state finished >Thread-288203::DEBUG::2014-01-16 17:27:05,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288203::DEBUG::2014-01-16 17:27:05,127::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288203::DEBUG::2014-01-16 17:27:05,127::task::974::TaskManager.Task::(_decref) Task=`3c65eeff-adb0-430e-8a17-c883938eff99`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:05,570::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:27:05,570::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:06,572::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:27:06,572::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:06,681::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:27:07,088::task::579::TaskManager.Task::(_updateState) Task=`730377aa-2ab4-4e8a-a719-4a85cc8e3322`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:27:07,088::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:27:07,089::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:27:07,089::task::1168::TaskManager.Task::(prepare) Task=`730377aa-2ab4-4e8a-a719-4a85cc8e3322`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:27:07,089::task::579::TaskManager.Task::(_updateState) Task=`730377aa-2ab4-4e8a-a719-4a85cc8e3322`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:27:07,089::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:27:07,089::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:27:07,089::task::974::TaskManager.Task::(_decref) Task=`730377aa-2ab4-4e8a-a719-4a85cc8e3322`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:27:07,270::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:27:07,287::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000289809 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:07,573::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:27:07,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:27:07,574::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:27:07,574::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:08,575::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:27:08,576::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:27:08,576::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:08,682::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:08,683::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288206::DEBUG::2014-01-16 17:27:08,699::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288206::DEBUG::2014-01-16 17:27:08,700::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.01', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.25', 'elapsedTime': '679', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >Thread-53040::DEBUG::2014-01-16 17:27:09,428::task::579::TaskManager.Task::(_updateState) Task=`e7d35f8a-6545-4604-bf0a-bb025415fdce`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:27:09,428::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:27:09,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:27:09,429::task::1168::TaskManager.Task::(prepare) Task=`e7d35f8a-6545-4604-bf0a-bb025415fdce`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:27:09,429::task::579::TaskManager.Task::(_updateState) Task=`e7d35f8a-6545-4604-bf0a-bb025415fdce`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:27:09,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:27:09,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:27:09,429::task::974::TaskManager.Task::(_decref) Task=`e7d35f8a-6545-4604-bf0a-bb025415fdce`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:27:09,430::task::579::TaskManager.Task::(_updateState) Task=`5b6dd5bc-b3e2-481f-a3f0-fb5a804f768b`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:27:09,430::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:27:09,431::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:27:09,431::task::1168::TaskManager.Task::(prepare) Task=`5b6dd5bc-b3e2-481f-a3f0-fb5a804f768b`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:27:09,431::task::579::TaskManager.Task::(_updateState) Task=`5b6dd5bc-b3e2-481f-a3f0-fb5a804f768b`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:27:09,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:27:09,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:27:09,431::task::974::TaskManager.Task::(_decref) Task=`5b6dd5bc-b3e2-481f-a3f0-fb5a804f768b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:09,577::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:27:09,577::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:27:09,735::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:27:09,753::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000252534 s, 16.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:10,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:27:10,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:27:10,579::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:27:10,579::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:10,685::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:11,580::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:27:11,627::task::579::TaskManager.Task::(_updateState) Task=`6c843edb-913e-40c3-9e69-b9ec35c2df37`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:27:11,628::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:27:11,629::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:27:11,629::task::1168::TaskManager.Task::(prepare) Task=`6c843edb-913e-40c3-9e69-b9ec35c2df37`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:27:11,629::task::579::TaskManager.Task::(_updateState) Task=`6c843edb-913e-40c3-9e69-b9ec35c2df37`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:27:11,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:27:11,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:27:11,630::task::974::TaskManager.Task::(_decref) Task=`6c843edb-913e-40c3-9e69-b9ec35c2df37`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:27:11,630::task::579::TaskManager.Task::(_updateState) Task=`628abdf7-7fa9-4118-81d4-aa4afe9c7b9e`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:27:11,630::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:27:11,631::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:27:11,631::task::1168::TaskManager.Task::(prepare) Task=`628abdf7-7fa9-4118-81d4-aa4afe9c7b9e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:27:11,631::task::579::TaskManager.Task::(_updateState) Task=`628abdf7-7fa9-4118-81d4-aa4afe9c7b9e`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:27:11,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:27:11,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:27:11,631::task::974::TaskManager.Task::(_decref) Task=`628abdf7-7fa9-4118-81d4-aa4afe9c7b9e`::ref 0 aborting False >Thread-288208::DEBUG::2014-01-16 17:27:11,805::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288208::DEBUG::2014-01-16 17:27:11,806::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.01', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.36', 'elapsedTime': '682', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:27:12,580::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:27:12,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:27:12,581::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:27:12,581::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:12,581::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:27:12,582::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:27:12,686::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:13,584::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:13,687::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:27:13,970::task::579::TaskManager.Task::(_updateState) Task=`97aa4159-7e1f-487e-bb4d-1355fea654c3`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:27:13,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:27:13,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:27:13,971::task::1168::TaskManager.Task::(prepare) Task=`97aa4159-7e1f-487e-bb4d-1355fea654c3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:27:13,971::task::579::TaskManager.Task::(_updateState) Task=`97aa4159-7e1f-487e-bb4d-1355fea654c3`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:27:13,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:27:13,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:27:13,972::task::974::TaskManager.Task::(_decref) Task=`97aa4159-7e1f-487e-bb4d-1355fea654c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:14,585::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:27:14,585::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:27:14,585::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:14,689::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:27:14,746::task::579::TaskManager.Task::(_updateState) Task=`8b585ea3-612c-426a-a660-29480d939954`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:27:14,747::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:27:14,747::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:27:14,747::task::1168::TaskManager.Task::(prepare) Task=`8b585ea3-612c-426a-a660-29480d939954`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:27:14,747::task::579::TaskManager.Task::(_updateState) Task=`8b585ea3-612c-426a-a660-29480d939954`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:27:14,747::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:27:14,747::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:27:14,748::task::974::TaskManager.Task::(_decref) Task=`8b585ea3-612c-426a-a660-29480d939954`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:27:14,748::task::579::TaskManager.Task::(_updateState) Task=`cf6b2ecf-8cf8-421a-a901-feede126d454`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:27:14,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:27:14,748::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:27:14,748::task::1168::TaskManager.Task::(prepare) Task=`cf6b2ecf-8cf8-421a-a901-feede126d454`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:27:14,749::task::579::TaskManager.Task::(_updateState) Task=`cf6b2ecf-8cf8-421a-a901-feede126d454`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:27:14,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:27:14,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:27:14,749::task::974::TaskManager.Task::(_decref) Task=`cf6b2ecf-8cf8-421a-a901-feede126d454`::ref 0 aborting False >Thread-288210::DEBUG::2014-01-16 17:27:14,907::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288210::DEBUG::2014-01-16 17:27:14,909::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.01', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.46', 'elapsedTime': '685', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:27:15,586::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:27:15,587::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:27:15,587::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:16,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:27:16,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:27:16,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:27:16,589::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:16,690::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:27:17,295::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:27:17,312::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000316131 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:27:17,433::task::579::TaskManager.Task::(_updateState) Task=`7ff055ea-ad85-4255-94f6-cc142b5de6f8`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:27:17,434::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:27:17,434::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:27:17,434::task::1168::TaskManager.Task::(prepare) Task=`7ff055ea-ad85-4255-94f6-cc142b5de6f8`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:27:17,434::task::579::TaskManager.Task::(_updateState) Task=`7ff055ea-ad85-4255-94f6-cc142b5de6f8`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:27:17,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:27:17,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:27:17,435::task::974::TaskManager.Task::(_decref) Task=`7ff055ea-ad85-4255-94f6-cc142b5de6f8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:17,590::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:27:17,933::task::579::TaskManager.Task::(_updateState) Task=`7d459bac-8076-4d47-90b3-bb13ac27d9f4`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:27:17,933::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:27:17,934::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:27:17,934::task::1168::TaskManager.Task::(prepare) Task=`7d459bac-8076-4d47-90b3-bb13ac27d9f4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:27:17,934::task::579::TaskManager.Task::(_updateState) Task=`7d459bac-8076-4d47-90b3-bb13ac27d9f4`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:27:17,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:27:17,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:27:17,934::task::974::TaskManager.Task::(_decref) Task=`7d459bac-8076-4d47-90b3-bb13ac27d9f4`::ref 0 aborting False >Thread-288212::DEBUG::2014-01-16 17:27:18,015::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [44c3f774] >Thread-288212::DEBUG::2014-01-16 17:27:18,017::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.01', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.57', 'elapsedTime': '689', 'vmType': 'kvm', 'cpuSys': '0.86', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:27:18,591::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:27:18,591::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:18,691::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:18,692::task::579::TaskManager.Task::(_updateState) Task=`cf526abf-ac9d-4bd0-932d-df92624df061`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:27:18,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:27:18,692::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:27:18,692::task::1168::TaskManager.Task::(prepare) Task=`cf526abf-ac9d-4bd0-932d-df92624df061`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:27:18,692::task::579::TaskManager.Task::(_updateState) Task=`cf526abf-ac9d-4bd0-932d-df92624df061`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:27:18,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:27:18,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:27:18,693::task::974::TaskManager.Task::(_decref) Task=`cf526abf-ac9d-4bd0-932d-df92624df061`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:27:18,694::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:27:18,695::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:27:18,696::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:18,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:18,698::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:19,592::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:27:19,673::task::579::TaskManager.Task::(_updateState) Task=`085ee64e-b844-4c4f-a21e-b95fa259e014`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:27:19,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:27:19,673::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:27:19,674::task::1168::TaskManager.Task::(prepare) Task=`085ee64e-b844-4c4f-a21e-b95fa259e014`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:27:19,674::task::579::TaskManager.Task::(_updateState) Task=`085ee64e-b844-4c4f-a21e-b95fa259e014`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:27:19,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:27:19,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:27:19,674::task::974::TaskManager.Task::(_decref) Task=`085ee64e-b844-4c4f-a21e-b95fa259e014`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:27:19,758::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:27:19,775::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024736 s, 16.6 MB/s\n'; <rc> = 0 >Thread-84402::DEBUG::2014-01-16 17:27:19,957::task::579::TaskManager.Task::(_updateState) Task=`fd55d222-1897-444d-8509-f3434b0984b1`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:27:19,957::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:27:19,958::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:27:19,958::task::1168::TaskManager.Task::(prepare) Task=`fd55d222-1897-444d-8509-f3434b0984b1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:27:19,958::task::579::TaskManager.Task::(_updateState) Task=`fd55d222-1897-444d-8509-f3434b0984b1`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:27:19,958::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:27:19,958::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:27:19,959::task::974::TaskManager.Task::(_decref) Task=`fd55d222-1897-444d-8509-f3434b0984b1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:20,594::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17110::DEBUG::2014-01-16 17:27:20,641::task::579::TaskManager.Task::(_updateState) Task=`27830799-16a7-43fb-b2b6-2be6e306d8b1`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:27:20,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:27:20,642::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:27:20,642::task::1168::TaskManager.Task::(prepare) Task=`27830799-16a7-43fb-b2b6-2be6e306d8b1`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:27:20,642::task::579::TaskManager.Task::(_updateState) Task=`27830799-16a7-43fb-b2b6-2be6e306d8b1`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:27:20,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:27:20,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:27:20,642::task::974::TaskManager.Task::(_decref) Task=`27830799-16a7-43fb-b2b6-2be6e306d8b1`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:27:20,643::task::579::TaskManager.Task::(_updateState) Task=`81e9de93-9dbb-4acc-bc09-e7afb8d44cb3`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:27:20,643::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:27:20,643::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:27:20,643::task::1168::TaskManager.Task::(prepare) Task=`81e9de93-9dbb-4acc-bc09-e7afb8d44cb3`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:27:20,644::task::579::TaskManager.Task::(_updateState) Task=`81e9de93-9dbb-4acc-bc09-e7afb8d44cb3`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:27:20,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:27:20,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:27:20,644::task::974::TaskManager.Task::(_decref) Task=`81e9de93-9dbb-4acc-bc09-e7afb8d44cb3`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:27:20,700::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288213::DEBUG::2014-01-16 17:27:21,073::task::579::TaskManager.Task::(_updateState) Task=`3e61540e-8295-45c9-a809-f6b5dd588a82`::moving from state init -> state preparing >Thread-288213::INFO::2014-01-16 17:27:21,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288213::INFO::2014-01-16 17:27:21,073::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316131', 'lastCheck': '3.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024736', 'lastCheck': '1.3', 'valid': True}} >Thread-288213::DEBUG::2014-01-16 17:27:21,073::task::1168::TaskManager.Task::(prepare) Task=`3e61540e-8295-45c9-a809-f6b5dd588a82`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316131', 'lastCheck': '3.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024736', 'lastCheck': '1.3', 'valid': True}} >Thread-288213::DEBUG::2014-01-16 17:27:21,074::task::579::TaskManager.Task::(_updateState) Task=`3e61540e-8295-45c9-a809-f6b5dd588a82`::moving from state preparing -> state finished >Thread-288213::DEBUG::2014-01-16 17:27:21,074::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288213::DEBUG::2014-01-16 17:27:21,074::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288213::DEBUG::2014-01-16 17:27:21,074::task::974::TaskManager.Task::(_decref) Task=`3e61540e-8295-45c9-a809-f6b5dd588a82`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:27:21,147::task::579::TaskManager.Task::(_updateState) Task=`7f6ad0f0-b6c4-4c0e-82f1-f37dd327101c`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:27:21,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:27:21,149::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:27:21,149::task::1168::TaskManager.Task::(prepare) Task=`7f6ad0f0-b6c4-4c0e-82f1-f37dd327101c`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:27:21,150::task::579::TaskManager.Task::(_updateState) Task=`7f6ad0f0-b6c4-4c0e-82f1-f37dd327101c`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:27:21,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:27:21,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:27:21,152::task::974::TaskManager.Task::(_decref) Task=`7f6ad0f0-b6c4-4c0e-82f1-f37dd327101c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:21,595::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:22,597::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:22,702::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:23,598::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:27:23,598::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:23,703::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:27:24,102::task::579::TaskManager.Task::(_updateState) Task=`5cae7ab6-6f81-4d01-b262-d6d172d84c7e`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:27:24,102::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:27:24,102::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:27:24,103::task::1168::TaskManager.Task::(prepare) Task=`5cae7ab6-6f81-4d01-b262-d6d172d84c7e`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:27:24,103::task::579::TaskManager.Task::(_updateState) Task=`5cae7ab6-6f81-4d01-b262-d6d172d84c7e`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:27:24,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:27:24,103::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:27:24,103::task::974::TaskManager.Task::(_decref) Task=`5cae7ab6-6f81-4d01-b262-d6d172d84c7e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:24,599::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:27:24,599::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288216::DEBUG::2014-01-16 17:27:24,632::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288216::DEBUG::2014-01-16 17:27:24,633::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.56', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '695', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:27:24,704::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:25,600::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:26,601::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:26,706::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:27:26,895::task::579::TaskManager.Task::(_updateState) Task=`2b71ae3b-9c86-4b08-bc42-5c5367a646c6`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:27:26,895::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:27:26,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:27:26,895::task::1168::TaskManager.Task::(prepare) Task=`2b71ae3b-9c86-4b08-bc42-5c5367a646c6`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:27:26,896::task::579::TaskManager.Task::(_updateState) Task=`2b71ae3b-9c86-4b08-bc42-5c5367a646c6`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:27:26,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:27:26,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:27:26,896::task::974::TaskManager.Task::(_decref) Task=`2b71ae3b-9c86-4b08-bc42-5c5367a646c6`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:27:27,320::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:27:27,338::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00030625 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:27,602::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288218::DEBUG::2014-01-16 17:27:27,733::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288218::DEBUG::2014-01-16 17:27:27,734::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.56', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.28', 'elapsedTime': '698', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-15207::DEBUG::2014-01-16 17:27:28,320::task::579::TaskManager.Task::(_updateState) Task=`4363e824-f2d1-46dd-8a2d-14200627bc6a`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:27:28,321::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:27:28,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:27:28,321::task::1168::TaskManager.Task::(prepare) Task=`4363e824-f2d1-46dd-8a2d-14200627bc6a`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:27:28,321::task::579::TaskManager.Task::(_updateState) Task=`4363e824-f2d1-46dd-8a2d-14200627bc6a`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:27:28,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:27:28,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:27:28,322::task::974::TaskManager.Task::(_decref) Task=`4363e824-f2d1-46dd-8a2d-14200627bc6a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:28,603::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:28,707::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:28,708::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:29,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:27:29,604::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:27:29,604::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:27:29,780::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:27:29,797::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000262932 s, 15.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:30,606::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:27:30,606::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:30,709::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288220::DEBUG::2014-01-16 17:27:30,839::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288220::DEBUG::2014-01-16 17:27:30,841::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.56', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'elapsedTime': '701', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-48934::DEBUG::2014-01-16 17:27:30,996::task::579::TaskManager.Task::(_updateState) Task=`bad9152f-785f-4d8c-af0a-e1b139598bf2`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:27:30,996::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:27:30,997::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:27:30,997::task::1168::TaskManager.Task::(prepare) Task=`bad9152f-785f-4d8c-af0a-e1b139598bf2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:27:30,997::task::579::TaskManager.Task::(_updateState) Task=`bad9152f-785f-4d8c-af0a-e1b139598bf2`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:27:30,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:27:30,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:27:30,997::task::974::TaskManager.Task::(_decref) Task=`bad9152f-785f-4d8c-af0a-e1b139598bf2`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:27:30,998::task::579::TaskManager.Task::(_updateState) Task=`2a133cd1-a3e7-46e1-b92c-5534428f9594`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:27:30,998::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:27:30,998::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:27:30,998::task::1168::TaskManager.Task::(prepare) Task=`2a133cd1-a3e7-46e1-b92c-5534428f9594`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:27:30,998::task::579::TaskManager.Task::(_updateState) Task=`2a133cd1-a3e7-46e1-b92c-5534428f9594`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:27:30,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:27:30,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:27:30,999::task::974::TaskManager.Task::(_decref) Task=`2a133cd1-a3e7-46e1-b92c-5534428f9594`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:27:30,999::task::579::TaskManager.Task::(_updateState) Task=`9de354b2-aa49-4531-b662-3935e95151e8`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:27:30,999::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:27:31,000::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:27:31,000::task::1168::TaskManager.Task::(prepare) Task=`9de354b2-aa49-4531-b662-3935e95151e8`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:27:31,000::task::579::TaskManager.Task::(_updateState) Task=`9de354b2-aa49-4531-b662-3935e95151e8`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:27:31,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:27:31,000::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:27:31,000::task::974::TaskManager.Task::(_decref) Task=`9de354b2-aa49-4531-b662-3935e95151e8`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:31,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:27:31,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:27:31,607::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:32,608::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:27:32,608::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:32,711::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:33,609::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:27:33,609::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:33,713::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:27:33,713::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:27:33,715::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288222::DEBUG::2014-01-16 17:27:33,936::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288222::DEBUG::2014-01-16 17:27:33,937::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.56', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'elapsedTime': '705', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189046::DEBUG::2014-01-16 17:27:34,579::task::579::TaskManager.Task::(_updateState) Task=`1ce8216a-594a-4932-be01-d5a8f8b7b310`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:27:34,579::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:27:34,579::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:27:34,580::task::1168::TaskManager.Task::(prepare) Task=`1ce8216a-594a-4932-be01-d5a8f8b7b310`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:27:34,580::task::579::TaskManager.Task::(_updateState) Task=`1ce8216a-594a-4932-be01-d5a8f8b7b310`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:27:34,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:27:34,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:27:34,580::task::974::TaskManager.Task::(_decref) Task=`1ce8216a-594a-4932-be01-d5a8f8b7b310`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:34,610::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:34,716::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:35,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:27:35,611::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:36,612::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:27:36,613::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:36,717::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288223::DEBUG::2014-01-16 17:27:36,994::task::579::TaskManager.Task::(_updateState) Task=`e3603043-fd09-4914-846c-2b508dd68dbe`::moving from state init -> state preparing >Thread-288223::INFO::2014-01-16 17:27:36,994::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288223::INFO::2014-01-16 17:27:36,994::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030625', 'lastCheck': '9.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262932', 'lastCheck': '7.2', 'valid': True}} >Thread-288223::DEBUG::2014-01-16 17:27:36,994::task::1168::TaskManager.Task::(prepare) Task=`e3603043-fd09-4914-846c-2b508dd68dbe`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00030625', 'lastCheck': '9.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262932', 'lastCheck': '7.2', 'valid': True}} >Thread-288223::DEBUG::2014-01-16 17:27:36,994::task::579::TaskManager.Task::(_updateState) Task=`e3603043-fd09-4914-846c-2b508dd68dbe`::moving from state preparing -> state finished >Thread-288223::DEBUG::2014-01-16 17:27:36,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288223::DEBUG::2014-01-16 17:27:36,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288223::DEBUG::2014-01-16 17:27:36,995::task::974::TaskManager.Task::(_decref) Task=`e3603043-fd09-4914-846c-2b508dd68dbe`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:27:37,346::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:27:37,362::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000291955 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:37,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:27:37,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:27:37,614::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:27:37,615::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3175::DEBUG::2014-01-16 17:27:38,533::task::579::TaskManager.Task::(_updateState) Task=`7ef8b12c-b03e-4ad2-b4b5-7f80af49df2c`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:27:38,534::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:27:38,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:27:38,534::task::1168::TaskManager.Task::(prepare) Task=`7ef8b12c-b03e-4ad2-b4b5-7f80af49df2c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:27:38,534::task::579::TaskManager.Task::(_updateState) Task=`7ef8b12c-b03e-4ad2-b4b5-7f80af49df2c`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:27:38,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:27:38,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:27:38,535::task::974::TaskManager.Task::(_decref) Task=`7ef8b12c-b03e-4ad2-b4b5-7f80af49df2c`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:27:38,598::task::579::TaskManager.Task::(_updateState) Task=`db18c1e5-a7d8-4e42-8ca6-3a49be314bbd`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:27:38,598::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:27:38,599::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:27:38,599::task::1168::TaskManager.Task::(prepare) Task=`db18c1e5-a7d8-4e42-8ca6-3a49be314bbd`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:27:38,599::task::579::TaskManager.Task::(_updateState) Task=`db18c1e5-a7d8-4e42-8ca6-3a49be314bbd`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:27:38,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:27:38,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:27:38,600::task::974::TaskManager.Task::(_decref) Task=`db18c1e5-a7d8-4e42-8ca6-3a49be314bbd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:38,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:27:38,616::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:27:38,616::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:38,719::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:38,720::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:39,617::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:27:39,618::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:27:39,803::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:27:39,821::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000242068 s, 16.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:40,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:27:40,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:27:40,619::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:27:40,620::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288226::DEBUG::2014-01-16 17:27:40,654::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288226::DEBUG::2014-01-16 17:27:40,655::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.42', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.19', 'elapsedTime': '711', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:27:40,721::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:41,621::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:42,622::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:27:42,622::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:27:42,623::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:27:42,623::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:42,623::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:27:42,623::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:27:42,722::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:43,624::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:43,723::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288228::DEBUG::2014-01-16 17:27:43,808::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288228::DEBUG::2014-01-16 17:27:43,810::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.42', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.35', 'elapsedTime': '714', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-48925::DEBUG::2014-01-16 17:27:43,996::task::579::TaskManager.Task::(_updateState) Task=`181699af-0b9e-46f7-8099-af6a1f487158`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:27:43,996::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:27:43,997::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:27:43,997::task::1168::TaskManager.Task::(prepare) Task=`181699af-0b9e-46f7-8099-af6a1f487158`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:27:43,997::task::579::TaskManager.Task::(_updateState) Task=`181699af-0b9e-46f7-8099-af6a1f487158`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:27:43,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:27:43,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:27:43,997::task::974::TaskManager.Task::(_decref) Task=`181699af-0b9e-46f7-8099-af6a1f487158`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:27:43,998::task::579::TaskManager.Task::(_updateState) Task=`d5c080b1-39a8-4c71-9a62-730574166308`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:27:43,998::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:27:43,998::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:27:43,998::task::1168::TaskManager.Task::(prepare) Task=`d5c080b1-39a8-4c71-9a62-730574166308`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:27:43,998::task::579::TaskManager.Task::(_updateState) Task=`d5c080b1-39a8-4c71-9a62-730574166308`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:27:43,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:27:43,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:27:43,999::task::974::TaskManager.Task::(_decref) Task=`d5c080b1-39a8-4c71-9a62-730574166308`::ref 0 aborting False >Thread-251420::DEBUG::2014-01-16 17:27:44,148::task::579::TaskManager.Task::(_updateState) Task=`c96099b4-62a7-413e-b5bc-2be4410ffda9`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:27:44,148::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:27:44,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:27:44,148::task::1168::TaskManager.Task::(prepare) Task=`c96099b4-62a7-413e-b5bc-2be4410ffda9`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:27:44,148::task::579::TaskManager.Task::(_updateState) Task=`c96099b4-62a7-413e-b5bc-2be4410ffda9`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:27:44,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:27:44,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:27:44,149::task::974::TaskManager.Task::(_decref) Task=`c96099b4-62a7-413e-b5bc-2be4410ffda9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:44,626::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:27:44,626::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:27:44,626::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:44,725::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:45,627::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:27:45,628::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:27:45,628::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:27:45,865::task::579::TaskManager.Task::(_updateState) Task=`e2e9c9bf-b644-46da-a1af-7309d130213c`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:27:45,866::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:27:45,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:27:45,866::task::1168::TaskManager.Task::(prepare) Task=`e2e9c9bf-b644-46da-a1af-7309d130213c`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:27:45,866::task::579::TaskManager.Task::(_updateState) Task=`e2e9c9bf-b644-46da-a1af-7309d130213c`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:27:45,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:27:45,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:27:45,867::task::974::TaskManager.Task::(_decref) Task=`e2e9c9bf-b644-46da-a1af-7309d130213c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:46,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:27:46,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:27:46,629::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:27:46,629::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:46,726::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288230::DEBUG::2014-01-16 17:27:46,918::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288230::DEBUG::2014-01-16 17:27:46,920::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.42', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.46', 'elapsedTime': '718', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >Thread-16398::DEBUG::2014-01-16 17:27:47,186::task::579::TaskManager.Task::(_updateState) Task=`8c570849-7a12-4ba4-8396-d757398b53f8`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:27:47,186::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:27:47,186::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:27:47,187::task::1168::TaskManager.Task::(prepare) Task=`8c570849-7a12-4ba4-8396-d757398b53f8`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:27:47,187::task::579::TaskManager.Task::(_updateState) Task=`8c570849-7a12-4ba4-8396-d757398b53f8`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:27:47,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:27:47,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:27:47,187::task::974::TaskManager.Task::(_decref) Task=`8c570849-7a12-4ba4-8396-d757398b53f8`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:27:47,275::task::579::TaskManager.Task::(_updateState) Task=`a11234ac-fa31-483c-865e-12baf8fb444d`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:27:47,275::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:27:47,275::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:27:47,276::task::1168::TaskManager.Task::(prepare) Task=`a11234ac-fa31-483c-865e-12baf8fb444d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:27:47,276::task::579::TaskManager.Task::(_updateState) Task=`a11234ac-fa31-483c-865e-12baf8fb444d`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:27:47,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:27:47,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:27:47,276::task::974::TaskManager.Task::(_decref) Task=`a11234ac-fa31-483c-865e-12baf8fb444d`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:27:47,293::task::579::TaskManager.Task::(_updateState) Task=`fa303446-9202-46d0-8f5d-d8b58326b76c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:27:47,293::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:27:47,293::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:27:47,293::task::1168::TaskManager.Task::(prepare) Task=`fa303446-9202-46d0-8f5d-d8b58326b76c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:27:47,294::task::579::TaskManager.Task::(_updateState) Task=`fa303446-9202-46d0-8f5d-d8b58326b76c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:27:47,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:27:47,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:27:47,294::task::974::TaskManager.Task::(_decref) Task=`fa303446-9202-46d0-8f5d-d8b58326b76c`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:27:47,370::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:27:47,387::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000299199 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:47,631::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:27:48,060::task::579::TaskManager.Task::(_updateState) Task=`2b4c2e19-e2a7-4d6f-bd01-c333df49fdde`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:27:48,060::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:27:48,061::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:27:48,061::task::1168::TaskManager.Task::(prepare) Task=`2b4c2e19-e2a7-4d6f-bd01-c333df49fdde`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:27:48,061::task::579::TaskManager.Task::(_updateState) Task=`2b4c2e19-e2a7-4d6f-bd01-c333df49fdde`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:27:48,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:27:48,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:27:48,062::task::974::TaskManager.Task::(_decref) Task=`2b4c2e19-e2a7-4d6f-bd01-c333df49fdde`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:27:48,067::task::579::TaskManager.Task::(_updateState) Task=`0ffa3eff-1b5c-4bbb-ac4d-bf4099bafb43`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:27:48,068::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:27:48,068::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:27:48,068::task::1168::TaskManager.Task::(prepare) Task=`0ffa3eff-1b5c-4bbb-ac4d-bf4099bafb43`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:27:48,068::task::579::TaskManager.Task::(_updateState) Task=`0ffa3eff-1b5c-4bbb-ac4d-bf4099bafb43`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:27:48,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:27:48,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:27:48,069::task::974::TaskManager.Task::(_decref) Task=`0ffa3eff-1b5c-4bbb-ac4d-bf4099bafb43`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:48,632::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:27:48,632::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:48,727::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:48,729::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:27:48,730::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:27:48,731::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:49,633::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:27:49,827::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:27:49,844::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000258963 s, 15.8 MB/s\n'; <rc> = 0 >Thread-288232::DEBUG::2014-01-16 17:27:50,025::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288232::DEBUG::2014-01-16 17:27:50,027::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.42', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.56', 'elapsedTime': '721', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:27:50,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:50,733::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:51,636::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:27:52,462::task::579::TaskManager.Task::(_updateState) Task=`29892642-6919-4f4d-aea4-e750014702dc`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:27:52,462::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:27:52,463::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:27:52,463::task::1168::TaskManager.Task::(prepare) Task=`29892642-6919-4f4d-aea4-e750014702dc`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:27:52,463::task::579::TaskManager.Task::(_updateState) Task=`29892642-6919-4f4d-aea4-e750014702dc`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:27:52,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:27:52,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:27:52,464::task::974::TaskManager.Task::(_decref) Task=`29892642-6919-4f4d-aea4-e750014702dc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:52,637::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:52,734::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288233::DEBUG::2014-01-16 17:27:53,137::task::579::TaskManager.Task::(_updateState) Task=`8b3cb217-339e-4b0d-bb19-bd20a2b1b8b5`::moving from state init -> state preparing >Thread-288233::INFO::2014-01-16 17:27:53,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288233::INFO::2014-01-16 17:27:53,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000299199', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258963', 'lastCheck': '3.3', 'valid': True}} >Thread-288233::DEBUG::2014-01-16 17:27:53,138::task::1168::TaskManager.Task::(prepare) Task=`8b3cb217-339e-4b0d-bb19-bd20a2b1b8b5`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000299199', 'lastCheck': '5.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258963', 'lastCheck': '3.3', 'valid': True}} >Thread-288233::DEBUG::2014-01-16 17:27:53,138::task::579::TaskManager.Task::(_updateState) Task=`8b3cb217-339e-4b0d-bb19-bd20a2b1b8b5`::moving from state preparing -> state finished >Thread-288233::DEBUG::2014-01-16 17:27:53,138::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288233::DEBUG::2014-01-16 17:27:53,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288233::DEBUG::2014-01-16 17:27:53,139::task::974::TaskManager.Task::(_decref) Task=`8b3cb217-339e-4b0d-bb19-bd20a2b1b8b5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:53,637::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:27:53,638::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:53,735::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:54,639::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:27:54,639::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:54,736::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:27:55,175::task::579::TaskManager.Task::(_updateState) Task=`d1a197e7-65dd-4ee4-ad74-79aeaba44de5`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:27:55,176::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:27:55,176::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:27:55,176::task::1168::TaskManager.Task::(prepare) Task=`d1a197e7-65dd-4ee4-ad74-79aeaba44de5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:27:55,176::task::579::TaskManager.Task::(_updateState) Task=`d1a197e7-65dd-4ee4-ad74-79aeaba44de5`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:27:55,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:27:55,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:27:55,177::task::974::TaskManager.Task::(_decref) Task=`d1a197e7-65dd-4ee4-ad74-79aeaba44de5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:55,640::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:27:56,284::task::579::TaskManager.Task::(_updateState) Task=`f68deaab-8cde-4d56-a640-6e892b7f32ad`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:27:56,285::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:27:56,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:27:56,285::task::1168::TaskManager.Task::(prepare) Task=`f68deaab-8cde-4d56-a640-6e892b7f32ad`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:27:56,285::task::579::TaskManager.Task::(_updateState) Task=`f68deaab-8cde-4d56-a640-6e892b7f32ad`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:27:56,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:27:56,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:27:56,286::task::974::TaskManager.Task::(_decref) Task=`f68deaab-8cde-4d56-a640-6e892b7f32ad`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:27:56,286::task::579::TaskManager.Task::(_updateState) Task=`d3140b90-30a5-49e0-b904-d66f2a4c4a96`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:27:56,286::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:27:56,287::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:27:56,287::task::1168::TaskManager.Task::(prepare) Task=`d3140b90-30a5-49e0-b904-d66f2a4c4a96`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:27:56,287::task::579::TaskManager.Task::(_updateState) Task=`d3140b90-30a5-49e0-b904-d66f2a4c4a96`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:27:56,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:27:56,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:27:56,287::task::974::TaskManager.Task::(_decref) Task=`d3140b90-30a5-49e0-b904-d66f2a4c4a96`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:27:56,288::task::579::TaskManager.Task::(_updateState) Task=`8aa8c81e-2371-4af1-88b1-e7d9275f4738`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:27:56,288::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:27:56,288::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:27:56,288::task::1168::TaskManager.Task::(prepare) Task=`8aa8c81e-2371-4af1-88b1-e7d9275f4738`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:27:56,288::task::579::TaskManager.Task::(_updateState) Task=`8aa8c81e-2371-4af1-88b1-e7d9275f4738`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:27:56,288::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:27:56,288::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:27:56,289::task::974::TaskManager.Task::(_decref) Task=`8aa8c81e-2371-4af1-88b1-e7d9275f4738`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:27:56,641::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288236::DEBUG::2014-01-16 17:27:56,702::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288236::DEBUG::2014-01-16 17:27:56,704::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.19', 'elapsedTime': '727', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:27:56,737::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:27:57,394::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:27:57,413::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000254086 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:27:57,643::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:27:58,644::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:27:58,739::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:27:58,740::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:27:59,644::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:27:59,645::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:27:59,645::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288238::DEBUG::2014-01-16 17:27:59,801::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288238::DEBUG::2014-01-16 17:27:59,803::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.29', 'elapsedTime': '730', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-22::DEBUG::2014-01-16 17:27:59,850::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:27:59,867::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000281884 s, 14.5 MB/s\n'; <rc> = 0 >Thread-221160::DEBUG::2014-01-16 17:28:00,493::task::579::TaskManager.Task::(_updateState) Task=`fa87e33a-a971-4a0a-bd91-6922847dd4ce`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:28:00,493::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:28:00,494::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:28:00,494::task::1168::TaskManager.Task::(prepare) Task=`fa87e33a-a971-4a0a-bd91-6922847dd4ce`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:28:00,494::task::579::TaskManager.Task::(_updateState) Task=`fa87e33a-a971-4a0a-bd91-6922847dd4ce`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:28:00,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:28:00,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:28:00,494::task::974::TaskManager.Task::(_decref) Task=`fa87e33a-a971-4a0a-bd91-6922847dd4ce`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:00,646::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:28:00,647::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:00,741::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:01,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:28:01,648::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:28:01,648::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:02,649::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:28:02,649::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:02,742::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288240::DEBUG::2014-01-16 17:28:02,900::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288240::DEBUG::2014-01-16 17:28:02,901::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'elapsedTime': '733', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:03,650::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:28:03,650::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:03,744::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:28:03,745::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:28:03,746::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:04,651::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:04,747::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:05,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:28:05,653::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288242::DEBUG::2014-01-16 17:28:05,998::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [44c3f774] >Thread-288242::DEBUG::2014-01-16 17:28:05,999::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'elapsedTime': '737', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:06,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:28:06,654::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:06,749::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:28:07,254::task::579::TaskManager.Task::(_updateState) Task=`9bd93c00-4f11-44ec-a586-74613b81b70b`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:28:07,254::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:28:07,254::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:28:07,254::task::1168::TaskManager.Task::(prepare) Task=`9bd93c00-4f11-44ec-a586-74613b81b70b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:28:07,255::task::579::TaskManager.Task::(_updateState) Task=`9bd93c00-4f11-44ec-a586-74613b81b70b`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:28:07,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:28:07,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:28:07,255::task::974::TaskManager.Task::(_decref) Task=`9bd93c00-4f11-44ec-a586-74613b81b70b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:28:07,423::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:28:07,441::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000275733 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:07,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:28:07,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:28:07,655::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:28:07,655::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:08,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:28:08,657::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:28:08,657::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:08,750::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:08,751::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288243::DEBUG::2014-01-16 17:28:09,055::task::579::TaskManager.Task::(_updateState) Task=`5942bd0e-3a9e-4433-8799-88b8d4873974`::moving from state init -> state preparing >Thread-288243::INFO::2014-01-16 17:28:09,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288243::INFO::2014-01-16 17:28:09,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275733', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281884', 'lastCheck': '9.2', 'valid': True}} >Thread-288243::DEBUG::2014-01-16 17:28:09,056::task::1168::TaskManager.Task::(prepare) Task=`5942bd0e-3a9e-4433-8799-88b8d4873974`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000275733', 'lastCheck': '1.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281884', 'lastCheck': '9.2', 'valid': True}} >Thread-288243::DEBUG::2014-01-16 17:28:09,056::task::579::TaskManager.Task::(_updateState) Task=`5942bd0e-3a9e-4433-8799-88b8d4873974`::moving from state preparing -> state finished >Thread-288243::DEBUG::2014-01-16 17:28:09,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288243::DEBUG::2014-01-16 17:28:09,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288243::DEBUG::2014-01-16 17:28:09,057::task::974::TaskManager.Task::(_decref) Task=`5942bd0e-3a9e-4433-8799-88b8d4873974`::ref 0 aborting False >Thread-53040::DEBUG::2014-01-16 17:28:09,512::task::579::TaskManager.Task::(_updateState) Task=`830cf6e8-1b4f-4aa8-b630-eda16917dbcb`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:28:09,512::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:28:09,513::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:28:09,513::task::1168::TaskManager.Task::(prepare) Task=`830cf6e8-1b4f-4aa8-b630-eda16917dbcb`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:28:09,513::task::579::TaskManager.Task::(_updateState) Task=`830cf6e8-1b4f-4aa8-b630-eda16917dbcb`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:28:09,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:28:09,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:28:09,513::task::974::TaskManager.Task::(_decref) Task=`830cf6e8-1b4f-4aa8-b630-eda16917dbcb`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:28:09,518::task::579::TaskManager.Task::(_updateState) Task=`450cc9f3-5723-4249-9ce2-16a9fef8b90a`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:28:09,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:28:09,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:28:09,519::task::1168::TaskManager.Task::(prepare) Task=`450cc9f3-5723-4249-9ce2-16a9fef8b90a`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:28:09,519::task::579::TaskManager.Task::(_updateState) Task=`450cc9f3-5723-4249-9ce2-16a9fef8b90a`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:28:09,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:28:09,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:28:09,519::task::974::TaskManager.Task::(_decref) Task=`450cc9f3-5723-4249-9ce2-16a9fef8b90a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:09,658::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:28:09,659::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:28:09,873::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:28:09,889::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000256 s, 16.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:10,660::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:28:10,661::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:28:10,661::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:28:10,661::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:10,752::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:11,662::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:28:11,712::task::579::TaskManager.Task::(_updateState) Task=`f7db67fa-c4f9-4599-93da-095014b74494`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:28:11,713::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:28:11,713::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:28:11,713::task::1168::TaskManager.Task::(prepare) Task=`f7db67fa-c4f9-4599-93da-095014b74494`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:28:11,714::task::579::TaskManager.Task::(_updateState) Task=`f7db67fa-c4f9-4599-93da-095014b74494`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:28:11,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:28:11,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:28:11,714::task::974::TaskManager.Task::(_decref) Task=`f7db67fa-c4f9-4599-93da-095014b74494`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:28:11,714::task::579::TaskManager.Task::(_updateState) Task=`1daeeab9-debf-4bbe-b2fe-2bc3bbd3d3ec`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:28:11,714::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:28:11,715::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:28:11,715::task::1168::TaskManager.Task::(prepare) Task=`1daeeab9-debf-4bbe-b2fe-2bc3bbd3d3ec`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:28:11,715::task::579::TaskManager.Task::(_updateState) Task=`1daeeab9-debf-4bbe-b2fe-2bc3bbd3d3ec`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:28:11,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:28:11,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:28:11,715::task::974::TaskManager.Task::(_decref) Task=`1daeeab9-debf-4bbe-b2fe-2bc3bbd3d3ec`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:12,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:28:12,663::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:28:12,664::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:28:12,666::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:12,666::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:28:12,667::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-288246::DEBUG::2014-01-16 17:28:12,707::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288246::DEBUG::2014-01-16 17:28:12,709::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.33', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.19', 'elapsedTime': '743', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]} >Thread-189817::DEBUG::2014-01-16 17:28:12,754::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:13,667::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:13,755::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:28:14,136::task::579::TaskManager.Task::(_updateState) Task=`a1f52e65-25e7-4ce5-b9ee-91f75108669e`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:28:14,136::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:28:14,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:28:14,137::task::1168::TaskManager.Task::(prepare) Task=`a1f52e65-25e7-4ce5-b9ee-91f75108669e`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:28:14,137::task::579::TaskManager.Task::(_updateState) Task=`a1f52e65-25e7-4ce5-b9ee-91f75108669e`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:28:14,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:28:14,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:28:14,137::task::974::TaskManager.Task::(_decref) Task=`a1f52e65-25e7-4ce5-b9ee-91f75108669e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:14,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:28:14,668::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:28:14,669::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:14,756::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:28:14,973::task::579::TaskManager.Task::(_updateState) Task=`b5ca8d46-9286-4a6a-8a4b-3ba8808c5286`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:28:14,974::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:28:14,974::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:28:14,974::task::1168::TaskManager.Task::(prepare) Task=`b5ca8d46-9286-4a6a-8a4b-3ba8808c5286`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:28:14,974::task::579::TaskManager.Task::(_updateState) Task=`b5ca8d46-9286-4a6a-8a4b-3ba8808c5286`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:28:14,974::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:28:14,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:28:14,975::task::974::TaskManager.Task::(_decref) Task=`b5ca8d46-9286-4a6a-8a4b-3ba8808c5286`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:28:14,975::task::579::TaskManager.Task::(_updateState) Task=`29738e0d-07fa-44b9-8ffc-27b2a8a41dfc`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:28:14,975::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:28:14,975::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:28:14,976::task::1168::TaskManager.Task::(prepare) Task=`29738e0d-07fa-44b9-8ffc-27b2a8a41dfc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:28:14,976::task::579::TaskManager.Task::(_updateState) Task=`29738e0d-07fa-44b9-8ffc-27b2a8a41dfc`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:28:14,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:28:14,976::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:28:14,976::task::974::TaskManager.Task::(_decref) Task=`29738e0d-07fa-44b9-8ffc-27b2a8a41dfc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:15,670::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:28:15,670::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:28:15,670::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288248::DEBUG::2014-01-16 17:28:15,809::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288248::DEBUG::2014-01-16 17:28:15,810::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.33', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.29', 'elapsedTime': '746', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:16,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:28:16,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:28:16,672::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:28:16,672::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:16,757::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:28:17,450::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:28:17,467::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000264534 s, 1.4 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:28:17,573::task::579::TaskManager.Task::(_updateState) Task=`6fe8d679-7cfe-43b2-8b31-87bf7333986f`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:28:17,573::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:28:17,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:28:17,574::task::1168::TaskManager.Task::(prepare) Task=`6fe8d679-7cfe-43b2-8b31-87bf7333986f`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:28:17,574::task::579::TaskManager.Task::(_updateState) Task=`6fe8d679-7cfe-43b2-8b31-87bf7333986f`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:28:17,574::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:28:17,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:28:17,574::task::974::TaskManager.Task::(_decref) Task=`6fe8d679-7cfe-43b2-8b31-87bf7333986f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:17,673::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:28:18,113::task::579::TaskManager.Task::(_updateState) Task=`9400d55e-ef0e-44ab-a93e-48c86e890178`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:28:18,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:28:18,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:28:18,114::task::1168::TaskManager.Task::(prepare) Task=`9400d55e-ef0e-44ab-a93e-48c86e890178`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:28:18,114::task::579::TaskManager.Task::(_updateState) Task=`9400d55e-ef0e-44ab-a93e-48c86e890178`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:28:18,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:28:18,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:28:18,115::task::974::TaskManager.Task::(_decref) Task=`9400d55e-ef0e-44ab-a93e-48c86e890178`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:18,674::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:28:18,675::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:18,759::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:18,759::task::579::TaskManager.Task::(_updateState) Task=`816b710c-8f23-4f47-b19e-44bf199a9f71`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:28:18,760::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:28:18,760::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:28:18,760::task::1168::TaskManager.Task::(prepare) Task=`816b710c-8f23-4f47-b19e-44bf199a9f71`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:28:18,760::task::579::TaskManager.Task::(_updateState) Task=`816b710c-8f23-4f47-b19e-44bf199a9f71`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:28:18,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:28:18,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:28:18,761::task::974::TaskManager.Task::(_decref) Task=`816b710c-8f23-4f47-b19e-44bf199a9f71`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:28:18,762::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:28:18,762::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:28:18,764::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:18,765::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:18,766::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288250::DEBUG::2014-01-16 17:28:18,909::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288250::DEBUG::2014-01-16 17:28:18,910::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.33', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.39', 'elapsedTime': '749', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:19,676::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:28:19,842::task::579::TaskManager.Task::(_updateState) Task=`f314634d-c12d-4628-9b8e-848a6496c271`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:28:19,843::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:28:19,843::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:28:19,843::task::1168::TaskManager.Task::(prepare) Task=`f314634d-c12d-4628-9b8e-848a6496c271`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:28:19,843::task::579::TaskManager.Task::(_updateState) Task=`f314634d-c12d-4628-9b8e-848a6496c271`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:28:19,843::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:28:19,844::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:28:19,844::task::974::TaskManager.Task::(_decref) Task=`f314634d-c12d-4628-9b8e-848a6496c271`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:28:19,894::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:28:19,912::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000289851 s, 14.1 MB/s\n'; <rc> = 0 >Thread-84402::DEBUG::2014-01-16 17:28:20,128::task::579::TaskManager.Task::(_updateState) Task=`b8c60983-8480-43b5-9494-2fa1f0d498d9`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:28:20,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:28:20,129::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:28:20,129::task::1168::TaskManager.Task::(prepare) Task=`b8c60983-8480-43b5-9494-2fa1f0d498d9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:28:20,129::task::579::TaskManager.Task::(_updateState) Task=`b8c60983-8480-43b5-9494-2fa1f0d498d9`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:28:20,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:28:20,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:28:20,130::task::974::TaskManager.Task::(_decref) Task=`b8c60983-8480-43b5-9494-2fa1f0d498d9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:20,677::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:20,767::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 17:28:20,868::task::579::TaskManager.Task::(_updateState) Task=`83ad4966-9d7a-497b-9b10-1865174f3d0b`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:28:20,868::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:28:20,868::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:28:20,869::task::1168::TaskManager.Task::(prepare) Task=`83ad4966-9d7a-497b-9b10-1865174f3d0b`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:28:20,869::task::579::TaskManager.Task::(_updateState) Task=`83ad4966-9d7a-497b-9b10-1865174f3d0b`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:28:20,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:28:20,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:28:20,869::task::974::TaskManager.Task::(_decref) Task=`83ad4966-9d7a-497b-9b10-1865174f3d0b`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:28:20,870::task::579::TaskManager.Task::(_updateState) Task=`ea338f6a-ff15-4683-a2a9-b6e8ec3db8ad`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:28:20,870::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:28:20,871::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:28:20,871::task::1168::TaskManager.Task::(prepare) Task=`ea338f6a-ff15-4683-a2a9-b6e8ec3db8ad`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:28:20,871::task::579::TaskManager.Task::(_updateState) Task=`ea338f6a-ff15-4683-a2a9-b6e8ec3db8ad`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:28:20,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:28:20,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:28:20,871::task::974::TaskManager.Task::(_decref) Task=`ea338f6a-ff15-4683-a2a9-b6e8ec3db8ad`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:28:21,229::task::579::TaskManager.Task::(_updateState) Task=`a20feb24-7bb8-47c8-a32a-026b21557938`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:28:21,229::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:28:21,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:28:21,230::task::1168::TaskManager.Task::(prepare) Task=`a20feb24-7bb8-47c8-a32a-026b21557938`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:28:21,230::task::579::TaskManager.Task::(_updateState) Task=`a20feb24-7bb8-47c8-a32a-026b21557938`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:28:21,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:28:21,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:28:21,230::task::974::TaskManager.Task::(_decref) Task=`a20feb24-7bb8-47c8-a32a-026b21557938`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:21,678::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288252::DEBUG::2014-01-16 17:28:22,007::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288252::DEBUG::2014-01-16 17:28:22,009::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.33', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.49', 'elapsedTime': '753', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:22,679::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:22,768::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:23,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:28:23,686::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:23,770::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:28:24,266::task::579::TaskManager.Task::(_updateState) Task=`6eabe5cd-4084-4500-ae70-b609107c08a4`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:28:24,267::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:28:24,267::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:28:24,267::task::1168::TaskManager.Task::(prepare) Task=`6eabe5cd-4084-4500-ae70-b609107c08a4`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:28:24,267::task::579::TaskManager.Task::(_updateState) Task=`6eabe5cd-4084-4500-ae70-b609107c08a4`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:28:24,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:28:24,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:28:24,268::task::974::TaskManager.Task::(_decref) Task=`6eabe5cd-4084-4500-ae70-b609107c08a4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:24,688::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:28:24,688::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:24,771::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288253::DEBUG::2014-01-16 17:28:25,066::task::579::TaskManager.Task::(_updateState) Task=`3691623a-f5e1-49dc-bbc3-a58f153e9c38`::moving from state init -> state preparing >Thread-288253::INFO::2014-01-16 17:28:25,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288253::INFO::2014-01-16 17:28:25,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264534', 'lastCheck': '7.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289851', 'lastCheck': '5.2', 'valid': True}} >Thread-288253::DEBUG::2014-01-16 17:28:25,066::task::1168::TaskManager.Task::(prepare) Task=`3691623a-f5e1-49dc-bbc3-a58f153e9c38`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000264534', 'lastCheck': '7.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289851', 'lastCheck': '5.2', 'valid': True}} >Thread-288253::DEBUG::2014-01-16 17:28:25,066::task::579::TaskManager.Task::(_updateState) Task=`3691623a-f5e1-49dc-bbc3-a58f153e9c38`::moving from state preparing -> state finished >Thread-288253::DEBUG::2014-01-16 17:28:25,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288253::DEBUG::2014-01-16 17:28:25,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288253::DEBUG::2014-01-16 17:28:25,067::task::974::TaskManager.Task::(_decref) Task=`3691623a-f5e1-49dc-bbc3-a58f153e9c38`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:25,689::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:26,690::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:26,772::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:28:27,064::task::579::TaskManager.Task::(_updateState) Task=`f56d05e4-d76d-4101-b284-00f4d480a21e`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:28:27,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:28:27,065::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:28:27,065::task::1168::TaskManager.Task::(prepare) Task=`f56d05e4-d76d-4101-b284-00f4d480a21e`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:28:27,065::task::579::TaskManager.Task::(_updateState) Task=`f56d05e4-d76d-4101-b284-00f4d480a21e`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:28:27,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:28:27,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:28:27,065::task::974::TaskManager.Task::(_decref) Task=`f56d05e4-d76d-4101-b284-00f4d480a21e`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:28:27,475::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:28:27,491::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000298014 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:27,692::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:28:28,389::task::579::TaskManager.Task::(_updateState) Task=`65750267-937d-403d-87d2-8e1bfc2acc9b`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:28:28,389::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:28:28,390::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:28:28,390::task::1168::TaskManager.Task::(prepare) Task=`65750267-937d-403d-87d2-8e1bfc2acc9b`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:28:28,390::task::579::TaskManager.Task::(_updateState) Task=`65750267-937d-403d-87d2-8e1bfc2acc9b`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:28:28,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:28:28,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:28:28,391::task::974::TaskManager.Task::(_decref) Task=`65750267-937d-403d-87d2-8e1bfc2acc9b`::ref 0 aborting False >Thread-288256::DEBUG::2014-01-16 17:28:28,629::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288256::DEBUG::2014-01-16 17:28:28,631::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.13', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.10', 'elapsedTime': '759', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:28,693::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:28,774::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:28,775::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:29,694::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:28:29,694::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:28:29,694::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:28:29,917::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:28:29,934::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000220027 s, 18.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:30,696::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:28:30,696::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:30,776::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:28:31,587::task::579::TaskManager.Task::(_updateState) Task=`ee35a011-2243-4ae6-b433-2b25a904d63f`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:28:31,588::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:28:31,588::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:28:31,588::task::1168::TaskManager.Task::(prepare) Task=`ee35a011-2243-4ae6-b433-2b25a904d63f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:28:31,588::task::579::TaskManager.Task::(_updateState) Task=`ee35a011-2243-4ae6-b433-2b25a904d63f`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:28:31,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:28:31,588::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:28:31,589::task::974::TaskManager.Task::(_decref) Task=`ee35a011-2243-4ae6-b433-2b25a904d63f`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:28:31,589::task::579::TaskManager.Task::(_updateState) Task=`cf90a8c4-cc56-4db4-a65b-212c47210fb8`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:28:31,589::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:28:31,589::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:28:31,589::task::1168::TaskManager.Task::(prepare) Task=`cf90a8c4-cc56-4db4-a65b-212c47210fb8`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:28:31,590::task::579::TaskManager.Task::(_updateState) Task=`cf90a8c4-cc56-4db4-a65b-212c47210fb8`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:28:31,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:28:31,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:28:31,590::task::974::TaskManager.Task::(_decref) Task=`cf90a8c4-cc56-4db4-a65b-212c47210fb8`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:28:31,590::task::579::TaskManager.Task::(_updateState) Task=`01016c85-6f2b-4e39-b9d1-c6d8a8ae9704`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:28:31,590::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:28:31,591::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:28:31,591::task::1168::TaskManager.Task::(prepare) Task=`01016c85-6f2b-4e39-b9d1-c6d8a8ae9704`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:28:31,591::task::579::TaskManager.Task::(_updateState) Task=`01016c85-6f2b-4e39-b9d1-c6d8a8ae9704`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:28:31,591::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:28:31,591::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:28:31,591::task::974::TaskManager.Task::(_decref) Task=`01016c85-6f2b-4e39-b9d1-c6d8a8ae9704`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:31,697::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:28:31,697::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:28:31,697::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288258::DEBUG::2014-01-16 17:28:31,792::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288258::DEBUG::2014-01-16 17:28:31,793::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.13', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.27', 'elapsedTime': '762', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:32,699::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:28:32,699::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:32,777::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:33,700::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:28:33,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:33,779::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:28:33,780::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:28:33,787::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:34,701::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189046::DEBUG::2014-01-16 17:28:34,759::task::579::TaskManager.Task::(_updateState) Task=`fdb84e8d-a6f5-467c-a204-d8188eb6351d`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:28:34,760::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:28:34,760::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:28:34,760::task::1168::TaskManager.Task::(prepare) Task=`fdb84e8d-a6f5-467c-a204-d8188eb6351d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:28:34,760::task::579::TaskManager.Task::(_updateState) Task=`fdb84e8d-a6f5-467c-a204-d8188eb6351d`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:28:34,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:28:34,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:28:34,761::task::974::TaskManager.Task::(_decref) Task=`fdb84e8d-a6f5-467c-a204-d8188eb6351d`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:28:34,788::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288260::DEBUG::2014-01-16 17:28:34,892::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288260::DEBUG::2014-01-16 17:28:34,894::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.13', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.37', 'elapsedTime': '765', 'vmType': 'kvm', 'cpuSys': '0.67', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:35,702::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:28:35,702::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:36,703::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:28:36,704::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:36,789::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:28:37,499::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:28:37,518::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300418 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:37,704::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:28:37,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:28:37,705::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:28:37,705::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288262::DEBUG::2014-01-16 17:28:37,993::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288262::DEBUG::2014-01-16 17:28:37,995::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.47', 'elapsedTime': '769', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-3175::DEBUG::2014-01-16 17:28:38,701::task::579::TaskManager.Task::(_updateState) Task=`ff259de5-a2ec-4fac-bd18-14b9c78c281b`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:28:38,701::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:28:38,702::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:28:38,702::task::1168::TaskManager.Task::(prepare) Task=`ff259de5-a2ec-4fac-bd18-14b9c78c281b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:28:38,702::task::579::TaskManager.Task::(_updateState) Task=`ff259de5-a2ec-4fac-bd18-14b9c78c281b`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:28:38,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:28:38,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:28:38,703::task::974::TaskManager.Task::(_decref) Task=`ff259de5-a2ec-4fac-bd18-14b9c78c281b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:38,707::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:28:38,707::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:28:38,708::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-59295::DEBUG::2014-01-16 17:28:38,767::task::579::TaskManager.Task::(_updateState) Task=`352c2a86-695e-45e5-ad14-f41f6447d528`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:28:38,767::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:28:38,767::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:28:38,768::task::1168::TaskManager.Task::(prepare) Task=`352c2a86-695e-45e5-ad14-f41f6447d528`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:28:38,768::task::579::TaskManager.Task::(_updateState) Task=`352c2a86-695e-45e5-ad14-f41f6447d528`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:28:38,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:28:38,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:28:38,768::task::974::TaskManager.Task::(_decref) Task=`352c2a86-695e-45e5-ad14-f41f6447d528`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:28:38,795::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:38,796::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:39,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:28:39,709::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:28:39,940::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:28:39,957::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000315553 s, 13.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:40,710::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:28:40,711::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:28:40,711::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:28:40,711::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:40,797::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288263::DEBUG::2014-01-16 17:28:41,055::task::579::TaskManager.Task::(_updateState) Task=`0d21d076-1239-41da-af48-a2d4adb57f2f`::moving from state init -> state preparing >Thread-288263::INFO::2014-01-16 17:28:41,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288263::INFO::2014-01-16 17:28:41,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300418', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315553', 'lastCheck': '1.1', 'valid': True}} >Thread-288263::DEBUG::2014-01-16 17:28:41,056::task::1168::TaskManager.Task::(prepare) Task=`0d21d076-1239-41da-af48-a2d4adb57f2f`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300418', 'lastCheck': '3.5', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315553', 'lastCheck': '1.1', 'valid': True}} >Thread-288263::DEBUG::2014-01-16 17:28:41,056::task::579::TaskManager.Task::(_updateState) Task=`0d21d076-1239-41da-af48-a2d4adb57f2f`::moving from state preparing -> state finished >Thread-288263::DEBUG::2014-01-16 17:28:41,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288263::DEBUG::2014-01-16 17:28:41,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288263::DEBUG::2014-01-16 17:28:41,057::task::974::TaskManager.Task::(_decref) Task=`0d21d076-1239-41da-af48-a2d4adb57f2f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:41,712::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:42,713::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:28:42,714::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:28:42,714::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:28:42,714::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:42,715::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:28:42,716::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:28:42,799::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:43,717::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:43,800::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:28:44,321::task::579::TaskManager.Task::(_updateState) Task=`79e83413-33f1-4db4-bcd8-43f9451221d7`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:28:44,322::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:28:44,322::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:28:44,322::task::1168::TaskManager.Task::(prepare) Task=`79e83413-33f1-4db4-bcd8-43f9451221d7`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:28:44,322::task::579::TaskManager.Task::(_updateState) Task=`79e83413-33f1-4db4-bcd8-43f9451221d7`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:28:44,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:28:44,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:28:44,323::task::974::TaskManager.Task::(_decref) Task=`79e83413-33f1-4db4-bcd8-43f9451221d7`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:28:44,382::task::579::TaskManager.Task::(_updateState) Task=`20076fa7-d19c-4bcc-a0e2-f79d021a9190`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:28:44,382::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:28:44,382::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:28:44,383::task::1168::TaskManager.Task::(prepare) Task=`20076fa7-d19c-4bcc-a0e2-f79d021a9190`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:28:44,383::task::579::TaskManager.Task::(_updateState) Task=`20076fa7-d19c-4bcc-a0e2-f79d021a9190`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:28:44,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:28:44,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:28:44,383::task::974::TaskManager.Task::(_decref) Task=`20076fa7-d19c-4bcc-a0e2-f79d021a9190`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:28:44,383::task::579::TaskManager.Task::(_updateState) Task=`06553f8b-52a3-45ef-bc20-227a36623454`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:28:44,384::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:28:44,384::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:28:44,384::task::1168::TaskManager.Task::(prepare) Task=`06553f8b-52a3-45ef-bc20-227a36623454`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:28:44,384::task::579::TaskManager.Task::(_updateState) Task=`06553f8b-52a3-45ef-bc20-227a36623454`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:28:44,384::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:28:44,384::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:28:44,384::task::974::TaskManager.Task::(_decref) Task=`06553f8b-52a3-45ef-bc20-227a36623454`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:44,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:28:44,718::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:28:44,718::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:44,801::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288266::DEBUG::2014-01-16 17:28:45,070::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288266::DEBUG::2014-01-16 17:28:45,072::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.54', 'elapsedTime': '776', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:45,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:28:45,720::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:28:45,720::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:28:46,032::task::579::TaskManager.Task::(_updateState) Task=`aa8eedb8-7698-49b0-b62a-3300e6ff16f1`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:28:46,032::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:28:46,033::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:28:46,033::task::1168::TaskManager.Task::(prepare) Task=`aa8eedb8-7698-49b0-b62a-3300e6ff16f1`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:28:46,033::task::579::TaskManager.Task::(_updateState) Task=`aa8eedb8-7698-49b0-b62a-3300e6ff16f1`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:28:46,033::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:28:46,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:28:46,033::task::974::TaskManager.Task::(_decref) Task=`aa8eedb8-7698-49b0-b62a-3300e6ff16f1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:46,721::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:28:46,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:28:46,722::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:28:46,722::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:46,802::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:28:47,360::task::579::TaskManager.Task::(_updateState) Task=`e3530602-33bf-4e0f-bc8c-3423255beb22`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:28:47,361::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:28:47,361::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:28:47,361::task::1168::TaskManager.Task::(prepare) Task=`e3530602-33bf-4e0f-bc8c-3423255beb22`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:28:47,361::task::579::TaskManager.Task::(_updateState) Task=`e3530602-33bf-4e0f-bc8c-3423255beb22`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:28:47,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:28:47,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:28:47,362::task::974::TaskManager.Task::(_decref) Task=`e3530602-33bf-4e0f-bc8c-3423255beb22`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:28:47,455::task::579::TaskManager.Task::(_updateState) Task=`eb661920-9f8a-4301-89bd-0d895f5e92ad`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:28:47,455::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:28:47,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:28:47,455::task::1168::TaskManager.Task::(prepare) Task=`eb661920-9f8a-4301-89bd-0d895f5e92ad`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:28:47,456::task::579::TaskManager.Task::(_updateState) Task=`eb661920-9f8a-4301-89bd-0d895f5e92ad`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:28:47,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:28:47,456::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:28:47,456::task::974::TaskManager.Task::(_decref) Task=`eb661920-9f8a-4301-89bd-0d895f5e92ad`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:28:47,475::task::579::TaskManager.Task::(_updateState) Task=`b2fd2384-16a0-4a06-9f73-4102aaed489b`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:28:47,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:28:47,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:28:47,475::task::1168::TaskManager.Task::(prepare) Task=`b2fd2384-16a0-4a06-9f73-4102aaed489b`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:28:47,476::task::579::TaskManager.Task::(_updateState) Task=`b2fd2384-16a0-4a06-9f73-4102aaed489b`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:28:47,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:28:47,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:28:47,476::task::974::TaskManager.Task::(_decref) Task=`b2fd2384-16a0-4a06-9f73-4102aaed489b`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:28:47,525::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:28:47,543::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000277623 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:47,723::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288268::DEBUG::2014-01-16 17:28:48,171::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288268::DEBUG::2014-01-16 17:28:48,173::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.63', 'elapsedTime': '779', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-12152::DEBUG::2014-01-16 17:28:48,250::task::579::TaskManager.Task::(_updateState) Task=`42624fd8-2ac1-44df-bfd3-8a91016903b3`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:28:48,250::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:28:48,250::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:28:48,251::task::1168::TaskManager.Task::(prepare) Task=`42624fd8-2ac1-44df-bfd3-8a91016903b3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:28:48,251::task::579::TaskManager.Task::(_updateState) Task=`42624fd8-2ac1-44df-bfd3-8a91016903b3`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:28:48,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:28:48,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:28:48,251::task::974::TaskManager.Task::(_decref) Task=`42624fd8-2ac1-44df-bfd3-8a91016903b3`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:28:48,265::task::579::TaskManager.Task::(_updateState) Task=`4e5a2d94-989a-412d-a65b-f4f646bc309b`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:28:48,265::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:28:48,265::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:28:48,265::task::1168::TaskManager.Task::(prepare) Task=`4e5a2d94-989a-412d-a65b-f4f646bc309b`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:28:48,266::task::579::TaskManager.Task::(_updateState) Task=`4e5a2d94-989a-412d-a65b-f4f646bc309b`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:28:48,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:28:48,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:28:48,266::task::974::TaskManager.Task::(_decref) Task=`4e5a2d94-989a-412d-a65b-f4f646bc309b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:48,725::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:28:48,725::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:48,804::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:48,806::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:28:48,806::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:28:48,807::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:49,726::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:28:49,963::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:28:49,980::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000263843 s, 15.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:50,727::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:50,809::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288270::DEBUG::2014-01-16 17:28:51,273::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288270::DEBUG::2014-01-16 17:28:51,276::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.19', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.73', 'elapsedTime': '782', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:51,727::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:28:52,542::task::579::TaskManager.Task::(_updateState) Task=`7ef99b37-09d5-45d3-992a-b5cff6f3e8dd`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:28:52,543::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:28:52,543::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:28:52,543::task::1168::TaskManager.Task::(prepare) Task=`7ef99b37-09d5-45d3-992a-b5cff6f3e8dd`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:28:52,543::task::579::TaskManager.Task::(_updateState) Task=`7ef99b37-09d5-45d3-992a-b5cff6f3e8dd`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:28:52,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:28:52,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:28:52,544::task::974::TaskManager.Task::(_decref) Task=`7ef99b37-09d5-45d3-992a-b5cff6f3e8dd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:52,729::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:52,810::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:53,729::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:28:53,730::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:53,811::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288272::DEBUG::2014-01-16 17:28:54,374::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288272::DEBUG::2014-01-16 17:28:54,375::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.52', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.83', 'elapsedTime': '785', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:28:54,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:28:54,731::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:54,813::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:28:55,340::task::579::TaskManager.Task::(_updateState) Task=`16c42708-4c97-4800-9874-fc2deaad4235`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:28:55,340::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:28:55,341::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:28:55,341::task::1168::TaskManager.Task::(prepare) Task=`16c42708-4c97-4800-9874-fc2deaad4235`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:28:55,341::task::579::TaskManager.Task::(_updateState) Task=`16c42708-4c97-4800-9874-fc2deaad4235`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:28:55,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:28:55,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:28:55,342::task::974::TaskManager.Task::(_decref) Task=`16c42708-4c97-4800-9874-fc2deaad4235`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:55,732::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:28:56,571::task::579::TaskManager.Task::(_updateState) Task=`b74fa1b4-08c9-4eb3-ad33-9a72a6aa879f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:28:56,571::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:28:56,571::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:28:56,572::task::1168::TaskManager.Task::(prepare) Task=`b74fa1b4-08c9-4eb3-ad33-9a72a6aa879f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:28:56,572::task::579::TaskManager.Task::(_updateState) Task=`b74fa1b4-08c9-4eb3-ad33-9a72a6aa879f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:28:56,572::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:28:56,572::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:28:56,572::task::974::TaskManager.Task::(_decref) Task=`b74fa1b4-08c9-4eb3-ad33-9a72a6aa879f`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:28:56,572::task::579::TaskManager.Task::(_updateState) Task=`e11ea279-6991-4c45-9a51-858b95da2e07`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:28:56,573::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:28:56,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:28:56,573::task::1168::TaskManager.Task::(prepare) Task=`e11ea279-6991-4c45-9a51-858b95da2e07`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:28:56,573::task::579::TaskManager.Task::(_updateState) Task=`e11ea279-6991-4c45-9a51-858b95da2e07`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:28:56,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:28:56,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:28:56,574::task::974::TaskManager.Task::(_decref) Task=`e11ea279-6991-4c45-9a51-858b95da2e07`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:28:56,574::task::579::TaskManager.Task::(_updateState) Task=`708504d6-c0b4-4573-b28c-2bc2eec0e06f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:28:56,574::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:28:56,574::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:28:56,574::task::1168::TaskManager.Task::(prepare) Task=`708504d6-c0b4-4573-b28c-2bc2eec0e06f`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:28:56,575::task::579::TaskManager.Task::(_updateState) Task=`708504d6-c0b4-4573-b28c-2bc2eec0e06f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:28:56,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:28:56,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:28:56,575::task::974::TaskManager.Task::(_decref) Task=`708504d6-c0b4-4573-b28c-2bc2eec0e06f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:28:56,734::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:56,814::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288273::DEBUG::2014-01-16 17:28:57,431::task::579::TaskManager.Task::(_updateState) Task=`41c04f35-3993-49c5-b4bb-6c789d8a7e5a`::moving from state init -> state preparing >Thread-288273::INFO::2014-01-16 17:28:57,431::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288273::INFO::2014-01-16 17:28:57,431::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277623', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263843', 'lastCheck': '7.4', 'valid': True}} >Thread-288273::DEBUG::2014-01-16 17:28:57,431::task::1168::TaskManager.Task::(prepare) Task=`41c04f35-3993-49c5-b4bb-6c789d8a7e5a`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277623', 'lastCheck': '9.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263843', 'lastCheck': '7.4', 'valid': True}} >Thread-288273::DEBUG::2014-01-16 17:28:57,431::task::579::TaskManager.Task::(_updateState) Task=`41c04f35-3993-49c5-b4bb-6c789d8a7e5a`::moving from state preparing -> state finished >Thread-288273::DEBUG::2014-01-16 17:28:57,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288273::DEBUG::2014-01-16 17:28:57,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288273::DEBUG::2014-01-16 17:28:57,432::task::974::TaskManager.Task::(_decref) Task=`41c04f35-3993-49c5-b4bb-6c789d8a7e5a`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:28:57,550::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:28:57,567::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290325 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:28:57,734::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:28:58,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:28:58,816::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:28:58,817::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:28:59,738::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:28:59,738::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:28:59,738::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:28:59,986::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:29:00,002::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000340912 s, 12.0 MB/s\n'; <rc> = 0 >Thread-221160::DEBUG::2014-01-16 17:29:00,687::task::579::TaskManager.Task::(_updateState) Task=`b7451ec7-1fd1-427e-abc1-0c3c194cbfe3`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:29:00,687::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:29:00,688::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:29:00,688::task::1168::TaskManager.Task::(prepare) Task=`b7451ec7-1fd1-427e-abc1-0c3c194cbfe3`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:29:00,688::task::579::TaskManager.Task::(_updateState) Task=`b7451ec7-1fd1-427e-abc1-0c3c194cbfe3`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:29:00,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:29:00,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:29:00,689::task::974::TaskManager.Task::(_decref) Task=`b7451ec7-1fd1-427e-abc1-0c3c194cbfe3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:00,739::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:29:00,739::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:00,818::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288276::DEBUG::2014-01-16 17:29:01,008::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288276::DEBUG::2014-01-16 17:29:01,009::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.52', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.41', 'elapsedTime': '792', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:29:01,740::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:29:01,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:29:01,741::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:02,742::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:29:02,742::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:02,820::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:03,743::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:29:03,743::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:03,822::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:29:03,822::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:29:03,824::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288278::DEBUG::2014-01-16 17:29:04,109::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288278::DEBUG::2014-01-16 17:29:04,111::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.52', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.51', 'elapsedTime': '795', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:29:04,745::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:04,825::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:05,746::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:29:05,746::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:06,747::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:29:06,748::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:06,827::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288280::DEBUG::2014-01-16 17:29:07,223::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288280::DEBUG::2014-01-16 17:29:07,224::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.52', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.62', 'elapsedTime': '798', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]} >Thread-84941::DEBUG::2014-01-16 17:29:07,422::task::579::TaskManager.Task::(_updateState) Task=`304d0a8c-b9c8-409b-a1a4-b7fce2b3c656`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:29:07,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:29:07,423::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:29:07,423::task::1168::TaskManager.Task::(prepare) Task=`304d0a8c-b9c8-409b-a1a4-b7fce2b3c656`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:29:07,423::task::579::TaskManager.Task::(_updateState) Task=`304d0a8c-b9c8-409b-a1a4-b7fce2b3c656`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:29:07,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:29:07,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:29:07,423::task::974::TaskManager.Task::(_decref) Task=`304d0a8c-b9c8-409b-a1a4-b7fce2b3c656`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:29:07,574::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:29:07,591::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000277252 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:07,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:29:07,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:29:07,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:29:07,749::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:08,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:29:08,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:29:08,751::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:08,828::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:08,829::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251782::DEBUG::2014-01-16 17:29:09,590::task::579::TaskManager.Task::(_updateState) Task=`59f70057-4dec-48ac-97b3-e34a2bcb1573`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:29:09,590::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-53040::DEBUG::2014-01-16 17:29:09,591::task::579::TaskManager.Task::(_updateState) Task=`b7068844-6d35-4dcf-8ae8-96247aaebf05`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:29:09,591::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:29:09,592::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::INFO::2014-01-16 17:29:09,593::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:29:09,593::task::1168::TaskManager.Task::(prepare) Task=`b7068844-6d35-4dcf-8ae8-96247aaebf05`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-251782::DEBUG::2014-01-16 17:29:09,593::task::1168::TaskManager.Task::(prepare) Task=`59f70057-4dec-48ac-97b3-e34a2bcb1573`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-53040::DEBUG::2014-01-16 17:29:09,593::task::579::TaskManager.Task::(_updateState) Task=`b7068844-6d35-4dcf-8ae8-96247aaebf05`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:29:09,593::task::579::TaskManager.Task::(_updateState) Task=`59f70057-4dec-48ac-97b3-e34a2bcb1573`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:29:09,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:29:09,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:29:09,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:29:09,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:29:09,594::task::974::TaskManager.Task::(_decref) Task=`b7068844-6d35-4dcf-8ae8-96247aaebf05`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:29:09,595::task::974::TaskManager.Task::(_decref) Task=`59f70057-4dec-48ac-97b3-e34a2bcb1573`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:09,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:29:09,752::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:29:10,009::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:29:10,030::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000235169 s, 17.4 MB/s\n'; <rc> = 0 >Thread-288282::DEBUG::2014-01-16 17:29:10,324::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288282::DEBUG::2014-01-16 17:29:10,325::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.72', 'elapsedTime': '801', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:29:10,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:29:10,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:29:10,753::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:29:10,753::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:10,830::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:11,755::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:29:11,801::task::579::TaskManager.Task::(_updateState) Task=`cf17d562-788b-448e-bf85-a2eb40be36f2`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:29:11,801::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:29:11,802::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:29:11,802::task::1168::TaskManager.Task::(prepare) Task=`cf17d562-788b-448e-bf85-a2eb40be36f2`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:29:11,802::task::579::TaskManager.Task::(_updateState) Task=`cf17d562-788b-448e-bf85-a2eb40be36f2`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:29:11,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:29:11,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:29:11,803::task::974::TaskManager.Task::(_decref) Task=`cf17d562-788b-448e-bf85-a2eb40be36f2`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:29:11,803::task::579::TaskManager.Task::(_updateState) Task=`e1ab38b9-fd68-435e-a64c-5e26136571c9`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:29:11,803::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:29:11,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:29:11,804::task::1168::TaskManager.Task::(prepare) Task=`e1ab38b9-fd68-435e-a64c-5e26136571c9`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:29:11,804::task::579::TaskManager.Task::(_updateState) Task=`e1ab38b9-fd68-435e-a64c-5e26136571c9`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:29:11,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:29:11,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:29:11,804::task::974::TaskManager.Task::(_decref) Task=`e1ab38b9-fd68-435e-a64c-5e26136571c9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:12,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:29:12,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:29:12,755::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:29:12,756::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:12,756::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:29:12,756::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:29:12,831::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288283::DEBUG::2014-01-16 17:29:13,383::task::579::TaskManager.Task::(_updateState) Task=`8430f15c-1b8c-4c2b-bc0a-7db84f2c535d`::moving from state init -> state preparing >Thread-288283::INFO::2014-01-16 17:29:13,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288283::INFO::2014-01-16 17:29:13,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277252', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235169', 'lastCheck': '3.4', 'valid': True}} >Thread-288283::DEBUG::2014-01-16 17:29:13,384::task::1168::TaskManager.Task::(prepare) Task=`8430f15c-1b8c-4c2b-bc0a-7db84f2c535d`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000277252', 'lastCheck': '5.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000235169', 'lastCheck': '3.4', 'valid': True}} >Thread-288283::DEBUG::2014-01-16 17:29:13,384::task::579::TaskManager.Task::(_updateState) Task=`8430f15c-1b8c-4c2b-bc0a-7db84f2c535d`::moving from state preparing -> state finished >Thread-288283::DEBUG::2014-01-16 17:29:13,384::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288283::DEBUG::2014-01-16 17:29:13,384::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288283::DEBUG::2014-01-16 17:29:13,385::task::974::TaskManager.Task::(_decref) Task=`8430f15c-1b8c-4c2b-bc0a-7db84f2c535d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:13,757::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:13,833::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:29:14,323::task::579::TaskManager.Task::(_updateState) Task=`54921ed5-6606-4207-9063-edd202294000`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:29:14,323::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:29:14,324::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:29:14,324::task::1168::TaskManager.Task::(prepare) Task=`54921ed5-6606-4207-9063-edd202294000`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:29:14,324::task::579::TaskManager.Task::(_updateState) Task=`54921ed5-6606-4207-9063-edd202294000`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:29:14,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:29:14,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:29:14,324::task::974::TaskManager.Task::(_decref) Task=`54921ed5-6606-4207-9063-edd202294000`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:14,757::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:29:14,758::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:29:14,758::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:14,834::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:29:15,203::task::579::TaskManager.Task::(_updateState) Task=`aebc2c53-f022-4293-8153-05512526f26e`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:29:15,204::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:29:15,204::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:29:15,204::task::1168::TaskManager.Task::(prepare) Task=`aebc2c53-f022-4293-8153-05512526f26e`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:29:15,204::task::579::TaskManager.Task::(_updateState) Task=`aebc2c53-f022-4293-8153-05512526f26e`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:29:15,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:29:15,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:29:15,204::task::974::TaskManager.Task::(_decref) Task=`aebc2c53-f022-4293-8153-05512526f26e`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:29:15,205::task::579::TaskManager.Task::(_updateState) Task=`cb447c9d-625f-4394-af4e-06d1326d9730`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:29:15,205::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:29:15,205::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:29:15,205::task::1168::TaskManager.Task::(prepare) Task=`cb447c9d-625f-4394-af4e-06d1326d9730`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:29:15,205::task::579::TaskManager.Task::(_updateState) Task=`cb447c9d-625f-4394-af4e-06d1326d9730`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:29:15,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:29:15,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:29:15,206::task::974::TaskManager.Task::(_decref) Task=`cb447c9d-625f-4394-af4e-06d1326d9730`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:15,759::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:29:15,759::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:29:15,759::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:16,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:29:16,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:29:16,760::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:29:16,761::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:16,835::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288286::DEBUG::2014-01-16 17:29:16,949::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288286::DEBUG::2014-01-16 17:29:16,950::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.34', 'elapsedTime': '808', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-20::DEBUG::2014-01-16 17:29:17,599::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:29:17,616::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029279 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17177::DEBUG::2014-01-16 17:29:17,725::task::579::TaskManager.Task::(_updateState) Task=`0f531d1d-ac82-40c4-802e-3b1237524873`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:29:17,726::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:29:17,726::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:29:17,726::task::1168::TaskManager.Task::(prepare) Task=`0f531d1d-ac82-40c4-802e-3b1237524873`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:29:17,727::task::579::TaskManager.Task::(_updateState) Task=`0f531d1d-ac82-40c4-802e-3b1237524873`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:29:17,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:29:17,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:29:17,727::task::974::TaskManager.Task::(_decref) Task=`0f531d1d-ac82-40c4-802e-3b1237524873`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:17,762::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-26403::DEBUG::2014-01-16 17:29:18,308::task::579::TaskManager.Task::(_updateState) Task=`5c7e2723-a013-4ff2-b3f1-fef60203ba02`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:29:18,309::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:29:18,309::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:29:18,309::task::1168::TaskManager.Task::(prepare) Task=`5c7e2723-a013-4ff2-b3f1-fef60203ba02`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:29:18,309::task::579::TaskManager.Task::(_updateState) Task=`5c7e2723-a013-4ff2-b3f1-fef60203ba02`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:29:18,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:29:18,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:29:18,310::task::974::TaskManager.Task::(_decref) Task=`5c7e2723-a013-4ff2-b3f1-fef60203ba02`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:18,764::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:29:18,764::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:18,837::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:18,837::task::579::TaskManager.Task::(_updateState) Task=`a8c26873-a808-489f-bc91-de8694681da5`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:29:18,838::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:29:18,838::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:29:18,838::task::1168::TaskManager.Task::(prepare) Task=`a8c26873-a808-489f-bc91-de8694681da5`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:29:18,838::task::579::TaskManager.Task::(_updateState) Task=`a8c26873-a808-489f-bc91-de8694681da5`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:29:18,838::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:29:18,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:29:18,839::task::974::TaskManager.Task::(_decref) Task=`a8c26873-a808-489f-bc91-de8694681da5`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:29:18,840::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:29:18,840::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:29:18,841::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:18,843::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:18,844::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:19,765::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:29:20,012::task::579::TaskManager.Task::(_updateState) Task=`94823525-8213-4211-a0a1-d651dedc68ba`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:29:20,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:29:20,012::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:29:20,013::task::1168::TaskManager.Task::(prepare) Task=`94823525-8213-4211-a0a1-d651dedc68ba`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:29:20,013::task::579::TaskManager.Task::(_updateState) Task=`94823525-8213-4211-a0a1-d651dedc68ba`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:29:20,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:29:20,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:29:20,013::task::974::TaskManager.Task::(_decref) Task=`94823525-8213-4211-a0a1-d651dedc68ba`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:29:20,035::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:29:20,055::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000201828 s, 20.3 MB/s\n'; <rc> = 0 >Thread-288288::DEBUG::2014-01-16 17:29:20,073::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288288::DEBUG::2014-01-16 17:29:20,076::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.46', 'elapsedTime': '811', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]} >Thread-84402::DEBUG::2014-01-16 17:29:20,312::task::579::TaskManager.Task::(_updateState) Task=`f69a729c-3049-4ea8-b693-52909a5a5ef6`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:29:20,312::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:29:20,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:29:20,313::task::1168::TaskManager.Task::(prepare) Task=`f69a729c-3049-4ea8-b693-52909a5a5ef6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:29:20,313::task::579::TaskManager.Task::(_updateState) Task=`f69a729c-3049-4ea8-b693-52909a5a5ef6`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:29:20,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:29:20,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:29:20,314::task::974::TaskManager.Task::(_decref) Task=`f69a729c-3049-4ea8-b693-52909a5a5ef6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:20,766::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:20,845::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 17:29:21,090::task::579::TaskManager.Task::(_updateState) Task=`4a41f096-7b0e-4651-a7d6-c4706a06b3be`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:29:21,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:29:21,090::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:29:21,091::task::1168::TaskManager.Task::(prepare) Task=`4a41f096-7b0e-4651-a7d6-c4706a06b3be`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:29:21,091::task::579::TaskManager.Task::(_updateState) Task=`4a41f096-7b0e-4651-a7d6-c4706a06b3be`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:29:21,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:29:21,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:29:21,091::task::974::TaskManager.Task::(_decref) Task=`4a41f096-7b0e-4651-a7d6-c4706a06b3be`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:29:21,091::task::579::TaskManager.Task::(_updateState) Task=`73fe3c50-5654-4c4b-b50b-10b7865400d2`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:29:21,092::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:29:21,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:29:21,092::task::1168::TaskManager.Task::(prepare) Task=`73fe3c50-5654-4c4b-b50b-10b7865400d2`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:29:21,092::task::579::TaskManager.Task::(_updateState) Task=`73fe3c50-5654-4c4b-b50b-10b7865400d2`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:29:21,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:29:21,093::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:29:21,093::task::974::TaskManager.Task::(_decref) Task=`73fe3c50-5654-4c4b-b50b-10b7865400d2`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:29:21,309::task::579::TaskManager.Task::(_updateState) Task=`59b33840-90ce-4a2a-80dd-287fa8cb3fc4`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:29:21,309::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:29:21,309::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:29:21,309::task::1168::TaskManager.Task::(prepare) Task=`59b33840-90ce-4a2a-80dd-287fa8cb3fc4`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:29:21,309::task::579::TaskManager.Task::(_updateState) Task=`59b33840-90ce-4a2a-80dd-287fa8cb3fc4`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:29:21,310::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:29:21,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:29:21,310::task::974::TaskManager.Task::(_decref) Task=`59b33840-90ce-4a2a-80dd-287fa8cb3fc4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:21,767::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:22,768::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:22,846::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288290::DEBUG::2014-01-16 17:29:23,174::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmGetStats with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} >Thread-288290::DEBUG::2014-01-16 17:29:23,175::BindingXMLRPC::991::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '28001', 'displayIp': '0', 'displayPort': u'5928', 'session': 'Unknown', 'displaySecurePort': u'5929', 'timeOffset': '0', 'hash': '9076429301963216307', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {}, 'vmId': '10bce6b5-ab25-452b-a8e2-24309deae8b7', 'displayType': 'qxl', 'cpuUser': '-0.24', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '42949672960', 'writeLatency': '0', 'imageID': '2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '42949672960', 'writeRate': '0.00'}, u'hdd': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.56', 'elapsedTime': '814', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-01-16 17:29:23,769::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:29:23,769::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:23,848::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:29:24,444::task::579::TaskManager.Task::(_updateState) Task=`aaea47f1-89a6-4f6b-aae9-121def24a36f`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:29:24,444::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:29:24,444::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:29:24,444::task::1168::TaskManager.Task::(prepare) Task=`aaea47f1-89a6-4f6b-aae9-121def24a36f`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:29:24,444::task::579::TaskManager.Task::(_updateState) Task=`aaea47f1-89a6-4f6b-aae9-121def24a36f`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:29:24,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:29:24,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:29:24,445::task::974::TaskManager.Task::(_decref) Task=`aaea47f1-89a6-4f6b-aae9-121def24a36f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:24,771::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:29:24,771::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:24,849::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:25,772::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:26,774::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:26,850::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:29:27,236::task::579::TaskManager.Task::(_updateState) Task=`3ab343dd-e61c-4255-93b3-b3d18a92c655`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:29:27,236::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:29:27,236::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:29:27,237::task::1168::TaskManager.Task::(prepare) Task=`3ab343dd-e61c-4255-93b3-b3d18a92c655`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:29:27,237::task::579::TaskManager.Task::(_updateState) Task=`3ab343dd-e61c-4255-93b3-b3d18a92c655`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:29:27,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:29:27,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:29:27,237::task::974::TaskManager.Task::(_decref) Task=`3ab343dd-e61c-4255-93b3-b3d18a92c655`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:29:27,624::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:29:27,640::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000429984 s, 849 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:27,775::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:29:28,463::task::579::TaskManager.Task::(_updateState) Task=`9355b904-3d5a-42f9-9e07-c0dd89086b78`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:29:28,463::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:29:28,464::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:29:28,464::task::1168::TaskManager.Task::(prepare) Task=`9355b904-3d5a-42f9-9e07-c0dd89086b78`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:29:28,464::task::579::TaskManager.Task::(_updateState) Task=`9355b904-3d5a-42f9-9e07-c0dd89086b78`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:29:28,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:29:28,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:29:28,465::task::974::TaskManager.Task::(_decref) Task=`9355b904-3d5a-42f9-9e07-c0dd89086b78`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:28,777::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:28,852::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:28,853::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288292::DEBUG::2014-01-16 17:29:29,425::task::579::TaskManager.Task::(_updateState) Task=`50f51516-ab59-4b76-b091-75a768609466`::moving from state init -> state preparing >Thread-288292::INFO::2014-01-16 17:29:29,425::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288292::INFO::2014-01-16 17:29:29,426::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429984', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201828', 'lastCheck': '9.4', 'valid': True}} >Thread-288292::DEBUG::2014-01-16 17:29:29,426::task::1168::TaskManager.Task::(prepare) Task=`50f51516-ab59-4b76-b091-75a768609466`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429984', 'lastCheck': '1.8', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000201828', 'lastCheck': '9.4', 'valid': True}} >Thread-288292::DEBUG::2014-01-16 17:29:29,426::task::579::TaskManager.Task::(_updateState) Task=`50f51516-ab59-4b76-b091-75a768609466`::moving from state preparing -> state finished >Thread-288292::DEBUG::2014-01-16 17:29:29,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288292::DEBUG::2014-01-16 17:29:29,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288292::DEBUG::2014-01-16 17:29:29,426::task::974::TaskManager.Task::(_decref) Task=`50f51516-ab59-4b76-b091-75a768609466`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:29,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:29:29,778::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:29:29,778::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:29:30,062::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:29:30,082::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00024735 s, 16.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:30,780::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:29:30,780::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:30,854::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:31,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:29:31,781::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:29:31,781::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:29:32,178::task::579::TaskManager.Task::(_updateState) Task=`5bac0197-2e8d-49a2-9eb6-4523bcf8babf`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:29:32,179::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:29:32,179::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:29:32,179::task::1168::TaskManager.Task::(prepare) Task=`5bac0197-2e8d-49a2-9eb6-4523bcf8babf`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:29:32,179::task::579::TaskManager.Task::(_updateState) Task=`5bac0197-2e8d-49a2-9eb6-4523bcf8babf`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:29:32,180::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:29:32,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:29:32,180::task::974::TaskManager.Task::(_decref) Task=`5bac0197-2e8d-49a2-9eb6-4523bcf8babf`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:29:32,180::task::579::TaskManager.Task::(_updateState) Task=`6cb96bf1-1739-4019-bf05-d185a4170c03`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:29:32,180::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:29:32,180::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:29:32,181::task::1168::TaskManager.Task::(prepare) Task=`6cb96bf1-1739-4019-bf05-d185a4170c03`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:29:32,181::task::579::TaskManager.Task::(_updateState) Task=`6cb96bf1-1739-4019-bf05-d185a4170c03`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:29:32,181::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:29:32,181::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:29:32,181::task::974::TaskManager.Task::(_decref) Task=`6cb96bf1-1739-4019-bf05-d185a4170c03`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:29:32,181::task::579::TaskManager.Task::(_updateState) Task=`e881656e-4531-4211-b577-e92d49cb3c56`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:29:32,181::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:29:32,182::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:29:32,182::task::1168::TaskManager.Task::(prepare) Task=`e881656e-4531-4211-b577-e92d49cb3c56`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:29:32,182::task::579::TaskManager.Task::(_updateState) Task=`e881656e-4531-4211-b577-e92d49cb3c56`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:29:32,182::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:29:32,182::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:29:32,182::task::974::TaskManager.Task::(_decref) Task=`e881656e-4531-4211-b577-e92d49cb3c56`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:32,782::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:29:32,783::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:32,855::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:33,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:29:33,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:33,858::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:29:33,858::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:29:33,859::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:34,784::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:34,860::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:29:34,927::task::579::TaskManager.Task::(_updateState) Task=`81940bd3-bafd-4022-b514-7cc08d280c90`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:29:34,927::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:29:34,928::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:29:34,928::task::1168::TaskManager.Task::(prepare) Task=`81940bd3-bafd-4022-b514-7cc08d280c90`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:29:34,928::task::579::TaskManager.Task::(_updateState) Task=`81940bd3-bafd-4022-b514-7cc08d280c90`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:29:34,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:29:34,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:29:34,929::task::974::TaskManager.Task::(_decref) Task=`81940bd3-bafd-4022-b514-7cc08d280c90`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:35,786::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:29:35,786::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:36,787::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:29:36,787::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:36,861::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:29:37,648::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:29:37,664::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000243585 s, 1.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:37,789::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:29:37,789::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:29:37,789::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:29:37,790::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:38,790::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:29:38,791::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:29:38,791::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:38,864::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:29:38,865::task::579::TaskManager.Task::(_updateState) Task=`461790b0-21e5-4ba5-81c5-a2abae18ecfd`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:29:38,867::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:29:38,867::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189817::DEBUG::2014-01-16 17:29:38,868::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:29:38,868::task::1168::TaskManager.Task::(prepare) Task=`461790b0-21e5-4ba5-81c5-a2abae18ecfd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:29:38,870::task::579::TaskManager.Task::(_updateState) Task=`461790b0-21e5-4ba5-81c5-a2abae18ecfd`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:29:38,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:29:38,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:29:38,870::task::974::TaskManager.Task::(_decref) Task=`461790b0-21e5-4ba5-81c5-a2abae18ecfd`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:29:38,941::task::579::TaskManager.Task::(_updateState) Task=`e0f1e400-dd78-431d-9ace-8d1617b96d0c`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:29:38,942::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:29:38,942::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:29:38,942::task::1168::TaskManager.Task::(prepare) Task=`e0f1e400-dd78-431d-9ace-8d1617b96d0c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:29:38,942::task::579::TaskManager.Task::(_updateState) Task=`e0f1e400-dd78-431d-9ace-8d1617b96d0c`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:29:38,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:29:38,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:29:38,943::task::974::TaskManager.Task::(_decref) Task=`e0f1e400-dd78-431d-9ace-8d1617b96d0c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:39,791::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:29:39,792::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:29:40,089::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:29:40,106::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000350567 s, 11.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:40,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:29:40,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:29:40,793::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:29:40,793::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:40,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:41,795::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:42,795::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:29:42,796::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:29:42,796::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:29:42,796::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:42,796::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:29:42,797::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:29:42,872::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:43,798::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:43,874::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:29:44,507::task::579::TaskManager.Task::(_updateState) Task=`b11006ca-7de2-4d11-a3e0-c6366664c22c`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:29:44,508::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:29:44,508::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:29:44,508::task::1168::TaskManager.Task::(prepare) Task=`b11006ca-7de2-4d11-a3e0-c6366664c22c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:29:44,508::task::579::TaskManager.Task::(_updateState) Task=`b11006ca-7de2-4d11-a3e0-c6366664c22c`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:29:44,509::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:29:44,509::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:29:44,509::task::974::TaskManager.Task::(_decref) Task=`b11006ca-7de2-4d11-a3e0-c6366664c22c`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:29:44,762::task::579::TaskManager.Task::(_updateState) Task=`a4ec4dd6-f61a-4201-ab21-6046804c068e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:29:44,762::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:29:44,762::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:29:44,763::task::1168::TaskManager.Task::(prepare) Task=`a4ec4dd6-f61a-4201-ab21-6046804c068e`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:29:44,763::task::579::TaskManager.Task::(_updateState) Task=`a4ec4dd6-f61a-4201-ab21-6046804c068e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:29:44,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:29:44,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:29:44,763::task::974::TaskManager.Task::(_decref) Task=`a4ec4dd6-f61a-4201-ab21-6046804c068e`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:29:44,763::task::579::TaskManager.Task::(_updateState) Task=`e666ad10-4790-4812-875e-635b2c0cc944`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:29:44,763::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:29:44,764::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:29:44,764::task::1168::TaskManager.Task::(prepare) Task=`e666ad10-4790-4812-875e-635b2c0cc944`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:29:44,764::task::579::TaskManager.Task::(_updateState) Task=`e666ad10-4790-4812-875e-635b2c0cc944`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:29:44,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:29:44,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:29:44,764::task::974::TaskManager.Task::(_decref) Task=`e666ad10-4790-4812-875e-635b2c0cc944`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:44,799::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:29:44,799::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:29:44,799::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:44,875::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:45,800::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:29:45,800::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:29:45,801::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:29:46,196::task::579::TaskManager.Task::(_updateState) Task=`2c4ccd38-5ae0-4e89-9e3f-bfd33a3154a7`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:29:46,197::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:29:46,197::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:29:46,197::task::1168::TaskManager.Task::(prepare) Task=`2c4ccd38-5ae0-4e89-9e3f-bfd33a3154a7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:29:46,197::task::579::TaskManager.Task::(_updateState) Task=`2c4ccd38-5ae0-4e89-9e3f-bfd33a3154a7`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:29:46,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:29:46,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:29:46,198::task::974::TaskManager.Task::(_decref) Task=`2c4ccd38-5ae0-4e89-9e3f-bfd33a3154a7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:46,801::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:29:46,802::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:29:46,802::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:29:46,802::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:46,876::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:29:47,532::task::579::TaskManager.Task::(_updateState) Task=`df9c79c9-6ce6-4755-953b-bacb8c10bf7a`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:29:47,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:29:47,532::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:29:47,532::task::1168::TaskManager.Task::(prepare) Task=`df9c79c9-6ce6-4755-953b-bacb8c10bf7a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:29:47,532::task::579::TaskManager.Task::(_updateState) Task=`df9c79c9-6ce6-4755-953b-bacb8c10bf7a`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:29:47,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:29:47,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:29:47,533::task::974::TaskManager.Task::(_decref) Task=`df9c79c9-6ce6-4755-953b-bacb8c10bf7a`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:29:47,629::task::579::TaskManager.Task::(_updateState) Task=`90fcd78d-b41e-44c7-af79-6c4843cb2ad4`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:29:47,629::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:29:47,630::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:29:47,630::task::1168::TaskManager.Task::(prepare) Task=`90fcd78d-b41e-44c7-af79-6c4843cb2ad4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:29:47,630::task::579::TaskManager.Task::(_updateState) Task=`90fcd78d-b41e-44c7-af79-6c4843cb2ad4`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:29:47,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:29:47,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:29:47,630::task::974::TaskManager.Task::(_decref) Task=`90fcd78d-b41e-44c7-af79-6c4843cb2ad4`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:29:47,650::task::579::TaskManager.Task::(_updateState) Task=`1c546209-5afe-408d-ba48-1b51f3af299c`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:29:47,651::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:29:47,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:29:47,651::task::1168::TaskManager.Task::(prepare) Task=`1c546209-5afe-408d-ba48-1b51f3af299c`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:29:47,651::task::579::TaskManager.Task::(_updateState) Task=`1c546209-5afe-408d-ba48-1b51f3af299c`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:29:47,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:29:47,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:29:47,652::task::974::TaskManager.Task::(_decref) Task=`1c546209-5afe-408d-ba48-1b51f3af299c`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:29:47,673::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:29:47,690::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000282284 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:47,803::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:29:48,421::task::579::TaskManager.Task::(_updateState) Task=`2b4ae7e0-adfc-4583-9620-c7c59bce3489`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:29:48,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:29:48,422::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:29:48,422::task::1168::TaskManager.Task::(prepare) Task=`2b4ae7e0-adfc-4583-9620-c7c59bce3489`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:29:48,422::task::579::TaskManager.Task::(_updateState) Task=`2b4ae7e0-adfc-4583-9620-c7c59bce3489`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:29:48,422::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:29:48,422::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:29:48,423::task::974::TaskManager.Task::(_decref) Task=`2b4ae7e0-adfc-4583-9620-c7c59bce3489`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:29:48,427::task::579::TaskManager.Task::(_updateState) Task=`b96bd2cf-0a7e-40ee-b034-abec9b7fd53c`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:29:48,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:29:48,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:29:48,428::task::1168::TaskManager.Task::(prepare) Task=`b96bd2cf-0a7e-40ee-b034-abec9b7fd53c`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:29:48,428::task::579::TaskManager.Task::(_updateState) Task=`b96bd2cf-0a7e-40ee-b034-abec9b7fd53c`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:29:48,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:29:48,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:29:48,429::task::974::TaskManager.Task::(_decref) Task=`b96bd2cf-0a7e-40ee-b034-abec9b7fd53c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:48,804::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:29:48,804::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:48,878::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:48,880::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:29:48,880::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:29:48,882::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:49,805::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:29:50,113::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:29:50,132::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000182676 s, 22.4 MB/s\n'; <rc> = 0 >Thread-288298::DEBUG::2014-01-16 17:29:50,595::task::579::TaskManager.Task::(_updateState) Task=`541e9b5f-83e8-4d4f-bd62-7c2334442467`::moving from state init -> state preparing >Thread-288298::INFO::2014-01-16 17:29:50,595::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288298::INFO::2014-01-16 17:29:50,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282284', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000182676', 'lastCheck': '0.5', 'valid': True}} >Thread-288298::DEBUG::2014-01-16 17:29:50,596::task::1168::TaskManager.Task::(prepare) Task=`541e9b5f-83e8-4d4f-bd62-7c2334442467`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000282284', 'lastCheck': '2.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000182676', 'lastCheck': '0.5', 'valid': True}} >Thread-288298::DEBUG::2014-01-16 17:29:50,596::task::579::TaskManager.Task::(_updateState) Task=`541e9b5f-83e8-4d4f-bd62-7c2334442467`::moving from state preparing -> state finished >Thread-288298::DEBUG::2014-01-16 17:29:50,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288298::DEBUG::2014-01-16 17:29:50,596::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288298::DEBUG::2014-01-16 17:29:50,596::task::974::TaskManager.Task::(_decref) Task=`541e9b5f-83e8-4d4f-bd62-7c2334442467`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:50,807::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:50,883::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:51,808::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:29:52,626::task::579::TaskManager.Task::(_updateState) Task=`5bb90d03-649f-4adc-932d-df495bf43c0b`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:29:52,626::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:29:52,627::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:29:52,627::task::1168::TaskManager.Task::(prepare) Task=`5bb90d03-649f-4adc-932d-df495bf43c0b`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:29:52,627::task::579::TaskManager.Task::(_updateState) Task=`5bb90d03-649f-4adc-932d-df495bf43c0b`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:29:52,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:29:52,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:29:52,628::task::974::TaskManager.Task::(_decref) Task=`5bb90d03-649f-4adc-932d-df495bf43c0b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:52,809::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:52,884::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:53,810::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:29:53,810::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:53,885::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:54,811::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:29:54,811::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:54,887::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:29:55,508::task::579::TaskManager.Task::(_updateState) Task=`5e8cd22a-233d-47aa-8cf3-58d2a5b66b14`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:29:55,508::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:29:55,509::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:29:55,509::task::1168::TaskManager.Task::(prepare) Task=`5e8cd22a-233d-47aa-8cf3-58d2a5b66b14`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:29:55,509::task::579::TaskManager.Task::(_updateState) Task=`5e8cd22a-233d-47aa-8cf3-58d2a5b66b14`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:29:55,509::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:29:55,509::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:29:55,509::task::974::TaskManager.Task::(_decref) Task=`5e8cd22a-233d-47aa-8cf3-58d2a5b66b14`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:29:55,812::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:56,814::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-84377::DEBUG::2014-01-16 17:29:56,858::task::579::TaskManager.Task::(_updateState) Task=`903ad883-a299-4efa-a1c3-dd10825d2859`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:29:56,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:29:56,859::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:29:56,859::task::1168::TaskManager.Task::(prepare) Task=`903ad883-a299-4efa-a1c3-dd10825d2859`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:29:56,859::task::579::TaskManager.Task::(_updateState) Task=`903ad883-a299-4efa-a1c3-dd10825d2859`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:29:56,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:29:56,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:29:56,860::task::974::TaskManager.Task::(_decref) Task=`903ad883-a299-4efa-a1c3-dd10825d2859`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:29:56,860::task::579::TaskManager.Task::(_updateState) Task=`7be6dffa-4bdd-401d-aa7a-200ddaacbf97`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:29:56,860::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:29:56,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:29:56,860::task::1168::TaskManager.Task::(prepare) Task=`7be6dffa-4bdd-401d-aa7a-200ddaacbf97`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:29:56,860::task::579::TaskManager.Task::(_updateState) Task=`7be6dffa-4bdd-401d-aa7a-200ddaacbf97`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:29:56,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:29:56,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:29:56,861::task::974::TaskManager.Task::(_decref) Task=`7be6dffa-4bdd-401d-aa7a-200ddaacbf97`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:29:56,861::task::579::TaskManager.Task::(_updateState) Task=`245f7cb7-b9cf-4926-9494-4809515596fc`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:29:56,861::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:29:56,861::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:29:56,862::task::1168::TaskManager.Task::(prepare) Task=`245f7cb7-b9cf-4926-9494-4809515596fc`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:29:56,862::task::579::TaskManager.Task::(_updateState) Task=`245f7cb7-b9cf-4926-9494-4809515596fc`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:29:56,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:29:56,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:29:56,862::task::974::TaskManager.Task::(_decref) Task=`245f7cb7-b9cf-4926-9494-4809515596fc`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:29:56,889::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:29:57,698::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:29:57,715::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000270588 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:29:57,815::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:29:58,816::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:29:58,892::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:29:58,893::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:29:59,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:29:59,817::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:29:59,817::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:30:00,138::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:00,155::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000195704 s, 20.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:00,819::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:30:00,819::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-221160::DEBUG::2014-01-16 17:30:00,870::task::579::TaskManager.Task::(_updateState) Task=`48236fcd-ba68-46a0-b432-d35feea73e67`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:30:00,871::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:30:00,871::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:30:00,871::task::1168::TaskManager.Task::(prepare) Task=`48236fcd-ba68-46a0-b432-d35feea73e67`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:30:00,871::task::579::TaskManager.Task::(_updateState) Task=`48236fcd-ba68-46a0-b432-d35feea73e67`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:30:00,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:30:00,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:30:00,872::task::974::TaskManager.Task::(_decref) Task=`48236fcd-ba68-46a0-b432-d35feea73e67`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:30:00,895::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:01,821::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:30:01,822::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:30:01,822::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:02,823::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:30:02,824::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:02,896::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:03,825::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:30:03,825::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:03,898::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:30:03,898::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:30:03,901::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:04,826::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:04,903::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:05,827::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:30:05,828::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288304::DEBUG::2014-01-16 17:30:06,334::task::579::TaskManager.Task::(_updateState) Task=`8c36406b-2b9f-463d-ba09-cf70acf3d969`::moving from state init -> state preparing >Thread-288304::INFO::2014-01-16 17:30:06,335::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288304::INFO::2014-01-16 17:30:06,335::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270588', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000195704', 'lastCheck': '6.2', 'valid': True}} >Thread-288304::DEBUG::2014-01-16 17:30:06,335::task::1168::TaskManager.Task::(prepare) Task=`8c36406b-2b9f-463d-ba09-cf70acf3d969`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270588', 'lastCheck': '8.6', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000195704', 'lastCheck': '6.2', 'valid': True}} >Thread-288304::DEBUG::2014-01-16 17:30:06,335::task::579::TaskManager.Task::(_updateState) Task=`8c36406b-2b9f-463d-ba09-cf70acf3d969`::moving from state preparing -> state finished >Thread-288304::DEBUG::2014-01-16 17:30:06,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288304::DEBUG::2014-01-16 17:30:06,335::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288304::DEBUG::2014-01-16 17:30:06,336::task::974::TaskManager.Task::(_decref) Task=`8c36406b-2b9f-463d-ba09-cf70acf3d969`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:06,829::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:30:06,829::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:06,904::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:30:07,606::task::579::TaskManager.Task::(_updateState) Task=`8fcfb0e2-dc39-4e1b-b188-0b64d6f7a369`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:30:07,606::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:30:07,607::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:30:07,607::task::1168::TaskManager.Task::(prepare) Task=`8fcfb0e2-dc39-4e1b-b188-0b64d6f7a369`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:30:07,607::task::579::TaskManager.Task::(_updateState) Task=`8fcfb0e2-dc39-4e1b-b188-0b64d6f7a369`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:30:07,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:30:07,608::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:30:07,608::task::974::TaskManager.Task::(_decref) Task=`8fcfb0e2-dc39-4e1b-b188-0b64d6f7a369`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:30:07,725::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:30:07,743::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000298862 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:07,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:30:07,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:30:07,830::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:30:07,831::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:08,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:30:08,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:30:08,833::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:08,905::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:08,906::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-53040::DEBUG::2014-01-16 17:30:09,680::task::579::TaskManager.Task::(_updateState) Task=`833f1bf1-4ff7-4c3e-85ab-ba7878fce592`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:30:09,681::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:30:09,681::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:30:09,681::task::1168::TaskManager.Task::(prepare) Task=`833f1bf1-4ff7-4c3e-85ab-ba7878fce592`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:30:09,681::task::579::TaskManager.Task::(_updateState) Task=`833f1bf1-4ff7-4c3e-85ab-ba7878fce592`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:30:09,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:30:09,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:30:09,682::task::974::TaskManager.Task::(_decref) Task=`833f1bf1-4ff7-4c3e-85ab-ba7878fce592`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:30:09,698::task::579::TaskManager.Task::(_updateState) Task=`ffd457d2-6b0a-4a3a-8ac9-34dcf1faab90`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:30:09,698::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:30:09,699::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:30:09,699::task::1168::TaskManager.Task::(prepare) Task=`ffd457d2-6b0a-4a3a-8ac9-34dcf1faab90`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:30:09,699::task::579::TaskManager.Task::(_updateState) Task=`ffd457d2-6b0a-4a3a-8ac9-34dcf1faab90`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:30:09,699::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:30:09,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:30:09,700::task::974::TaskManager.Task::(_decref) Task=`ffd457d2-6b0a-4a3a-8ac9-34dcf1faab90`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:09,834::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:30:09,834::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:30:10,161::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:10,179::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000172931 s, 23.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:10,835::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:30:10,836::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:30:10,836::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:30:10,836::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:10,908::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:11,837::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:30:11,907::task::579::TaskManager.Task::(_updateState) Task=`fed87b4d-5f39-4cbd-a494-24eeb33f9adc`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:30:11,907::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:30:11,908::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:30:11,908::task::1168::TaskManager.Task::(prepare) Task=`fed87b4d-5f39-4cbd-a494-24eeb33f9adc`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:30:11,909::task::579::TaskManager.Task::(_updateState) Task=`fed87b4d-5f39-4cbd-a494-24eeb33f9adc`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:30:11,909::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:30:11,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:30:11,909::task::974::TaskManager.Task::(_decref) Task=`fed87b4d-5f39-4cbd-a494-24eeb33f9adc`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:30:11,909::task::579::TaskManager.Task::(_updateState) Task=`9fcfe968-4e95-4225-bdc3-a30b2c8a2099`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:30:11,910::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:30:11,910::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:30:11,910::task::1168::TaskManager.Task::(prepare) Task=`9fcfe968-4e95-4225-bdc3-a30b2c8a2099`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:30:11,910::task::579::TaskManager.Task::(_updateState) Task=`9fcfe968-4e95-4225-bdc3-a30b2c8a2099`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:30:11,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:30:11,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:30:11,911::task::974::TaskManager.Task::(_decref) Task=`9fcfe968-4e95-4225-bdc3-a30b2c8a2099`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:12,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:30:12,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:30:12,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:30:12,839::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:12,840::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:30:12,841::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:30:12,909::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:13,842::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:13,910::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:30:14,497::task::579::TaskManager.Task::(_updateState) Task=`61edce26-0324-4b8a-a7a8-e2451b7b330b`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:30:14,497::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:30:14,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:30:14,498::task::1168::TaskManager.Task::(prepare) Task=`61edce26-0324-4b8a-a7a8-e2451b7b330b`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:30:14,498::task::579::TaskManager.Task::(_updateState) Task=`61edce26-0324-4b8a-a7a8-e2451b7b330b`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:30:14,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:30:14,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:30:14,498::task::974::TaskManager.Task::(_decref) Task=`61edce26-0324-4b8a-a7a8-e2451b7b330b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:14,844::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:30:14,844::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:30:14,844::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:14,911::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:30:15,440::task::579::TaskManager.Task::(_updateState) Task=`bfb1053d-f2f0-4ff5-9c80-839ff816f536`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:30:15,441::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:30:15,441::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:30:15,441::task::1168::TaskManager.Task::(prepare) Task=`bfb1053d-f2f0-4ff5-9c80-839ff816f536`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:30:15,441::task::579::TaskManager.Task::(_updateState) Task=`bfb1053d-f2f0-4ff5-9c80-839ff816f536`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:30:15,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:30:15,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:30:15,442::task::974::TaskManager.Task::(_decref) Task=`bfb1053d-f2f0-4ff5-9c80-839ff816f536`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:30:15,442::task::579::TaskManager.Task::(_updateState) Task=`cb5cbe3c-a764-409c-a89c-ad3cc4e11dde`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:30:15,442::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:30:15,442::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:30:15,443::task::1168::TaskManager.Task::(prepare) Task=`cb5cbe3c-a764-409c-a89c-ad3cc4e11dde`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:30:15,443::task::579::TaskManager.Task::(_updateState) Task=`cb5cbe3c-a764-409c-a89c-ad3cc4e11dde`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:30:15,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:30:15,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:30:15,443::task::974::TaskManager.Task::(_decref) Task=`cb5cbe3c-a764-409c-a89c-ad3cc4e11dde`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:15,845::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:30:15,845::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:30:15,846::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:16,847::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:30:16,847::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:30:16,848::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:30:16,848::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:16,913::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:30:17,751::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:30:17,768::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000321711 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:17,849::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:30:17,868::task::579::TaskManager.Task::(_updateState) Task=`d4ac99b6-686e-4915-98cf-556823098505`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:30:17,868::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:30:17,869::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:30:17,869::task::1168::TaskManager.Task::(prepare) Task=`d4ac99b6-686e-4915-98cf-556823098505`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:30:17,869::task::579::TaskManager.Task::(_updateState) Task=`d4ac99b6-686e-4915-98cf-556823098505`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:30:17,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:30:17,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:30:17,870::task::974::TaskManager.Task::(_decref) Task=`d4ac99b6-686e-4915-98cf-556823098505`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:30:18,483::task::579::TaskManager.Task::(_updateState) Task=`c2ed24e4-863b-4523-a436-e475c6b99118`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:30:18,483::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:30:18,484::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:30:18,484::task::1168::TaskManager.Task::(prepare) Task=`c2ed24e4-863b-4523-a436-e475c6b99118`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:30:18,485::task::579::TaskManager.Task::(_updateState) Task=`c2ed24e4-863b-4523-a436-e475c6b99118`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:30:18,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:30:18,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:30:18,486::task::974::TaskManager.Task::(_decref) Task=`c2ed24e4-863b-4523-a436-e475c6b99118`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:18,850::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:30:18,850::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:18,914::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:18,915::task::579::TaskManager.Task::(_updateState) Task=`eaefe04f-3299-4ec8-8b7b-0e498a74ac6c`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:30:18,916::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:30:18,916::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:30:18,916::task::1168::TaskManager.Task::(prepare) Task=`eaefe04f-3299-4ec8-8b7b-0e498a74ac6c`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:30:18,916::task::579::TaskManager.Task::(_updateState) Task=`eaefe04f-3299-4ec8-8b7b-0e498a74ac6c`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:30:18,917::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:30:18,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:30:18,917::task::974::TaskManager.Task::(_decref) Task=`eaefe04f-3299-4ec8-8b7b-0e498a74ac6c`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:30:18,918::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:30:18,919::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:30:18,926::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:18,927::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:18,928::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:19,851::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:30:20,183::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:30:20,183::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::ERROR::2014-01-16 17:30:20,183::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a08b74fb-7dbf-4ef4-8caa-0e53c0056a02 >Thread-22::DEBUG::2014-01-16 17:30:20,184::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:30:20,186::blockSD::326::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:20,201::blockSD::326::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000338957 s, 6.0 MB/s\n'; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:30:20,202::misc::289::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000338957 s, 6.0 MB/s'], size: 2048 >Thread-22::DEBUG::2014-01-16 17:30:20,202::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-22::WARNING::2014-01-16 17:30:20,202::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-22::DEBUG::2014-01-16 17:30:20,202::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-22::DEBUG::2014-01-16 17:30:20,203::lvm::516::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:30:20,203::lvm::518::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:30:20,203::lvm::526::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:30:20,203::lvm::538::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:30:20,204::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-01-16 17:30:20,205::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142c5091ec295001000000|/dev/mapper/3600c0ff000142c50b5ec295001000000|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::DEBUG::2014-01-16 17:30:20,220::task::579::TaskManager.Task::(_updateState) Task=`a791489a-0a23-413c-a375-db8e8a32608f`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:30:20,221::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-22::DEBUG::2014-01-16 17:30:20,430::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:30:20,438::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-01-16 17:30:20,438::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=7TBxit-VDMl-ivH9-gIOC-Rf7c-Pfd5-obDgsy', 'LOCKPOLICY=', 'DESCRIPTION=lab-storage-02', 'LEASERETRIES=3', u'PV0=pv:3600c0ff000142dcd3fe3525001000000,uuid:NjQwKw-Iyuq-EOEf-lOLH-cHnv-Hezb-t9K3MV,pestart:0,pecount:22331,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'SDUUID=a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', 'CLASS=Data', 'TYPE=FCP', 'LEASETIMESEC=60', 'IOOPTIMEOUTSEC=10', 'POOL_DESCRIPTION=Default', 'MASTER_VERSION=2', 'ROLE=Master', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'VERSION=3', u'POOL_DOMAINS=29d81073-5ffb-4757-82bc-d07e3b443a03:Active,a08b74fb-7dbf-4ef4-8caa-0e53c0056a02:Active', 'POOL_SPM_ID=4', '_SHA_CKSUM=61e825974738a140ec9004187bf5be0b8be8a39c', 'POOL_SPM_LVER=1'] >Thread-22::INFO::2014-01-16 17:30:20,439::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_imageNS already registered >Thread-22::INFO::2014-01-16 17:30:20,439::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_volumeNS already registered >Thread-22::INFO::2014-01-16 17:30:20,439::blockSD::446::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a08b74fb-7dbf-4ef4-8caa-0e53c0056a02_lvmActivationNS already registered >Thread-22::DEBUG::2014-01-16 17:30:20,440::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3600c0ff000142dcd3fe3525001000000|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a08b74fb-7dbf-4ef4-8caa-0e53c0056a02' (cwd None) >Thread-184546::INFO::2014-01-16 17:30:20,457::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:30:20,457::task::1168::TaskManager.Task::(prepare) Task=`a791489a-0a23-413c-a375-db8e8a32608f`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:30:20,457::task::579::TaskManager.Task::(_updateState) Task=`a791489a-0a23-413c-a375-db8e8a32608f`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:30:20,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:30:20,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:30:20,458::task::974::TaskManager.Task::(_decref) Task=`a791489a-0a23-413c-a375-db8e8a32608f`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 17:30:20,495::task::579::TaskManager.Task::(_updateState) Task=`8572efae-b894-4716-b47d-760eb4c7ab49`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:30:20,495::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:30:20,496::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:30:20,496::task::1168::TaskManager.Task::(prepare) Task=`8572efae-b894-4716-b47d-760eb4c7ab49`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:30:20,496::task::579::TaskManager.Task::(_updateState) Task=`8572efae-b894-4716-b47d-760eb4c7ab49`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:30:20,497::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:30:20,497::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:30:20,497::task::974::TaskManager.Task::(_decref) Task=`8572efae-b894-4716-b47d-760eb4c7ab49`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:30:20,599::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-01-16 17:30:20,602::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:20,620::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000218368 s, 18.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:20,852::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:20,930::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-17110::DEBUG::2014-01-16 17:30:21,324::task::579::TaskManager.Task::(_updateState) Task=`67d81976-7d41-4c9d-9dca-fbc5a5224419`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:30:21,325::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:30:21,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:30:21,325::task::1168::TaskManager.Task::(prepare) Task=`67d81976-7d41-4c9d-9dca-fbc5a5224419`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:30:21,326::task::579::TaskManager.Task::(_updateState) Task=`67d81976-7d41-4c9d-9dca-fbc5a5224419`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:30:21,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:30:21,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:30:21,326::task::974::TaskManager.Task::(_decref) Task=`67d81976-7d41-4c9d-9dca-fbc5a5224419`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:30:21,326::task::579::TaskManager.Task::(_updateState) Task=`05e7b93f-bb6b-45c5-9942-7a0206e321a8`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:30:21,327::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:30:21,327::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:30:21,327::task::1168::TaskManager.Task::(prepare) Task=`05e7b93f-bb6b-45c5-9942-7a0206e321a8`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:30:21,327::task::579::TaskManager.Task::(_updateState) Task=`05e7b93f-bb6b-45c5-9942-7a0206e321a8`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:30:21,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:30:21,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:30:21,328::task::974::TaskManager.Task::(_decref) Task=`05e7b93f-bb6b-45c5-9942-7a0206e321a8`::ref 0 aborting False >Thread-131569::DEBUG::2014-01-16 17:30:21,397::task::579::TaskManager.Task::(_updateState) Task=`29629070-42e0-469c-9c52-cf44c96b5258`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:30:21,397::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:30:21,398::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:30:21,398::task::1168::TaskManager.Task::(prepare) Task=`29629070-42e0-469c-9c52-cf44c96b5258`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:30:21,398::task::579::TaskManager.Task::(_updateState) Task=`29629070-42e0-469c-9c52-cf44c96b5258`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:30:21,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:30:21,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:30:21,399::task::974::TaskManager.Task::(_decref) Task=`29629070-42e0-469c-9c52-cf44c96b5258`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:21,853::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288310::DEBUG::2014-01-16 17:30:22,142::task::579::TaskManager.Task::(_updateState) Task=`a5c2e79e-52ac-4e58-9d0a-b556065d7e3b`::moving from state init -> state preparing >Thread-288310::INFO::2014-01-16 17:30:22,142::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288310::INFO::2014-01-16 17:30:22,142::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321711', 'lastCheck': '4.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218368', 'lastCheck': '1.5', 'valid': True}} >Thread-288310::DEBUG::2014-01-16 17:30:22,143::task::1168::TaskManager.Task::(prepare) Task=`a5c2e79e-52ac-4e58-9d0a-b556065d7e3b`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000321711', 'lastCheck': '4.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218368', 'lastCheck': '1.5', 'valid': True}} >Thread-288310::DEBUG::2014-01-16 17:30:22,143::task::579::TaskManager.Task::(_updateState) Task=`a5c2e79e-52ac-4e58-9d0a-b556065d7e3b`::moving from state preparing -> state finished >Thread-288310::DEBUG::2014-01-16 17:30:22,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288310::DEBUG::2014-01-16 17:30:22,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288310::DEBUG::2014-01-16 17:30:22,143::task::974::TaskManager.Task::(_decref) Task=`a5c2e79e-52ac-4e58-9d0a-b556065d7e3b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:22,855::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:22,931::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:23,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:30:23,856::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:23,932::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:30:24,644::task::579::TaskManager.Task::(_updateState) Task=`24087277-e8d6-4b20-bc3d-c913a5ce51c3`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:30:24,645::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:30:24,645::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:30:24,645::task::1168::TaskManager.Task::(prepare) Task=`24087277-e8d6-4b20-bc3d-c913a5ce51c3`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:30:24,645::task::579::TaskManager.Task::(_updateState) Task=`24087277-e8d6-4b20-bc3d-c913a5ce51c3`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:30:24,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:30:24,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:30:24,646::task::974::TaskManager.Task::(_decref) Task=`24087277-e8d6-4b20-bc3d-c913a5ce51c3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:24,857::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:30:24,858::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:24,933::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:25,859::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:26,860::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:26,935::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:30:27,414::task::579::TaskManager.Task::(_updateState) Task=`105f4547-42a0-4d6c-9f76-b8c16f72e300`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:30:27,415::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:30:27,415::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:30:27,415::task::1168::TaskManager.Task::(prepare) Task=`105f4547-42a0-4d6c-9f76-b8c16f72e300`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:30:27,415::task::579::TaskManager.Task::(_updateState) Task=`105f4547-42a0-4d6c-9f76-b8c16f72e300`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:30:27,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:30:27,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:30:27,416::task::974::TaskManager.Task::(_decref) Task=`105f4547-42a0-4d6c-9f76-b8c16f72e300`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:30:27,775::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:30:27,794::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000260146 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:27,862::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-15207::DEBUG::2014-01-16 17:30:28,538::task::579::TaskManager.Task::(_updateState) Task=`864f44d3-6064-4a79-849a-010de89427de`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:30:28,538::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:30:28,539::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:30:28,540::task::1168::TaskManager.Task::(prepare) Task=`864f44d3-6064-4a79-849a-010de89427de`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:30:28,540::task::579::TaskManager.Task::(_updateState) Task=`864f44d3-6064-4a79-849a-010de89427de`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:30:28,540::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:30:28,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:30:28,540::task::974::TaskManager.Task::(_decref) Task=`864f44d3-6064-4a79-849a-010de89427de`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:28,863::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:28,936::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:28,937::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:29,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:30:29,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:30:29,864::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:30:30,626::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:30,644::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000231991 s, 17.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:30,866::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:30:30,866::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:30,939::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:31,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:30:31,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:30:31,867::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-48934::DEBUG::2014-01-16 17:30:32,765::task::579::TaskManager.Task::(_updateState) Task=`ae7c3bd5-1e77-47c2-a664-76a378d460ae`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:30:32,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:30:32,766::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:30:32,767::task::1168::TaskManager.Task::(prepare) Task=`ae7c3bd5-1e77-47c2-a664-76a378d460ae`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:30:32,767::task::579::TaskManager.Task::(_updateState) Task=`ae7c3bd5-1e77-47c2-a664-76a378d460ae`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:30:32,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:30:32,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:30:32,767::task::974::TaskManager.Task::(_decref) Task=`ae7c3bd5-1e77-47c2-a664-76a378d460ae`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:30:32,768::task::579::TaskManager.Task::(_updateState) Task=`363215b5-891e-48bb-b59d-b009af118c12`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:30:32,768::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:30:32,769::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:30:32,769::task::1168::TaskManager.Task::(prepare) Task=`363215b5-891e-48bb-b59d-b009af118c12`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:30:32,769::task::579::TaskManager.Task::(_updateState) Task=`363215b5-891e-48bb-b59d-b009af118c12`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:30:32,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:30:32,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:30:32,770::task::974::TaskManager.Task::(_decref) Task=`363215b5-891e-48bb-b59d-b009af118c12`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:30:32,770::task::579::TaskManager.Task::(_updateState) Task=`0d6514ff-19ed-4b98-ba41-af02c61bb23e`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:30:32,770::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:30:32,771::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:30:32,771::task::1168::TaskManager.Task::(prepare) Task=`0d6514ff-19ed-4b98-ba41-af02c61bb23e`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:30:32,771::task::579::TaskManager.Task::(_updateState) Task=`0d6514ff-19ed-4b98-ba41-af02c61bb23e`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:30:32,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:30:32,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:30:32,771::task::974::TaskManager.Task::(_decref) Task=`0d6514ff-19ed-4b98-ba41-af02c61bb23e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:32,868::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:30:32,868::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:32,940::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:33,869::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:30:33,869::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:33,942::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:30:33,942::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:30:33,945::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:34,871::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:34,946::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:30:35,101::task::579::TaskManager.Task::(_updateState) Task=`50c5e4bd-a895-4edf-84a3-eaf4c16af42a`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:30:35,101::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:30:35,102::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:30:35,102::task::1168::TaskManager.Task::(prepare) Task=`50c5e4bd-a895-4edf-84a3-eaf4c16af42a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:30:35,102::task::579::TaskManager.Task::(_updateState) Task=`50c5e4bd-a895-4edf-84a3-eaf4c16af42a`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:30:35,102::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:30:35,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:30:35,102::task::974::TaskManager.Task::(_decref) Task=`50c5e4bd-a895-4edf-84a3-eaf4c16af42a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:35,872::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:30:35,872::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:36,873::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:30:36,873::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:36,948::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:30:37,801::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:30:37,819::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000253413 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:37,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:30:37,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:30:37,875::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:30:37,875::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288316::DEBUG::2014-01-16 17:30:37,952::task::579::TaskManager.Task::(_updateState) Task=`aa2f6f7b-3093-4c68-aa4f-a18db6eb6430`::moving from state init -> state preparing >Thread-288316::INFO::2014-01-16 17:30:37,952::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288316::INFO::2014-01-16 17:30:37,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253413', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231991', 'lastCheck': '7.3', 'valid': True}} >Thread-288316::DEBUG::2014-01-16 17:30:37,952::task::1168::TaskManager.Task::(prepare) Task=`aa2f6f7b-3093-4c68-aa4f-a18db6eb6430`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000253413', 'lastCheck': '0.1', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231991', 'lastCheck': '7.3', 'valid': True}} >Thread-288316::DEBUG::2014-01-16 17:30:37,953::task::579::TaskManager.Task::(_updateState) Task=`aa2f6f7b-3093-4c68-aa4f-a18db6eb6430`::moving from state preparing -> state finished >Thread-288316::DEBUG::2014-01-16 17:30:37,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288316::DEBUG::2014-01-16 17:30:37,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288316::DEBUG::2014-01-16 17:30:37,953::task::974::TaskManager.Task::(_decref) Task=`aa2f6f7b-3093-4c68-aa4f-a18db6eb6430`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:38,876::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:30:38,877::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:30:38,877::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:38,949::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:38,950::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:30:39,038::task::579::TaskManager.Task::(_updateState) Task=`593a6101-c2bf-4f2f-9f02-ea728ef27e5d`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:30:39,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:30:39,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:30:39,039::task::1168::TaskManager.Task::(prepare) Task=`593a6101-c2bf-4f2f-9f02-ea728ef27e5d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:30:39,039::task::579::TaskManager.Task::(_updateState) Task=`593a6101-c2bf-4f2f-9f02-ea728ef27e5d`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:30:39,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:30:39,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:30:39,039::task::974::TaskManager.Task::(_decref) Task=`593a6101-c2bf-4f2f-9f02-ea728ef27e5d`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:30:39,123::task::579::TaskManager.Task::(_updateState) Task=`ec94c971-3691-4fe2-9743-9d2addaeb608`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:30:39,123::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:30:39,124::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:30:39,124::task::1168::TaskManager.Task::(prepare) Task=`ec94c971-3691-4fe2-9743-9d2addaeb608`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:30:39,124::task::579::TaskManager.Task::(_updateState) Task=`ec94c971-3691-4fe2-9743-9d2addaeb608`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:30:39,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:30:39,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:30:39,125::task::974::TaskManager.Task::(_decref) Task=`ec94c971-3691-4fe2-9743-9d2addaeb608`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:39,878::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:30:39,878::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:30:40,650::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:40,669::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000221588 s, 18.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:40,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:30:40,879::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:30:40,880::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:30:40,880::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:40,952::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:41,881::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:42,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:30:42,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:30:42,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:30:42,882::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:42,883::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:30:42,884::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:30:42,953::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:43,886::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:43,955::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:30:44,689::task::579::TaskManager.Task::(_updateState) Task=`6a47988e-8edf-43fc-a0c1-c7b588a36c73`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:30:44,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:30:44,690::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:30:44,690::task::1168::TaskManager.Task::(prepare) Task=`6a47988e-8edf-43fc-a0c1-c7b588a36c73`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:30:44,690::task::579::TaskManager.Task::(_updateState) Task=`6a47988e-8edf-43fc-a0c1-c7b588a36c73`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:30:44,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:30:44,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:30:44,691::task::974::TaskManager.Task::(_decref) Task=`6a47988e-8edf-43fc-a0c1-c7b588a36c73`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:44,887::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:30:44,887::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:30:44,887::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:44,956::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:30:45,141::task::579::TaskManager.Task::(_updateState) Task=`2956a816-9062-419e-beff-b6d49b2cc60e`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:30:45,141::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:30:45,142::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:30:45,142::task::1168::TaskManager.Task::(prepare) Task=`2956a816-9062-419e-beff-b6d49b2cc60e`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:30:45,142::task::579::TaskManager.Task::(_updateState) Task=`2956a816-9062-419e-beff-b6d49b2cc60e`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:30:45,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:30:45,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:30:45,142::task::974::TaskManager.Task::(_decref) Task=`2956a816-9062-419e-beff-b6d49b2cc60e`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:30:45,143::task::579::TaskManager.Task::(_updateState) Task=`8d2230fb-acd4-4e75-944a-3d129d6f85ed`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:30:45,143::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:30:45,143::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:30:45,143::task::1168::TaskManager.Task::(prepare) Task=`8d2230fb-acd4-4e75-944a-3d129d6f85ed`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:30:45,143::task::579::TaskManager.Task::(_updateState) Task=`8d2230fb-acd4-4e75-944a-3d129d6f85ed`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:30:45,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:30:45,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:30:45,144::task::974::TaskManager.Task::(_decref) Task=`8d2230fb-acd4-4e75-944a-3d129d6f85ed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:45,888::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:30:45,888::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:30:45,889::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:30:46,368::task::579::TaskManager.Task::(_updateState) Task=`2d76af38-beea-4335-9457-2259c7e8b704`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:30:46,368::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:30:46,368::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:30:46,369::task::1168::TaskManager.Task::(prepare) Task=`2d76af38-beea-4335-9457-2259c7e8b704`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:30:46,369::task::579::TaskManager.Task::(_updateState) Task=`2d76af38-beea-4335-9457-2259c7e8b704`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:30:46,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:30:46,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:30:46,369::task::974::TaskManager.Task::(_decref) Task=`2d76af38-beea-4335-9457-2259c7e8b704`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:46,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:30:46,889::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:30:46,890::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:30:46,890::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:46,958::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:30:47,700::task::579::TaskManager.Task::(_updateState) Task=`4f3c5764-e68a-4480-8351-b53f8100c387`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:30:47,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:30:47,700::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:30:47,700::task::1168::TaskManager.Task::(prepare) Task=`4f3c5764-e68a-4480-8351-b53f8100c387`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:30:47,701::task::579::TaskManager.Task::(_updateState) Task=`4f3c5764-e68a-4480-8351-b53f8100c387`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:30:47,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:30:47,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:30:47,701::task::974::TaskManager.Task::(_decref) Task=`4f3c5764-e68a-4480-8351-b53f8100c387`::ref 0 aborting False >Thread-16393::DEBUG::2014-01-16 17:30:47,798::task::579::TaskManager.Task::(_updateState) Task=`93a16312-cda3-4a16-aa0d-79bc2f3e0354`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:30:47,798::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:30:47,799::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:30:47,799::task::1168::TaskManager.Task::(prepare) Task=`93a16312-cda3-4a16-aa0d-79bc2f3e0354`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:30:47,799::task::579::TaskManager.Task::(_updateState) Task=`93a16312-cda3-4a16-aa0d-79bc2f3e0354`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:30:47,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:30:47,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:30:47,799::task::974::TaskManager.Task::(_decref) Task=`93a16312-cda3-4a16-aa0d-79bc2f3e0354`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:30:47,827::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:30:47,845::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000274879 s, 1.3 MB/s\n'; <rc> = 0 >Thread-69607::DEBUG::2014-01-16 17:30:47,851::task::579::TaskManager.Task::(_updateState) Task=`e5bceba8-2638-455b-9659-81c8c678533a`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:30:47,851::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:30:47,852::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:30:47,852::task::1168::TaskManager.Task::(prepare) Task=`e5bceba8-2638-455b-9659-81c8c678533a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:30:47,852::task::579::TaskManager.Task::(_updateState) Task=`e5bceba8-2638-455b-9659-81c8c678533a`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:30:47,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:30:47,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:30:47,852::task::974::TaskManager.Task::(_decref) Task=`e5bceba8-2638-455b-9659-81c8c678533a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:47,891::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-12152::DEBUG::2014-01-16 17:30:48,620::task::579::TaskManager.Task::(_updateState) Task=`9ca381bc-0db5-4483-a8a3-fffd04260f1f`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:30:48,621::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:30:48,621::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:30:48,621::task::1168::TaskManager.Task::(prepare) Task=`9ca381bc-0db5-4483-a8a3-fffd04260f1f`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:30:48,621::task::579::TaskManager.Task::(_updateState) Task=`9ca381bc-0db5-4483-a8a3-fffd04260f1f`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:30:48,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:30:48,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:30:48,622::task::974::TaskManager.Task::(_decref) Task=`9ca381bc-0db5-4483-a8a3-fffd04260f1f`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:30:48,623::task::579::TaskManager.Task::(_updateState) Task=`a65f6a96-ba09-4055-8695-1a9ada6d39dd`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:30:48,624::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:30:48,624::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:30:48,624::task::1168::TaskManager.Task::(prepare) Task=`a65f6a96-ba09-4055-8695-1a9ada6d39dd`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:30:48,625::task::579::TaskManager.Task::(_updateState) Task=`a65f6a96-ba09-4055-8695-1a9ada6d39dd`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:30:48,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:30:48,625::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:30:48,625::task::974::TaskManager.Task::(_decref) Task=`a65f6a96-ba09-4055-8695-1a9ada6d39dd`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:48,892::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:30:48,893::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:48,960::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:48,961::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:30:48,961::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:30:48,963::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:49,893::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:30:50,674::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:30:50,696::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000246575 s, 16.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:50,895::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:50,965::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:51,896::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:30:52,696::task::579::TaskManager.Task::(_updateState) Task=`3460e808-094a-4f6e-8a26-019b17cfb1cc`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:30:52,696::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:30:52,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:30:52,697::task::1168::TaskManager.Task::(prepare) Task=`3460e808-094a-4f6e-8a26-019b17cfb1cc`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:30:52,697::task::579::TaskManager.Task::(_updateState) Task=`3460e808-094a-4f6e-8a26-019b17cfb1cc`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:30:52,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:30:52,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:30:52,697::task::974::TaskManager.Task::(_decref) Task=`3460e808-094a-4f6e-8a26-019b17cfb1cc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:52,897::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:52,966::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:53,898::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:30:53,899::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:53,967::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288322::DEBUG::2014-01-16 17:30:54,178::task::579::TaskManager.Task::(_updateState) Task=`ed0cb0bd-df2f-427d-a6dc-2e2d440c85fe`::moving from state init -> state preparing >Thread-288322::INFO::2014-01-16 17:30:54,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288322::INFO::2014-01-16 17:30:54,179::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274879', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246575', 'lastCheck': '3.5', 'valid': True}} >Thread-288322::DEBUG::2014-01-16 17:30:54,179::task::1168::TaskManager.Task::(prepare) Task=`ed0cb0bd-df2f-427d-a6dc-2e2d440c85fe`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274879', 'lastCheck': '6.3', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246575', 'lastCheck': '3.5', 'valid': True}} >Thread-288322::DEBUG::2014-01-16 17:30:54,179::task::579::TaskManager.Task::(_updateState) Task=`ed0cb0bd-df2f-427d-a6dc-2e2d440c85fe`::moving from state preparing -> state finished >Thread-288322::DEBUG::2014-01-16 17:30:54,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288322::DEBUG::2014-01-16 17:30:54,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288322::DEBUG::2014-01-16 17:30:54,180::task::974::TaskManager.Task::(_decref) Task=`ed0cb0bd-df2f-427d-a6dc-2e2d440c85fe`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:54,900::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:30:54,900::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:54,968::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288324::DEBUG::2014-01-16 17:30:55,125::BindingXMLRPC::984::vds::(wrapper) client [10.34.57.8]::call vmDestroy with ('10bce6b5-ab25-452b-a8e2-24309deae8b7',) {} flowID [7b23f63b] >Thread-288324::INFO::2014-01-16 17:30:55,125::API::324::vds::(destroy) vmContainerLock acquired by vm 10bce6b5-ab25-452b-a8e2-24309deae8b7 >Thread-288324::DEBUG::2014-01-16 17:30:55,125::vm::4477::vm.Vm::(destroy) vmId=`10bce6b5-ab25-452b-a8e2-24309deae8b7`::destroy Called >Thread-288324::ERROR::2014-01-16 17:30:55,146::BindingXMLRPC::1003::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 989, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in vmDestroy > return vm.destroy() > File "/usr/share/vdsm/API.py", line 329, in destroy > res = v.destroy() > File "/usr/share/vdsm/vm.py", line 4485, in destroy > response = self.releaseVm() > File "/usr/share/vdsm/vm.py", line 4417, in releaseVm > supervdsm.getProxy().removeFs(drive.path) > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in removeFs > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 740, in _callmethod > raise convert_to_error(kind, result) >Exception: Cannot remove Fs that does not exists in: /var/run/vdsm/payload >Thread-16244::DEBUG::2014-01-16 17:30:55,703::task::579::TaskManager.Task::(_updateState) Task=`954b3217-216f-4cd0-bef8-b9707d05db0a`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:30:55,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:30:55,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:30:55,704::task::1168::TaskManager.Task::(prepare) Task=`954b3217-216f-4cd0-bef8-b9707d05db0a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:30:55,704::task::579::TaskManager.Task::(_updateState) Task=`954b3217-216f-4cd0-bef8-b9707d05db0a`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:30:55,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:30:55,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:30:55,705::task::974::TaskManager.Task::(_decref) Task=`954b3217-216f-4cd0-bef8-b9707d05db0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:30:55,901::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:56,903::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:56,970::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:30:57,147::task::579::TaskManager.Task::(_updateState) Task=`5b6a5678-2b2c-4c8c-b796-5b8efe14cedc`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:30:57,147::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:30:57,147::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:30:57,147::task::1168::TaskManager.Task::(prepare) Task=`5b6a5678-2b2c-4c8c-b796-5b8efe14cedc`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:30:57,147::task::579::TaskManager.Task::(_updateState) Task=`5b6a5678-2b2c-4c8c-b796-5b8efe14cedc`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:30:57,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:30:57,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:30:57,148::task::974::TaskManager.Task::(_decref) Task=`5b6a5678-2b2c-4c8c-b796-5b8efe14cedc`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:30:57,148::task::579::TaskManager.Task::(_updateState) Task=`9f4ce4b6-da09-42c2-840a-bbe45a335ae0`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:30:57,148::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:30:57,149::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:30:57,149::task::1168::TaskManager.Task::(prepare) Task=`9f4ce4b6-da09-42c2-840a-bbe45a335ae0`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:30:57,149::task::579::TaskManager.Task::(_updateState) Task=`9f4ce4b6-da09-42c2-840a-bbe45a335ae0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:30:57,149::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:30:57,149::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:30:57,149::task::974::TaskManager.Task::(_decref) Task=`9f4ce4b6-da09-42c2-840a-bbe45a335ae0`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:30:57,149::task::579::TaskManager.Task::(_updateState) Task=`3bac8d46-7f7d-43c5-9502-ced0682957a0`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:30:57,150::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:30:57,150::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:30:57,150::task::1168::TaskManager.Task::(prepare) Task=`3bac8d46-7f7d-43c5-9502-ced0682957a0`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:30:57,150::task::579::TaskManager.Task::(_updateState) Task=`3bac8d46-7f7d-43c5-9502-ced0682957a0`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:30:57,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:30:57,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:30:57,151::task::974::TaskManager.Task::(_decref) Task=`3bac8d46-7f7d-43c5-9502-ced0682957a0`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:30:57,852::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:30:57,869::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00026327 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:30:57,904::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:30:58,904::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:30:58,972::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:30:58,973::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:30:59,905::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:30:59,905::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:30:59,906::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:31:00,702::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:31:00,719::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000287234 s, 14.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:00,907::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:31:00,907::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:00,975::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 17:31:01,064::task::579::TaskManager.Task::(_updateState) Task=`dba9e508-9a2c-4408-951d-92aaecbea690`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:31:01,064::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:31:01,065::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:31:01,065::task::1168::TaskManager.Task::(prepare) Task=`dba9e508-9a2c-4408-951d-92aaecbea690`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:31:01,065::task::579::TaskManager.Task::(_updateState) Task=`dba9e508-9a2c-4408-951d-92aaecbea690`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:31:01,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:31:01,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:31:01,066::task::974::TaskManager.Task::(_decref) Task=`dba9e508-9a2c-4408-951d-92aaecbea690`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:01,908::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:31:01,908::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:31:01,908::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:02,910::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:31:02,910::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:02,976::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:03,911::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:31:03,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:03,978::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:31:03,978::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:31:03,980::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:04,912::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:04,981::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:05,913::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:31:05,913::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:06,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:31:06,914::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:06,982::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:31:07,785::task::579::TaskManager.Task::(_updateState) Task=`43260045-0ed7-4b62-a026-5823e423ed42`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:31:07,785::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:31:07,785::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:31:07,785::task::1168::TaskManager.Task::(prepare) Task=`43260045-0ed7-4b62-a026-5823e423ed42`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:31:07,786::task::579::TaskManager.Task::(_updateState) Task=`43260045-0ed7-4b62-a026-5823e423ed42`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:31:07,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:31:07,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:31:07,786::task::974::TaskManager.Task::(_decref) Task=`43260045-0ed7-4b62-a026-5823e423ed42`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:31:07,876::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:31:07,893::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000254828 s, 1.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:07,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:31:07,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:31:07,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:31:07,915::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:08,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:31:08,916::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:31:08,917::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:08,984::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:08,986::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-53040::DEBUG::2014-01-16 17:31:09,748::task::579::TaskManager.Task::(_updateState) Task=`ea943269-d3e9-466e-b72b-ef281e5ed026`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:31:09,748::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:31:09,749::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:31:09,750::task::1168::TaskManager.Task::(prepare) Task=`ea943269-d3e9-466e-b72b-ef281e5ed026`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:31:09,750::task::579::TaskManager.Task::(_updateState) Task=`ea943269-d3e9-466e-b72b-ef281e5ed026`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:31:09,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:31:09,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:31:09,750::task::974::TaskManager.Task::(_decref) Task=`ea943269-d3e9-466e-b72b-ef281e5ed026`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:31:09,764::task::579::TaskManager.Task::(_updateState) Task=`a5265459-d929-443d-9e80-a8862fd064e6`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:31:09,764::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:31:09,765::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:31:09,765::task::1168::TaskManager.Task::(prepare) Task=`a5265459-d929-443d-9e80-a8862fd064e6`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:31:09,765::task::579::TaskManager.Task::(_updateState) Task=`a5265459-d929-443d-9e80-a8862fd064e6`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:31:09,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:31:09,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:31:09,765::task::974::TaskManager.Task::(_decref) Task=`a5265459-d929-443d-9e80-a8862fd064e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:09,918::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:31:09,918::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288329::DEBUG::2014-01-16 17:31:10,254::task::579::TaskManager.Task::(_updateState) Task=`3644c8b9-1936-484a-bc7f-cb8bd42221d2`::moving from state init -> state preparing >Thread-288329::INFO::2014-01-16 17:31:10,254::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288329::INFO::2014-01-16 17:31:10,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254828', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287234', 'lastCheck': '9.5', 'valid': True}} >Thread-288329::DEBUG::2014-01-16 17:31:10,255::task::1168::TaskManager.Task::(prepare) Task=`3644c8b9-1936-484a-bc7f-cb8bd42221d2`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000254828', 'lastCheck': '2.4', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287234', 'lastCheck': '9.5', 'valid': True}} >Thread-288329::DEBUG::2014-01-16 17:31:10,255::task::579::TaskManager.Task::(_updateState) Task=`3644c8b9-1936-484a-bc7f-cb8bd42221d2`::moving from state preparing -> state finished >Thread-288329::DEBUG::2014-01-16 17:31:10,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288329::DEBUG::2014-01-16 17:31:10,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288329::DEBUG::2014-01-16 17:31:10,255::task::974::TaskManager.Task::(_decref) Task=`3644c8b9-1936-484a-bc7f-cb8bd42221d2`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:31:10,724::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:31:10,741::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000320462 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:10,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:31:10,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:31:10,920::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:31:10,920::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:10,987::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:11,922::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-16399::DEBUG::2014-01-16 17:31:11,999::task::579::TaskManager.Task::(_updateState) Task=`c47fd822-ba9b-45c2-a4ae-371f69cb80fa`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:31:11,999::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ec472e43-cc5b-4707-afee-66fd2a0ba4bc', volUUID='f73153e5-6989-4b3b-980d-d9f18526ea40', options=None) >Thread-16399::INFO::2014-01-16 17:31:12,001::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:31:12,001::task::1168::TaskManager.Task::(prepare) Task=`c47fd822-ba9b-45c2-a4ae-371f69cb80fa`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-16399::DEBUG::2014-01-16 17:31:12,001::task::579::TaskManager.Task::(_updateState) Task=`c47fd822-ba9b-45c2-a4ae-371f69cb80fa`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:31:12,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:31:12,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:31:12,002::task::974::TaskManager.Task::(_decref) Task=`c47fd822-ba9b-45c2-a4ae-371f69cb80fa`::ref 0 aborting False >Thread-16399::DEBUG::2014-01-16 17:31:12,002::task::579::TaskManager.Task::(_updateState) Task=`e6298f60-2bb8-4d71-bf6f-f828d0d980ef`::moving from state init -> state preparing >Thread-16399::INFO::2014-01-16 17:31:12,002::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='df799708-cd09-4084-a397-0bc9be26513e', volUUID='bdc558fb-19cc-408d-abd4-712be845d180', options=None) >Thread-16399::INFO::2014-01-16 17:31:12,003::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:31:12,003::task::1168::TaskManager.Task::(prepare) Task=`e6298f60-2bb8-4d71-bf6f-f828d0d980ef`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-16399::DEBUG::2014-01-16 17:31:12,003::task::579::TaskManager.Task::(_updateState) Task=`e6298f60-2bb8-4d71-bf6f-f828d0d980ef`::moving from state preparing -> state finished >Thread-16399::DEBUG::2014-01-16 17:31:12,003::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16399::DEBUG::2014-01-16 17:31:12,003::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16399::DEBUG::2014-01-16 17:31:12,004::task::974::TaskManager.Task::(_decref) Task=`e6298f60-2bb8-4d71-bf6f-f828d0d980ef`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:12,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:31:12,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:31:12,923::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:31:12,923::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:12,923::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:31:12,924::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:31:12,988::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:13,926::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:13,989::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131629::DEBUG::2014-01-16 17:31:14,695::task::579::TaskManager.Task::(_updateState) Task=`884b8f77-c327-4a58-8f39-ee5a35e3c8f7`::moving from state init -> state preparing >Thread-131629::INFO::2014-01-16 17:31:14,696::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9f780f53-18c5-456e-9ade-a29647227fb7', volUUID='472d6930-ae3c-4080-a401-25b52a478c11', options=None) >Thread-131629::INFO::2014-01-16 17:31:14,696::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:31:14,696::task::1168::TaskManager.Task::(prepare) Task=`884b8f77-c327-4a58-8f39-ee5a35e3c8f7`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-131629::DEBUG::2014-01-16 17:31:14,696::task::579::TaskManager.Task::(_updateState) Task=`884b8f77-c327-4a58-8f39-ee5a35e3c8f7`::moving from state preparing -> state finished >Thread-131629::DEBUG::2014-01-16 17:31:14,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131629::DEBUG::2014-01-16 17:31:14,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131629::DEBUG::2014-01-16 17:31:14,697::task::974::TaskManager.Task::(_decref) Task=`884b8f77-c327-4a58-8f39-ee5a35e3c8f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:14,927::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:31:14,927::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:31:14,927::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:14,991::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-256178::DEBUG::2014-01-16 17:31:15,692::task::579::TaskManager.Task::(_updateState) Task=`199a6a39-7b02-4182-aadd-ff281a4d9104`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:31:15,692::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4fec0d38-4c8a-4e83-a039-46a5d865c8a0', volUUID='456c3c64-eedc-4865-9b37-ebba7eeab8c5', options=None) >Thread-256178::INFO::2014-01-16 17:31:15,693::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:31:15,693::task::1168::TaskManager.Task::(prepare) Task=`199a6a39-7b02-4182-aadd-ff281a4d9104`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-256178::DEBUG::2014-01-16 17:31:15,693::task::579::TaskManager.Task::(_updateState) Task=`199a6a39-7b02-4182-aadd-ff281a4d9104`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:31:15,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:31:15,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:31:15,694::task::974::TaskManager.Task::(_decref) Task=`199a6a39-7b02-4182-aadd-ff281a4d9104`::ref 0 aborting False >Thread-256178::DEBUG::2014-01-16 17:31:15,694::task::579::TaskManager.Task::(_updateState) Task=`76bbd633-9089-45dd-8ba2-036b5197b891`::moving from state init -> state preparing >Thread-256178::INFO::2014-01-16 17:31:15,694::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e4308c5d-37d4-4142-828a-912b92cbb9f5', volUUID='91f0e070-7755-4212-b820-fe79e7d04ea8', options=None) >Thread-256178::INFO::2014-01-16 17:31:15,694::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:31:15,694::task::1168::TaskManager.Task::(prepare) Task=`76bbd633-9089-45dd-8ba2-036b5197b891`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-256178::DEBUG::2014-01-16 17:31:15,694::task::579::TaskManager.Task::(_updateState) Task=`76bbd633-9089-45dd-8ba2-036b5197b891`::moving from state preparing -> state finished >Thread-256178::DEBUG::2014-01-16 17:31:15,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-256178::DEBUG::2014-01-16 17:31:15,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-256178::DEBUG::2014-01-16 17:31:15,695::task::974::TaskManager.Task::(_decref) Task=`76bbd633-9089-45dd-8ba2-036b5197b891`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:15,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:31:15,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:31:15,928::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:16,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:31:16,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:31:16,929::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:31:16,929::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:16,992::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:31:17,896::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:31:17,900::fileSD::154::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03 >Thread-20::DEBUG::2014-01-16 17:31:17,901::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-20::DEBUG::2014-01-16 17:31:17,906::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=ISODomain', 'IOOPTIMEOUTSEC=1', 'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=b3088fcc-d291-11e1-933a-0015c5f4698c', 'REMOTE_PATH=lab-rhevm.gsslab.brq.redhat.com:/export/isos', 'ROLE=Regular', 'SDUUID=29d81073-5ffb-4757-82bc-d07e3b443a03', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=77bb0330e780d81b7b0d5c8bbe39a165518d8f07'] >Thread-20::DEBUG::2014-01-16 17:31:17,907::fileSD::572::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-20::INFO::2014-01-16 17:31:17,908::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_imageNS already registered >Thread-20::INFO::2014-01-16 17:31:17,908::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 29d81073-5ffb-4757-82bc-d07e3b443a03_volumeNS already registered >Thread-20::DEBUG::2014-01-16 17:31:17,913::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-20::DEBUG::2014-01-16 17:31:17,929::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000300426 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:17,931::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-17177::DEBUG::2014-01-16 17:31:18,016::task::579::TaskManager.Task::(_updateState) Task=`b9a6dcfa-4f51-48f9-8b78-60cbc7c48bcb`::moving from state init -> state preparing >Thread-17177::INFO::2014-01-16 17:31:18,017::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='af94d55b-f5b1-49b2-8eac-c84df56b0c29', volUUID='3213e289-fa35-4a0b-a48d-b74461570e9e', options=None) >Thread-17177::INFO::2014-01-16 17:31:18,017::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:31:18,017::task::1168::TaskManager.Task::(prepare) Task=`b9a6dcfa-4f51-48f9-8b78-60cbc7c48bcb`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-17177::DEBUG::2014-01-16 17:31:18,018::task::579::TaskManager.Task::(_updateState) Task=`b9a6dcfa-4f51-48f9-8b78-60cbc7c48bcb`::moving from state preparing -> state finished >Thread-17177::DEBUG::2014-01-16 17:31:18,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17177::DEBUG::2014-01-16 17:31:18,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17177::DEBUG::2014-01-16 17:31:18,018::task::974::TaskManager.Task::(_decref) Task=`b9a6dcfa-4f51-48f9-8b78-60cbc7c48bcb`::ref 0 aborting False >Thread-26403::DEBUG::2014-01-16 17:31:18,675::task::579::TaskManager.Task::(_updateState) Task=`8997ac77-51a5-4e49-a4de-b1f794891809`::moving from state init -> state preparing >Thread-26403::INFO::2014-01-16 17:31:18,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='698f79f0-989b-45d8-8539-93b0a839eb3f', volUUID='3eb29cec-90f8-4cc9-a61d-c81ada8c9dc3', options=None) >Thread-26403::INFO::2014-01-16 17:31:18,676::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:31:18,676::task::1168::TaskManager.Task::(prepare) Task=`8997ac77-51a5-4e49-a4de-b1f794891809`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-26403::DEBUG::2014-01-16 17:31:18,676::task::579::TaskManager.Task::(_updateState) Task=`8997ac77-51a5-4e49-a4de-b1f794891809`::moving from state preparing -> state finished >Thread-26403::DEBUG::2014-01-16 17:31:18,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26403::DEBUG::2014-01-16 17:31:18,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26403::DEBUG::2014-01-16 17:31:18,677::task::974::TaskManager.Task::(_decref) Task=`8997ac77-51a5-4e49-a4de-b1f794891809`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:18,932::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:31:18,933::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:18,994::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:18,994::task::579::TaskManager.Task::(_updateState) Task=`8d8d0127-8546-497b-94a9-a6190e00956a`::moving from state init -> state preparing >Thread-189817::INFO::2014-01-16 17:31:18,994::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a86ad21c-ac6b-4390-ae91-beaefae04d3c', volUUID='8a975cf1-be02-4f07-aee9-e9288d826082', options=None) >Thread-189817::INFO::2014-01-16 17:31:18,995::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:31:18,995::task::1168::TaskManager.Task::(prepare) Task=`8d8d0127-8546-497b-94a9-a6190e00956a`::finished: {'truesize': '16642998272', 'apparentsize': '16642998272'} >Thread-189817::DEBUG::2014-01-16 17:31:18,995::task::579::TaskManager.Task::(_updateState) Task=`8d8d0127-8546-497b-94a9-a6190e00956a`::moving from state preparing -> state finished >Thread-189817::DEBUG::2014-01-16 17:31:18,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189817::DEBUG::2014-01-16 17:31:18,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189817::DEBUG::2014-01-16 17:31:18,995::task::974::TaskManager.Task::(_decref) Task=`8d8d0127-8546-497b-94a9-a6190e00956a`::ref 0 aborting False >Thread-189817::DEBUG::2014-01-16 17:31:18,997::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:31:18,997::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:31:18,999::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:19,001::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:19,002::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:19,934::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-184546::DEBUG::2014-01-16 17:31:20,684::task::579::TaskManager.Task::(_updateState) Task=`1a6f369d-ddc0-460b-8e77-f801d8e1cc78`::moving from state init -> state preparing >Thread-184546::INFO::2014-01-16 17:31:20,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='5d31c891-9dd4-49bb-ace8-9c4130c101f8', volUUID='49bbee15-4ba7-4900-bf28-c43841cddd1b', options=None) >Thread-184546::INFO::2014-01-16 17:31:20,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:31:20,685::task::1168::TaskManager.Task::(prepare) Task=`1a6f369d-ddc0-460b-8e77-f801d8e1cc78`::finished: {'truesize': '15032385536', 'apparentsize': '15032385536'} >Thread-184546::DEBUG::2014-01-16 17:31:20,685::task::579::TaskManager.Task::(_updateState) Task=`1a6f369d-ddc0-460b-8e77-f801d8e1cc78`::moving from state preparing -> state finished >Thread-184546::DEBUG::2014-01-16 17:31:20,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184546::DEBUG::2014-01-16 17:31:20,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184546::DEBUG::2014-01-16 17:31:20,685::task::974::TaskManager.Task::(_decref) Task=`1a6f369d-ddc0-460b-8e77-f801d8e1cc78`::ref 0 aborting False >Thread-84402::DEBUG::2014-01-16 17:31:20,710::task::579::TaskManager.Task::(_updateState) Task=`373826df-dfa4-4c7f-b1b1-1a994783a907`::moving from state init -> state preparing >Thread-84402::INFO::2014-01-16 17:31:20,710::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='47759fa1-3f07-4a3b-8af6-f5c2af94b06b', volUUID='568a7c8b-e639-4ee5-aa66-41352aa20623', options=None) >Thread-84402::INFO::2014-01-16 17:31:20,711::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:31:20,711::task::1168::TaskManager.Task::(prepare) Task=`373826df-dfa4-4c7f-b1b1-1a994783a907`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84402::DEBUG::2014-01-16 17:31:20,711::task::579::TaskManager.Task::(_updateState) Task=`373826df-dfa4-4c7f-b1b1-1a994783a907`::moving from state preparing -> state finished >Thread-84402::DEBUG::2014-01-16 17:31:20,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84402::DEBUG::2014-01-16 17:31:20,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84402::DEBUG::2014-01-16 17:31:20,712::task::974::TaskManager.Task::(_decref) Task=`373826df-dfa4-4c7f-b1b1-1a994783a907`::ref 0 aborting False >Thread-22::DEBUG::2014-01-16 17:31:20,747::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:31:20,765::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000278998 s, 14.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:20,935::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:21,003::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-131569::DEBUG::2014-01-16 17:31:21,474::task::579::TaskManager.Task::(_updateState) Task=`474e5cd4-ba31-4b77-b235-f059765c34a0`::moving from state init -> state preparing >Thread-131569::INFO::2014-01-16 17:31:21,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='83ad0a41-c6f8-408f-8e1f-e655c44f9f10', volUUID='992acc7b-7426-4e89-8c4a-b88b5d3901a6', options=None) >Thread-131569::INFO::2014-01-16 17:31:21,475::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:31:21,475::task::1168::TaskManager.Task::(prepare) Task=`474e5cd4-ba31-4b77-b235-f059765c34a0`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-131569::DEBUG::2014-01-16 17:31:21,475::task::579::TaskManager.Task::(_updateState) Task=`474e5cd4-ba31-4b77-b235-f059765c34a0`::moving from state preparing -> state finished >Thread-131569::DEBUG::2014-01-16 17:31:21,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131569::DEBUG::2014-01-16 17:31:21,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131569::DEBUG::2014-01-16 17:31:21,476::task::974::TaskManager.Task::(_decref) Task=`474e5cd4-ba31-4b77-b235-f059765c34a0`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:31:21,548::task::579::TaskManager.Task::(_updateState) Task=`9057f56d-9d86-4281-a56f-978054f22f7f`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:31:21,548::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='4be04cfe-c7c3-432f-9ec1-217b48fe30c4', volUUID='aa846b8d-4d56-4dea-a0b7-1aed8d3e0272', options=None) >Thread-17110::INFO::2014-01-16 17:31:21,549::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:31:21,549::task::1168::TaskManager.Task::(prepare) Task=`9057f56d-9d86-4281-a56f-978054f22f7f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-17110::DEBUG::2014-01-16 17:31:21,549::task::579::TaskManager.Task::(_updateState) Task=`9057f56d-9d86-4281-a56f-978054f22f7f`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:31:21,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:31:21,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:31:21,549::task::974::TaskManager.Task::(_decref) Task=`9057f56d-9d86-4281-a56f-978054f22f7f`::ref 0 aborting False >Thread-17110::DEBUG::2014-01-16 17:31:21,550::task::579::TaskManager.Task::(_updateState) Task=`3727d1c4-d0ba-4f8c-8b52-8b553929daeb`::moving from state init -> state preparing >Thread-17110::INFO::2014-01-16 17:31:21,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='791252e4-860f-4485-946b-4bfbce63bf47', volUUID='1d38ecee-e6e8-4b9c-8c7e-7f301b592bca', options=None) >Thread-17110::INFO::2014-01-16 17:31:21,550::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:31:21,550::task::1168::TaskManager.Task::(prepare) Task=`3727d1c4-d0ba-4f8c-8b52-8b553929daeb`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-17110::DEBUG::2014-01-16 17:31:21,551::task::579::TaskManager.Task::(_updateState) Task=`3727d1c4-d0ba-4f8c-8b52-8b553929daeb`::moving from state preparing -> state finished >Thread-17110::DEBUG::2014-01-16 17:31:21,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17110::DEBUG::2014-01-16 17:31:21,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17110::DEBUG::2014-01-16 17:31:21,551::task::974::TaskManager.Task::(_decref) Task=`3727d1c4-d0ba-4f8c-8b52-8b553929daeb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:21,937::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:22,938::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:23,005::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:23,945::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:31:23,946::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:24,006::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-227488::DEBUG::2014-01-16 17:31:24,819::task::579::TaskManager.Task::(_updateState) Task=`250d76c5-d1bf-44bc-baf0-a3f19a63a728`::moving from state init -> state preparing >Thread-227488::INFO::2014-01-16 17:31:24,819::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='279a8eed-a876-43bb-9ec8-f2665366af1a', volUUID='d046cdf6-6357-40c8-a5d4-5f83e778a744', options=None) >Thread-227488::INFO::2014-01-16 17:31:24,819::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:31:24,819::task::1168::TaskManager.Task::(prepare) Task=`250d76c5-d1bf-44bc-baf0-a3f19a63a728`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-227488::DEBUG::2014-01-16 17:31:24,819::task::579::TaskManager.Task::(_updateState) Task=`250d76c5-d1bf-44bc-baf0-a3f19a63a728`::moving from state preparing -> state finished >Thread-227488::DEBUG::2014-01-16 17:31:24,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227488::DEBUG::2014-01-16 17:31:24,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227488::DEBUG::2014-01-16 17:31:24,820::task::974::TaskManager.Task::(_decref) Task=`250d76c5-d1bf-44bc-baf0-a3f19a63a728`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:24,946::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:31:24,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:25,007::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:25,947::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-288336::DEBUG::2014-01-16 17:31:26,143::task::579::TaskManager.Task::(_updateState) Task=`ba7f9858-e9c2-405f-aa6b-0e6ccff8e769`::moving from state init -> state preparing >Thread-288336::INFO::2014-01-16 17:31:26,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288336::INFO::2014-01-16 17:31:26,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300426', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278998', 'lastCheck': '5.4', 'valid': True}} >Thread-288336::DEBUG::2014-01-16 17:31:26,144::task::1168::TaskManager.Task::(prepare) Task=`ba7f9858-e9c2-405f-aa6b-0e6ccff8e769`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000300426', 'lastCheck': '8.2', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278998', 'lastCheck': '5.4', 'valid': True}} >Thread-288336::DEBUG::2014-01-16 17:31:26,144::task::579::TaskManager.Task::(_updateState) Task=`ba7f9858-e9c2-405f-aa6b-0e6ccff8e769`::moving from state preparing -> state finished >Thread-288336::DEBUG::2014-01-16 17:31:26,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288336::DEBUG::2014-01-16 17:31:26,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288336::DEBUG::2014-01-16 17:31:26,145::task::974::TaskManager.Task::(_decref) Task=`ba7f9858-e9c2-405f-aa6b-0e6ccff8e769`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:26,948::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:27,008::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-49313::DEBUG::2014-01-16 17:31:27,579::task::579::TaskManager.Task::(_updateState) Task=`c2ee989a-5228-4de7-87b2-5d79d8e960f5`::moving from state init -> state preparing >Thread-49313::INFO::2014-01-16 17:31:27,580::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7bf60baf-8dd6-41f3-b547-e521b75494e4', volUUID='c3a9117d-5ce5-40e1-b517-acbd0ff1a7f6', options=None) >Thread-49313::INFO::2014-01-16 17:31:27,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:31:27,580::task::1168::TaskManager.Task::(prepare) Task=`c2ee989a-5228-4de7-87b2-5d79d8e960f5`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-49313::DEBUG::2014-01-16 17:31:27,580::task::579::TaskManager.Task::(_updateState) Task=`c2ee989a-5228-4de7-87b2-5d79d8e960f5`::moving from state preparing -> state finished >Thread-49313::DEBUG::2014-01-16 17:31:27,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49313::DEBUG::2014-01-16 17:31:27,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49313::DEBUG::2014-01-16 17:31:27,581::task::974::TaskManager.Task::(_decref) Task=`c2ee989a-5228-4de7-87b2-5d79d8e960f5`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:31:27,938::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:31:27,953::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:31:27,956::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00025201 s, 1.4 MB/s\n'; <rc> = 0 >Thread-15207::DEBUG::2014-01-16 17:31:28,614::task::579::TaskManager.Task::(_updateState) Task=`453dd3a3-d79c-43bb-88a9-43ecb2835559`::moving from state init -> state preparing >Thread-15207::INFO::2014-01-16 17:31:28,614::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='188ed094-d107-43e3-a20a-cb9c472bb88e', volUUID='a252d60c-946b-4f2b-a5ed-543609c7952a', options=None) >Thread-15207::INFO::2014-01-16 17:31:28,616::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:31:28,616::task::1168::TaskManager.Task::(prepare) Task=`453dd3a3-d79c-43bb-88a9-43ecb2835559`::finished: {'truesize': '12884901888', 'apparentsize': '12884901888'} >Thread-15207::DEBUG::2014-01-16 17:31:28,616::task::579::TaskManager.Task::(_updateState) Task=`453dd3a3-d79c-43bb-88a9-43ecb2835559`::moving from state preparing -> state finished >Thread-15207::DEBUG::2014-01-16 17:31:28,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15207::DEBUG::2014-01-16 17:31:28,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15207::DEBUG::2014-01-16 17:31:28,616::task::974::TaskManager.Task::(_decref) Task=`453dd3a3-d79c-43bb-88a9-43ecb2835559`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:28,955::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:29,010::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:29,011::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:29,956::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:31:29,957::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:31:29,957::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:31:30,771::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:31:30,788::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000241003 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:30,958::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:31:30,959::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:31,013::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:31,960::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:31:31,960::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:31:31,960::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:32,962::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:31:32,962::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:33,014::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48934::DEBUG::2014-01-16 17:31:33,350::task::579::TaskManager.Task::(_updateState) Task=`8e8b2a38-7e07-4bf1-b1e9-dfe544659940`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:31:33,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='07e4ac73-fa61-45fa-83e2-0ecf6073c71e', volUUID='07217843-1507-441f-9d51-16c31824358e', options=None) >Thread-48934::INFO::2014-01-16 17:31:33,351::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:31:33,351::task::1168::TaskManager.Task::(prepare) Task=`8e8b2a38-7e07-4bf1-b1e9-dfe544659940`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-48934::DEBUG::2014-01-16 17:31:33,351::task::579::TaskManager.Task::(_updateState) Task=`8e8b2a38-7e07-4bf1-b1e9-dfe544659940`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:31:33,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:31:33,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:31:33,353::task::974::TaskManager.Task::(_decref) Task=`8e8b2a38-7e07-4bf1-b1e9-dfe544659940`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:31:33,353::task::579::TaskManager.Task::(_updateState) Task=`fc8ddd57-c124-4dee-b341-479cb39dfbb4`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:31:33,353::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='6c669d0a-4b98-4a22-a0dc-884b0c918940', volUUID='e5b0611c-de77-4426-b625-a31cc7a9f3d0', options=None) >Thread-48934::INFO::2014-01-16 17:31:33,354::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:31:33,354::task::1168::TaskManager.Task::(prepare) Task=`fc8ddd57-c124-4dee-b341-479cb39dfbb4`::finished: {'truesize': '11811160064', 'apparentsize': '11811160064'} >Thread-48934::DEBUG::2014-01-16 17:31:33,354::task::579::TaskManager.Task::(_updateState) Task=`fc8ddd57-c124-4dee-b341-479cb39dfbb4`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:31:33,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:31:33,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:31:33,354::task::974::TaskManager.Task::(_decref) Task=`fc8ddd57-c124-4dee-b341-479cb39dfbb4`::ref 0 aborting False >Thread-48934::DEBUG::2014-01-16 17:31:33,355::task::579::TaskManager.Task::(_updateState) Task=`3b47a72f-f202-4847-9d79-0517419dc1ad`::moving from state init -> state preparing >Thread-48934::INFO::2014-01-16 17:31:33,355::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='c36e7811-c2c3-4bb9-8fda-83e8d6d115c0', volUUID='247fa821-8958-4a7b-81c2-b139c74c7ab4', options=None) >Thread-48934::INFO::2014-01-16 17:31:33,355::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:31:33,355::task::1168::TaskManager.Task::(prepare) Task=`3b47a72f-f202-4847-9d79-0517419dc1ad`::finished: {'truesize': '206158430208', 'apparentsize': '206158430208'} >Thread-48934::DEBUG::2014-01-16 17:31:33,355::task::579::TaskManager.Task::(_updateState) Task=`3b47a72f-f202-4847-9d79-0517419dc1ad`::moving from state preparing -> state finished >Thread-48934::DEBUG::2014-01-16 17:31:33,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48934::DEBUG::2014-01-16 17:31:33,356::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48934::DEBUG::2014-01-16 17:31:33,356::task::974::TaskManager.Task::(_decref) Task=`3b47a72f-f202-4847-9d79-0517419dc1ad`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:33,963::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:31:33,963::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:34,017::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:31:34,017::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:31:34,024::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:34,964::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:35,025::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189046::DEBUG::2014-01-16 17:31:35,279::task::579::TaskManager.Task::(_updateState) Task=`7dec620b-3b23-41f3-b0f7-f1fa2dd16f65`::moving from state init -> state preparing >Thread-189046::INFO::2014-01-16 17:31:35,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a740bb9-88b1-45fa-83e4-826637e7ff2e', volUUID='6006353f-f3c3-44b6-b0b4-fb1407ba2863', options=None) >Thread-189046::INFO::2014-01-16 17:31:35,280::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:31:35,280::task::1168::TaskManager.Task::(prepare) Task=`7dec620b-3b23-41f3-b0f7-f1fa2dd16f65`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-189046::DEBUG::2014-01-16 17:31:35,280::task::579::TaskManager.Task::(_updateState) Task=`7dec620b-3b23-41f3-b0f7-f1fa2dd16f65`::moving from state preparing -> state finished >Thread-189046::DEBUG::2014-01-16 17:31:35,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189046::DEBUG::2014-01-16 17:31:35,281::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189046::DEBUG::2014-01-16 17:31:35,281::task::974::TaskManager.Task::(_decref) Task=`7dec620b-3b23-41f3-b0f7-f1fa2dd16f65`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:35,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:31:35,965::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:36,965::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:31:36,966::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:37,027::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-20::DEBUG::2014-01-16 17:31:37,963::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:31:37,978::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:31:37,980::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:31:37,981::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:31:37,983::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:31:37,985::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000306368 s, 1.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:38,985::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:31:38,986::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:31:38,986::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:39,028::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:39,029::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-3175::DEBUG::2014-01-16 17:31:39,211::task::579::TaskManager.Task::(_updateState) Task=`c09a2283-b53e-4585-9f99-4ee58d61e6f5`::moving from state init -> state preparing >Thread-3175::INFO::2014-01-16 17:31:39,211::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='ce9a1ad8-bd88-4ddb-90de-b761dec2a478', volUUID='412b4fc1-b60e-479a-a5b9-a1f04f4bb261', options=None) >Thread-3175::INFO::2014-01-16 17:31:39,211::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:31:39,211::task::1168::TaskManager.Task::(prepare) Task=`c09a2283-b53e-4585-9f99-4ee58d61e6f5`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-3175::DEBUG::2014-01-16 17:31:39,212::task::579::TaskManager.Task::(_updateState) Task=`c09a2283-b53e-4585-9f99-4ee58d61e6f5`::moving from state preparing -> state finished >Thread-3175::DEBUG::2014-01-16 17:31:39,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3175::DEBUG::2014-01-16 17:31:39,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3175::DEBUG::2014-01-16 17:31:39,212::task::974::TaskManager.Task::(_decref) Task=`c09a2283-b53e-4585-9f99-4ee58d61e6f5`::ref 0 aborting False >Thread-59295::DEBUG::2014-01-16 17:31:39,291::task::579::TaskManager.Task::(_updateState) Task=`e4967895-9f6c-413c-aeda-90746050fc89`::moving from state init -> state preparing >Thread-59295::INFO::2014-01-16 17:31:39,291::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='a4dd82a6-f089-47f2-a43c-1b8dab6f132f', volUUID='c81c07de-9396-4eec-addf-465b745b02c0', options=None) >Thread-59295::INFO::2014-01-16 17:31:39,291::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:31:39,291::task::1168::TaskManager.Task::(prepare) Task=`e4967895-9f6c-413c-aeda-90746050fc89`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-59295::DEBUG::2014-01-16 17:31:39,292::task::579::TaskManager.Task::(_updateState) Task=`e4967895-9f6c-413c-aeda-90746050fc89`::moving from state preparing -> state finished >Thread-59295::DEBUG::2014-01-16 17:31:39,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59295::DEBUG::2014-01-16 17:31:39,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59295::DEBUG::2014-01-16 17:31:39,292::task::974::TaskManager.Task::(_decref) Task=`e4967895-9f6c-413c-aeda-90746050fc89`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:39,987::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:31:39,987::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:31:40,797::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:31:40,816::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000325441 s, 12.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:40,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >VM Channels Listener::DEBUG::2014-01-16 17:31:40,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 65. >VM Channels Listener::DEBUG::2014-01-16 17:31:40,988::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 74. >VM Channels Listener::DEBUG::2014-01-16 17:31:40,989::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:41,031::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-288342::DEBUG::2014-01-16 17:31:41,932::task::579::TaskManager.Task::(_updateState) Task=`262dad0c-8a56-4b0a-b7a1-4ff11ad6bd09`::moving from state init -> state preparing >Thread-288342::INFO::2014-01-16 17:31:41,932::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288342::INFO::2014-01-16 17:31:41,932::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306368', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325441', 'lastCheck': '1.1', 'valid': True}} >Thread-288342::DEBUG::2014-01-16 17:31:41,932::task::1168::TaskManager.Task::(prepare) Task=`262dad0c-8a56-4b0a-b7a1-4ff11ad6bd09`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306368', 'lastCheck': '3.9', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325441', 'lastCheck': '1.1', 'valid': True}} >Thread-288342::DEBUG::2014-01-16 17:31:41,933::task::579::TaskManager.Task::(_updateState) Task=`262dad0c-8a56-4b0a-b7a1-4ff11ad6bd09`::moving from state preparing -> state finished >Thread-288342::DEBUG::2014-01-16 17:31:41,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288342::DEBUG::2014-01-16 17:31:41,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288342::DEBUG::2014-01-16 17:31:41,933::task::974::TaskManager.Task::(_decref) Task=`262dad0c-8a56-4b0a-b7a1-4ff11ad6bd09`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:41,990::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:42,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 71. >VM Channels Listener::DEBUG::2014-01-16 17:31:42,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 75. >VM Channels Listener::DEBUG::2014-01-16 17:31:42,992::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 84. >VM Channels Listener::DEBUG::2014-01-16 17:31:42,993::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:42,993::guestIF::147::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Attempting connection to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-01-16 17:31:42,994::guestIF::158::vm.Vm::(_connect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Failed to connect to /var/lib/libvirt/qemu/channels/07fa40e1-6a7b-45e7-add2-8358594277cc.com.redhat.rhevm.vdsm with 111 >Thread-189817::DEBUG::2014-01-16 17:31:43,032::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:43,996::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:44,033::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-251420::DEBUG::2014-01-16 17:31:44,868::task::579::TaskManager.Task::(_updateState) Task=`2d471c40-f9da-4020-bae6-cd9920790e15`::moving from state init -> state preparing >Thread-251420::INFO::2014-01-16 17:31:44,868::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='da40bb2e-e7d6-4e29-aa38-08dd09a3b64e', volUUID='d891a230-520d-47b6-b554-8b35fcd3706b', options=None) >Thread-251420::INFO::2014-01-16 17:31:44,869::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:31:44,869::task::1168::TaskManager.Task::(prepare) Task=`2d471c40-f9da-4020-bae6-cd9920790e15`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-251420::DEBUG::2014-01-16 17:31:44,869::task::579::TaskManager.Task::(_updateState) Task=`2d471c40-f9da-4020-bae6-cd9920790e15`::moving from state preparing -> state finished >Thread-251420::DEBUG::2014-01-16 17:31:44,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251420::DEBUG::2014-01-16 17:31:44,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251420::DEBUG::2014-01-16 17:31:44,869::task::974::TaskManager.Task::(_decref) Task=`2d471c40-f9da-4020-bae6-cd9920790e15`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:44,996::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 77. >VM Channels Listener::DEBUG::2014-01-16 17:31:44,997::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 85. >VM Channels Listener::DEBUG::2014-01-16 17:31:44,997::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:45,035::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-48925::DEBUG::2014-01-16 17:31:45,519::task::579::TaskManager.Task::(_updateState) Task=`793b148a-2950-4c31-816a-81b5d969f797`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:31:45,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7343b8bc-ecdc-40d8-b9cd-0ec10ec43d08', volUUID='b072fe3b-e280-412b-b5d0-3ea32f450a59', options=None) >Thread-48925::INFO::2014-01-16 17:31:45,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:31:45,519::task::1168::TaskManager.Task::(prepare) Task=`793b148a-2950-4c31-816a-81b5d969f797`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-48925::DEBUG::2014-01-16 17:31:45,520::task::579::TaskManager.Task::(_updateState) Task=`793b148a-2950-4c31-816a-81b5d969f797`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:31:45,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:31:45,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:31:45,520::task::974::TaskManager.Task::(_decref) Task=`793b148a-2950-4c31-816a-81b5d969f797`::ref 0 aborting False >Thread-48925::DEBUG::2014-01-16 17:31:45,520::task::579::TaskManager.Task::(_updateState) Task=`7c4f8877-251c-4d0c-a6ae-c0d0eb9a6d5c`::moving from state init -> state preparing >Thread-48925::INFO::2014-01-16 17:31:45,520::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2864b3a0-2e79-422a-ad28-c5b0feb0097d', volUUID='0f903376-84a4-4930-8c7d-fde664e37d38', options=None) >Thread-48925::INFO::2014-01-16 17:31:45,521::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:31:45,521::task::1168::TaskManager.Task::(prepare) Task=`7c4f8877-251c-4d0c-a6ae-c0d0eb9a6d5c`::finished: {'truesize': '7516192768', 'apparentsize': '7516192768'} >Thread-48925::DEBUG::2014-01-16 17:31:45,521::task::579::TaskManager.Task::(_updateState) Task=`7c4f8877-251c-4d0c-a6ae-c0d0eb9a6d5c`::moving from state preparing -> state finished >Thread-48925::DEBUG::2014-01-16 17:31:45,521::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48925::DEBUG::2014-01-16 17:31:45,521::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48925::DEBUG::2014-01-16 17:31:45,521::task::974::TaskManager.Task::(_decref) Task=`7c4f8877-251c-4d0c-a6ae-c0d0eb9a6d5c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:45,998::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 61. >VM Channels Listener::DEBUG::2014-01-16 17:31:45,998::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 79. >VM Channels Listener::DEBUG::2014-01-16 17:31:45,999::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-3168::DEBUG::2014-01-16 17:31:46,536::task::579::TaskManager.Task::(_updateState) Task=`a0b3e3cc-124c-4de9-a4b7-44a07b563dc0`::moving from state init -> state preparing >Thread-3168::INFO::2014-01-16 17:31:46,537::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='be18a5ad-41e3-4605-9278-17d5cf651634', volUUID='bc16368f-c753-4cf8-9a42-5b8f4cf81f97', options=None) >Thread-3168::INFO::2014-01-16 17:31:46,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:31:46,537::task::1168::TaskManager.Task::(prepare) Task=`a0b3e3cc-124c-4de9-a4b7-44a07b563dc0`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-3168::DEBUG::2014-01-16 17:31:46,537::task::579::TaskManager.Task::(_updateState) Task=`a0b3e3cc-124c-4de9-a4b7-44a07b563dc0`::moving from state preparing -> state finished >Thread-3168::DEBUG::2014-01-16 17:31:46,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3168::DEBUG::2014-01-16 17:31:46,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3168::DEBUG::2014-01-16 17:31:46,538::task::974::TaskManager.Task::(_decref) Task=`a0b3e3cc-124c-4de9-a4b7-44a07b563dc0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:47,000::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64. >VM Channels Listener::DEBUG::2014-01-16 17:31:47,000::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 76. >VM Channels Listener::DEBUG::2014-01-16 17:31:47,000::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 80. >VM Channels Listener::DEBUG::2014-01-16 17:31:47,000::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:47,037::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16398::DEBUG::2014-01-16 17:31:47,877::task::579::TaskManager.Task::(_updateState) Task=`38e4f733-df08-4dd7-b3a7-3f644123c6b1`::moving from state init -> state preparing >Thread-16398::INFO::2014-01-16 17:31:47,877::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='500d3b3d-e915-4757-af16-41eb55c1dec9', volUUID='a5f639ed-efe8-4ce6-87bd-a3c86f19b33c', options=None) >Thread-16398::INFO::2014-01-16 17:31:47,878::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:31:47,878::task::1168::TaskManager.Task::(prepare) Task=`38e4f733-df08-4dd7-b3a7-3f644123c6b1`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16398::DEBUG::2014-01-16 17:31:47,878::task::579::TaskManager.Task::(_updateState) Task=`38e4f733-df08-4dd7-b3a7-3f644123c6b1`::moving from state preparing -> state finished >Thread-16398::DEBUG::2014-01-16 17:31:47,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16398::DEBUG::2014-01-16 17:31:47,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16398::DEBUG::2014-01-16 17:31:47,878::task::974::TaskManager.Task::(_decref) Task=`38e4f733-df08-4dd7-b3a7-3f644123c6b1`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:31:47,993::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:31:48,010::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:31:48,013::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.00029387 s, 1.2 MB/s\n'; <rc> = 0 >Thread-16393::DEBUG::2014-01-16 17:31:48,015::task::579::TaskManager.Task::(_updateState) Task=`1b12595e-7139-46b3-8e21-f28c99ae6363`::moving from state init -> state preparing >Thread-16393::INFO::2014-01-16 17:31:48,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='aa6f496d-3d9e-4970-92d6-f00165e8816a', volUUID='917d91c4-421a-44ee-b41b-9de6dc8b2c98', options=None) >Thread-16393::INFO::2014-01-16 17:31:48,016::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:31:48,016::task::1168::TaskManager.Task::(prepare) Task=`1b12595e-7139-46b3-8e21-f28c99ae6363`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16393::DEBUG::2014-01-16 17:31:48,016::task::579::TaskManager.Task::(_updateState) Task=`1b12595e-7139-46b3-8e21-f28c99ae6363`::moving from state preparing -> state finished >Thread-16393::DEBUG::2014-01-16 17:31:48,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16393::DEBUG::2014-01-16 17:31:48,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16393::DEBUG::2014-01-16 17:31:48,017::task::974::TaskManager.Task::(_decref) Task=`1b12595e-7139-46b3-8e21-f28c99ae6363`::ref 0 aborting False >Thread-69607::DEBUG::2014-01-16 17:31:48,025::task::579::TaskManager.Task::(_updateState) Task=`72de4c6f-5b31-4526-b024-e5da52977d95`::moving from state init -> state preparing >Thread-69607::INFO::2014-01-16 17:31:48,026::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='d151a724-b420-4b21-bd61-2ceaa4598083', volUUID='c705efe5-67a7-4c63-b435-466dff49a384', options=None) >Thread-69607::INFO::2014-01-16 17:31:48,026::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:31:48,026::task::1168::TaskManager.Task::(prepare) Task=`72de4c6f-5b31-4526-b024-e5da52977d95`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-69607::DEBUG::2014-01-16 17:31:48,026::task::579::TaskManager.Task::(_updateState) Task=`72de4c6f-5b31-4526-b024-e5da52977d95`::moving from state preparing -> state finished >Thread-69607::DEBUG::2014-01-16 17:31:48,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69607::DEBUG::2014-01-16 17:31:48,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69607::DEBUG::2014-01-16 17:31:48,027::task::974::TaskManager.Task::(_decref) Task=`72de4c6f-5b31-4526-b024-e5da52977d95`::ref 0 aborting False >Thread-12152::DEBUG::2014-01-16 17:31:48,796::task::579::TaskManager.Task::(_updateState) Task=`445c3752-70d9-4f70-abd8-848da0486da8`::moving from state init -> state preparing >Thread-12152::INFO::2014-01-16 17:31:48,796::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='3ae3ba20-4b86-4d8b-9d9c-49c2ba343bd6', volUUID='b1cd4644-8bcd-4921-991b-abf2df14c886', options=None) >Thread-12152::INFO::2014-01-16 17:31:48,797::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:31:48,797::task::1168::TaskManager.Task::(prepare) Task=`445c3752-70d9-4f70-abd8-848da0486da8`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-12152::DEBUG::2014-01-16 17:31:48,797::task::579::TaskManager.Task::(_updateState) Task=`445c3752-70d9-4f70-abd8-848da0486da8`::moving from state preparing -> state finished >Thread-12152::DEBUG::2014-01-16 17:31:48,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-12152::DEBUG::2014-01-16 17:31:48,797::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-12152::DEBUG::2014-01-16 17:31:48,797::task::974::TaskManager.Task::(_decref) Task=`445c3752-70d9-4f70-abd8-848da0486da8`::ref 0 aborting False >Thread-20952::DEBUG::2014-01-16 17:31:48,829::task::579::TaskManager.Task::(_updateState) Task=`7abf1edc-b0f5-4596-b1f5-01f706142dac`::moving from state init -> state preparing >Thread-20952::INFO::2014-01-16 17:31:48,829::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='e1859e88-05d3-4221-9c20-879d5dcfadc1', volUUID='6f118eed-043f-414f-bbcb-8911eee508f5', options=None) >Thread-20952::INFO::2014-01-16 17:31:48,829::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:31:48,829::task::1168::TaskManager.Task::(prepare) Task=`7abf1edc-b0f5-4596-b1f5-01f706142dac`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-20952::DEBUG::2014-01-16 17:31:48,829::task::579::TaskManager.Task::(_updateState) Task=`7abf1edc-b0f5-4596-b1f5-01f706142dac`::moving from state preparing -> state finished >Thread-20952::DEBUG::2014-01-16 17:31:48,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20952::DEBUG::2014-01-16 17:31:48,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20952::DEBUG::2014-01-16 17:31:48,830::task::974::TaskManager.Task::(_decref) Task=`7abf1edc-b0f5-4596-b1f5-01f706142dac`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:49,012::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 33. >VM Channels Listener::DEBUG::2014-01-16 17:31:49,012::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:49,038::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:49,040::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:31:49,041::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:31:49,043::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:50,013::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:31:50,821::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:31:50,842::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000288973 s, 14.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:51,014::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:51,044::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:52,015::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-287783::DEBUG::2014-01-16 17:31:52,775::task::579::TaskManager.Task::(_updateState) Task=`8155dea3-e6a9-4ac4-866a-58df53b2abf9`::moving from state init -> state preparing >Thread-287783::INFO::2014-01-16 17:31:52,775::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='2a34e0d0-6658-4ed4-ade1-f78c3c6919fa', volUUID='8688815d-b239-43d4-8688-813810a9b6b6', options=None) >Thread-287783::INFO::2014-01-16 17:31:52,776::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:31:52,777::task::1168::TaskManager.Task::(prepare) Task=`8155dea3-e6a9-4ac4-866a-58df53b2abf9`::finished: {'truesize': '42949672960', 'apparentsize': '42949672960'} >Thread-287783::DEBUG::2014-01-16 17:31:52,777::task::579::TaskManager.Task::(_updateState) Task=`8155dea3-e6a9-4ac4-866a-58df53b2abf9`::moving from state preparing -> state finished >Thread-287783::DEBUG::2014-01-16 17:31:52,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287783::DEBUG::2014-01-16 17:31:52,777::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287783::DEBUG::2014-01-16 17:31:52,777::task::974::TaskManager.Task::(_decref) Task=`8155dea3-e6a9-4ac4-866a-58df53b2abf9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:53,016::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:53,046::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:54,018::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62. >VM Channels Listener::DEBUG::2014-01-16 17:31:54,018::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:54,047::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:31:55,019::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 48. >VM Channels Listener::DEBUG::2014-01-16 17:31:55,020::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:55,048::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-16244::DEBUG::2014-01-16 17:31:55,874::task::579::TaskManager.Task::(_updateState) Task=`5ac9ea50-11b4-4d33-affe-cfe1d8dcd793`::moving from state init -> state preparing >Thread-16244::INFO::2014-01-16 17:31:55,875::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='94df40c8-abba-4e64-88d5-ab785e138021', volUUID='3561f8a5-291a-456e-817e-f05e1f339f71', options=None) >Thread-16244::INFO::2014-01-16 17:31:55,875::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:31:55,875::task::1168::TaskManager.Task::(prepare) Task=`5ac9ea50-11b4-4d33-affe-cfe1d8dcd793`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-16244::DEBUG::2014-01-16 17:31:55,875::task::579::TaskManager.Task::(_updateState) Task=`5ac9ea50-11b4-4d33-affe-cfe1d8dcd793`::moving from state preparing -> state finished >Thread-16244::DEBUG::2014-01-16 17:31:55,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16244::DEBUG::2014-01-16 17:31:55,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16244::DEBUG::2014-01-16 17:31:55,876::task::974::TaskManager.Task::(_decref) Task=`5ac9ea50-11b4-4d33-affe-cfe1d8dcd793`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:31:56,020::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:31:57,022::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:57,050::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84377::DEBUG::2014-01-16 17:31:57,424::task::579::TaskManager.Task::(_updateState) Task=`a69d503e-c8dc-48b8-81c9-8fa4c7f7f2d9`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:31:57,424::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='27c456f0-df51-4348-bd16-7e534eace204', volUUID='2f411a38-d485-4db5-bbbd-c3586d817b57', options=None) >Thread-84377::INFO::2014-01-16 17:31:57,424::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:31:57,424::task::1168::TaskManager.Task::(prepare) Task=`a69d503e-c8dc-48b8-81c9-8fa4c7f7f2d9`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-84377::DEBUG::2014-01-16 17:31:57,425::task::579::TaskManager.Task::(_updateState) Task=`a69d503e-c8dc-48b8-81c9-8fa4c7f7f2d9`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:31:57,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:31:57,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:31:57,425::task::974::TaskManager.Task::(_decref) Task=`a69d503e-c8dc-48b8-81c9-8fa4c7f7f2d9`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:31:57,425::task::579::TaskManager.Task::(_updateState) Task=`80f258e0-ca18-4e84-bd99-90a23937347f`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:31:57,425::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='fc54170f-db36-4b3a-970b-8518ad3a40ed', volUUID='90c2561e-71f9-47e9-a071-aae28fcc39c5', options=None) >Thread-84377::INFO::2014-01-16 17:31:57,426::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:31:57,426::task::1168::TaskManager.Task::(prepare) Task=`80f258e0-ca18-4e84-bd99-90a23937347f`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:31:57,426::task::579::TaskManager.Task::(_updateState) Task=`80f258e0-ca18-4e84-bd99-90a23937347f`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:31:57,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:31:57,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:31:57,426::task::974::TaskManager.Task::(_decref) Task=`80f258e0-ca18-4e84-bd99-90a23937347f`::ref 0 aborting False >Thread-84377::DEBUG::2014-01-16 17:31:57,427::task::579::TaskManager.Task::(_updateState) Task=`7fd40478-4cf9-4c5c-a98b-3d6e6e36f9ac`::moving from state init -> state preparing >Thread-84377::INFO::2014-01-16 17:31:57,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='7785a938-0eab-4f7c-a429-e487dbee319f', volUUID='1d724fba-a002-4b2a-bc8e-c4a7a959f68a', options=None) >Thread-84377::INFO::2014-01-16 17:31:57,427::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:31:57,427::task::1168::TaskManager.Task::(prepare) Task=`7fd40478-4cf9-4c5c-a98b-3d6e6e36f9ac`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-84377::DEBUG::2014-01-16 17:31:57,427::task::579::TaskManager.Task::(_updateState) Task=`7fd40478-4cf9-4c5c-a98b-3d6e6e36f9ac`::moving from state preparing -> state finished >Thread-84377::DEBUG::2014-01-16 17:31:57,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84377::DEBUG::2014-01-16 17:31:57,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84377::DEBUG::2014-01-16 17:31:57,428::task::974::TaskManager.Task::(_decref) Task=`7fd40478-4cf9-4c5c-a98b-3d6e6e36f9ac`::ref 0 aborting False >Thread-288348::DEBUG::2014-01-16 17:31:57,696::task::579::TaskManager.Task::(_updateState) Task=`f04be605-b909-4146-a14b-a649458875de`::moving from state init -> state preparing >Thread-288348::INFO::2014-01-16 17:31:57,696::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-288348::INFO::2014-01-16 17:31:57,696::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029387', 'lastCheck': '9.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288973', 'lastCheck': '6.9', 'valid': True}} >Thread-288348::DEBUG::2014-01-16 17:31:57,697::task::1168::TaskManager.Task::(prepare) Task=`f04be605-b909-4146-a14b-a649458875de`::finished: {u'29d81073-5ffb-4757-82bc-d07e3b443a03': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00029387', 'lastCheck': '9.7', 'valid': True}, u'a08b74fb-7dbf-4ef4-8caa-0e53c0056a02': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288973', 'lastCheck': '6.9', 'valid': True}} >Thread-288348::DEBUG::2014-01-16 17:31:57,697::task::579::TaskManager.Task::(_updateState) Task=`f04be605-b909-4146-a14b-a649458875de`::moving from state preparing -> state finished >Thread-288348::DEBUG::2014-01-16 17:31:57,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-288348::DEBUG::2014-01-16 17:31:57,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288348::DEBUG::2014-01-16 17:31:57,697::task::974::TaskManager.Task::(_decref) Task=`f04be605-b909-4146-a14b-a649458875de`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:31:58,020::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:31:58,035::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:31:58,037::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000290493 s, 1.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:31:59,036::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:31:59,051::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:31:59,052::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:32:00,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 51. >VM Channels Listener::DEBUG::2014-01-16 17:32:00,037::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 72. >VM Channels Listener::DEBUG::2014-01-16 17:32:00,038::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:32:00,847::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:32:00,868::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00382911 s, 1.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-01-16 17:32:01,039::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 54. >VM Channels Listener::DEBUG::2014-01-16 17:32:01,039::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:32:01,054::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-221160::DEBUG::2014-01-16 17:32:01,255::task::579::TaskManager.Task::(_updateState) Task=`574b01b3-0105-4965-90eb-228a037e1eec`::moving from state init -> state preparing >Thread-221160::INFO::2014-01-16 17:32:01,255::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='b3484273-2e7d-4b8f-b83c-03f8ce41e220', volUUID='2470055b-e8b6-4bf1-9b76-6a6c2c7cff0f', options=None) >Thread-221160::INFO::2014-01-16 17:32:01,255::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:32:01,255::task::1168::TaskManager.Task::(prepare) Task=`574b01b3-0105-4965-90eb-228a037e1eec`::finished: {'truesize': '10737418240', 'apparentsize': '10737418240'} >Thread-221160::DEBUG::2014-01-16 17:32:01,256::task::579::TaskManager.Task::(_updateState) Task=`574b01b3-0105-4965-90eb-228a037e1eec`::moving from state preparing -> state finished >Thread-221160::DEBUG::2014-01-16 17:32:01,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-221160::DEBUG::2014-01-16 17:32:01,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-221160::DEBUG::2014-01-16 17:32:01,256::task::974::TaskManager.Task::(_decref) Task=`574b01b3-0105-4965-90eb-228a037e1eec`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:32:02,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 52. >VM Channels Listener::DEBUG::2014-01-16 17:32:02,041::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 82. >VM Channels Listener::DEBUG::2014-01-16 17:32:02,041::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:32:03,043::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 26. >VM Channels Listener::DEBUG::2014-01-16 17:32:03,043::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:32:03,055::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:32:04,044::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 63. >VM Channels Listener::DEBUG::2014-01-16 17:32:04,045::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:32:04,057::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 1 edom: 10 level: 2 message: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::ERROR::2014-01-16 17:32:04,057::sampling::355::vm.Vm::(collect) vmId=`07fa40e1-6a7b-45e7-add2-8358594277cc`::Stats function failed: <AdvancedStatsFunction _sampleCpu at 0x1f34570> >Traceback (most recent call last): > File "/usr/share/vdsm/sampling.py", line 351, in collect > statsFunction() > File "/usr/share/vdsm/sampling.py", line 226, in __call__ > retValue = self._function(*args, **kwargs) > File "/usr/share/vdsm/vm.py", line 540, in _sampleCpu > cpuStats = self._vm._dom.getCPUStats(True, 0) > File "/usr/share/vdsm/vm.py", line 842, in f > ret = attr(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper > ret = f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1868, in getCPUStats > if ret is None: raise libvirtError ('virDomainGetCPUStats() failed', dom=self) >libvirtError: internal error No such domain ú@áj{EçÒXYBwÌ >Thread-189817::DEBUG::2014-01-16 17:32:04,058::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:32:05,046::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:32:05,059::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:32:06,047::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 59. >VM Channels Listener::DEBUG::2014-01-16 17:32:06,048::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >VM Channels Listener::DEBUG::2014-01-16 17:32:07,049::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 68. >VM Channels Listener::DEBUG::2014-01-16 17:32:07,049::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-189817::DEBUG::2014-01-16 17:32:07,061::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-84941::DEBUG::2014-01-16 17:32:07,954::task::579::TaskManager.Task::(_updateState) Task=`b5263dbc-f098-4254-8310-7665c87357fd`::moving from state init -> state preparing >Thread-84941::INFO::2014-01-16 17:32:07,955::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='9bd2c165-ab4f-40fb-93f4-1dffa9b9e67a', volUUID='65dd79e2-31a1-434a-8455-33ed11c5809a', options=None) >Thread-84941::INFO::2014-01-16 17:32:07,955::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:32:07,955::task::1168::TaskManager.Task::(prepare) Task=`b5263dbc-f098-4254-8310-7665c87357fd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-84941::DEBUG::2014-01-16 17:32:07,956::task::579::TaskManager.Task::(_updateState) Task=`b5263dbc-f098-4254-8310-7665c87357fd`::moving from state preparing -> state finished >Thread-84941::DEBUG::2014-01-16 17:32:07,956::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84941::DEBUG::2014-01-16 17:32:07,956::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84941::DEBUG::2014-01-16 17:32:07,956::task::974::TaskManager.Task::(_decref) Task=`b5263dbc-f098-4254-8310-7665c87357fd`::ref 0 aborting False >Thread-20::DEBUG::2014-01-16 17:32:08,044::fileSD::239::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/lab-rhevm.gsslab.brq.redhat.com:_export_isos/29d81073-5ffb-4757-82bc-d07e3b443a03/dom_md/metadata bs=4096 count=1' (cwd None) >VM Channels Listener::DEBUG::2014-01-16 17:32:08,059::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 7. >VM Channels Listener::DEBUG::2014-01-16 17:32:08,060::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 44. >VM Channels Listener::DEBUG::2014-01-16 17:32:08,061::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 57. >VM Channels Listener::DEBUG::2014-01-16 17:32:08,062::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-20::DEBUG::2014-01-16 17:32:08,064::fileSD::239::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n365 bytes (365 B) copied, 0.000258577 s, 1.4 MB/s\n'; <rc> = 0 >Thread-189817::DEBUG::2014-01-16 17:32:09,062::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >Thread-189817::DEBUG::2014-01-16 17:32:09,063::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '07fa40e1-6a7b-45e7-add2-8358594277cc' >VM Channels Listener::DEBUG::2014-01-16 17:32:09,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 60. >VM Channels Listener::DEBUG::2014-01-16 17:32:09,064::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 92. >VM Channels Listener::DEBUG::2014-01-16 17:32:09,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-53040::DEBUG::2014-01-16 17:32:09,826::task::579::TaskManager.Task::(_updateState) Task=`32a13b26-b8b3-495a-a3dc-d831fa5b093d`::moving from state init -> state preparing >Thread-53040::INFO::2014-01-16 17:32:09,826::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='0da99cca-a096-4a3b-97e8-795683da5c6c', volUUID='378e4a64-f980-4bae-aae1-fc5a0f31435b', options=None) >Thread-53040::INFO::2014-01-16 17:32:09,828::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:32:09,828::task::1168::TaskManager.Task::(prepare) Task=`32a13b26-b8b3-495a-a3dc-d831fa5b093d`::finished: {'truesize': '8589934592', 'apparentsize': '8589934592'} >Thread-53040::DEBUG::2014-01-16 17:32:09,828::task::579::TaskManager.Task::(_updateState) Task=`32a13b26-b8b3-495a-a3dc-d831fa5b093d`::moving from state preparing -> state finished >Thread-53040::DEBUG::2014-01-16 17:32:09,828::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53040::DEBUG::2014-01-16 17:32:09,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53040::DEBUG::2014-01-16 17:32:09,829::task::974::TaskManager.Task::(_decref) Task=`32a13b26-b8b3-495a-a3dc-d831fa5b093d`::ref 0 aborting False >Thread-251782::DEBUG::2014-01-16 17:32:09,839::task::579::TaskManager.Task::(_updateState) Task=`7f97d346-e245-4443-8172-3ef3b8a7a643`::moving from state init -> state preparing >Thread-251782::INFO::2014-01-16 17:32:09,839::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='a08b74fb-7dbf-4ef4-8caa-0e53c0056a02', spUUID='b3088fcc-d291-11e1-933a-0015c5f4698c', imgUUID='23d1f9e3-41c1-45cd-b33a-d0dc9df8b197', volUUID='dbdcdc2f-a2b5-400a-9f0a-eb9652961d6b', options=None) >Thread-251782::INFO::2014-01-16 17:32:09,840::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:32:09,840::task::1168::TaskManager.Task::(prepare) Task=`7f97d346-e245-4443-8172-3ef3b8a7a643`::finished: {'truesize': '21474836480', 'apparentsize': '21474836480'} >Thread-251782::DEBUG::2014-01-16 17:32:09,840::task::579::TaskManager.Task::(_updateState) Task=`7f97d346-e245-4443-8172-3ef3b8a7a643`::moving from state preparing -> state finished >Thread-251782::DEBUG::2014-01-16 17:32:09,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251782::DEBUG::2014-01-16 17:32:09,840::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251782::DEBUG::2014-01-16 17:32:09,840::task::974::TaskManager.Task::(_decref) Task=`7f97d346-e245-4443-8172-3ef3b8a7a643`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-01-16 17:32:10,065::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 88. >VM Channels Listener::DEBUG::2014-01-16 17:32:10,065::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 81. >Thread-22::DEBUG::2014-01-16 17:32:10,876::blockSD::595::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a08b74fb-7dbf-4ef4-8caa-0e53c0056a02/metadata bs=4096 count=1' (cwd None) >Thread-22::DEBUG::2014-01-16 17:32:10,895::blockSD::595::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000222771 s, 18.4 MB/s\n'; <rc> = 0 >